Don’t know if this has been solved yet but I was getting similar problems with Anaconda python 3.7.3 and Idle on Windows 10. Fixed it by adding: <path>\Anaconda3 <path>\Anaconda3\scripts <path>\Anaconda3\Library\bin to the PATH variable.
You can use a session object. It stores the cookies so you can make requests, and it handles the cookies for you s = requests.Session() # all cookies received will be stored in the session object s.post(‘http://www…’,data=payload) s.get(‘http://www…’) Docs: https://requests.readthedocs.io/en/master/user/advanced/#session-objects You can also save the cookie data to an external file, and then reload them … Read more
Reposting this here for others from the requests issue page: Requests’ does not support doing this before version 1. Subsequent to version 1, you are expected to subclass the HTTPAdapter, like so: from requests.adapters import HTTPAdapter from requests.packages.urllib3.poolmanager import PoolManager import ssl class MyAdapter(HTTPAdapter): def init_poolmanager(self, connections, maxsize, block=False): self.poolmanager = PoolManager(num_pools=connections, maxsize=maxsize, block=block, ssl_version=ssl.PROTOCOL_TLSv1) … Read more
You need to enable debugging at httplib level (requests → urllib3 → httplib). Here’s some functions to both toggle (…_on() and …_off()) or temporarily have it on: import logging import contextlib try: from http.client import HTTPConnection # py3 except ImportError: from httplib import HTTPConnection # py2 def debug_requests_on(): ”’Switches on logging of the requests module.”’ … Read more
I found out how to configure requests‘s logging level, it’s done via the standard logging module. I decided to configure it to not log messages unless they are at least warnings: import logging logging.getLogger(“requests”).setLevel(logging.WARNING) If you wish to apply this setting for the urllib3 library (typically used by requests) too, add the following: logging.getLogger(“urllib3”).setLevel(logging.WARNING)
This will not only change the max_retries but also enable a backoff strategy which makes requests to all http:// addresses sleep for a period of time before retrying (to a total of 5 times): import requests from requests.adapters import HTTPAdapter, Retry s = requests.Session() retries = Retry(total=5, backoff_factor=0.1, status_forcelist=[ 500, 502, 503, 504 ]) s.mount(‘http://’, … Read more
From the documentation: requests can also ignore verifying the SSL certificate if you set verify to False. >>> requests.get(‘https://kennethreitz.com’, verify=False) <Response [200]> If you’re using a third-party module and want to disable the checks, here’s a context manager that monkey patches requests and changes it so that verify=False is the default and suppresses the warning. … Read more
To use requests (or any other blocking libraries) with asyncio, you can use BaseEventLoop.run_in_executor to run a function in another thread and yield from it to get the result. For example: import asyncio import requests @asyncio.coroutine def main(): loop = asyncio.get_event_loop() future1 = loop.run_in_executor(None, requests.get, ‘http://www.google.com’) future2 = loop.run_in_executor(None, requests.get, ‘http://www.google.co.uk’) response1 = yield from … Read more
This error message… MaxRetryError: HTTPConnectionPool(host=”127.0.0.1″, port=51379): Max retries exceeded with url: /session/2e64d2a1-3c7f-4221-96fe-9d0b1c102195/window (Caused by ProtocolError(‘Connection aborted.’, error(111, ‘Connection refused’))) …implies that the call to self.driver.close() method failed raising MaxRetryError. A couple of things: First and foremost as per the discussion max-retries-exceeded exceptions are confusing the traceback is somewhat misleading. Requests wraps the exception for the … Read more
It seems the page rejects GET requests that do not identify a User-Agent. I visited the page with a browser (Chrome) and copied the User-Agent header of the GET request (look in the Network tab of the developer tools): import requests url=”http://worldagnetwork.com/” headers = {‘User-Agent’: ‘Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like … Read more