How Do I Properly Configure Proxies with Python\'s `requests` Module?

Configuring Proxies with 'Requests' in Python

The 'Requests' module provides a convenient option for handling proxies. However, the documentation can be unclear about how to format the 'proxies' variable. Let's clarify this issue.

Proper Syntax for Proxies

The 'proxies' variable should contain a dictionary where the keys represent the protocol (e.g., "http", "https") and the values represent the full URL of the proxy, including IP and port. For example:

proxies = {
    "http": "http://10.10.1.10:3128",
    "https": "https://10.10.1.11:1080",
    "ftp": "ftp://10.10.1.10:3128",
}

Using Environment Variables

Alternatively, on Linux, you can set the environment variables 'HTTP_PROXY', 'HTTPS_PROXY', and 'FTP_PROXY' with the proxy URLs. On Windows, use the 'set' command.

Integration with 'requests.get'

To use the configured proxies, pass the 'proxies' dictionary as an argument to the 'requests.get' function:

r = requests.get(url, headers=headers, proxies=proxies)

Additional Notes

• The values in the 'proxies' dictionary should be strings.
• The 'Requests' documentation states that the 'proxies' parameter should be a dictionary mapping protocols to proxy URLs, but it does not explicitly specify the required format for the values.
• The recommended way to specify the proxy configuration is through the 'proxies' dictionary rather than environment variables.

The above is the detailed content of How Do I Properly Configure Proxies with Python\'s `requests` Module?. For more information, please follow other related articles on the PHP Chinese website!