How to Properly Send a User-Agent Header with Python\'s Requests Library?

Sending "User-Agent" Header with Requests in Python

When sending a request to a webpage using Python's Requests library, it's often necessary to specify a user-agent header to identify your bot or program. However, you may encounter some confusion about how to send this information correctly.

Question:

Is it acceptable to send the user-agent as a part of the header in the following code snippet?

debug = {'verbose': sys.stderr}
user_agent = {'User-agent': 'Mozilla/5.0'}
response  = requests.get(url, headers = user_agent, config=debug)

Answer:

Yes, it is acceptable to send the user-agent information in the header. The user-agent should be specified as a field in the header request.

For Requests v2.13 and Newer:

You can create a dictionary and specify your headers directly:

headers = {
    'User-Agent': 'My User Agent 1.0',
    'From': '[email protected]'  # This is another valid field
}

response = requests.get(url, headers=headers)

For Requests v2.12.x and Older:

To preserve default headers and add your own, you can do the following:

headers = requests.utils.default_headers()

headers.update(
    {
        'User-Agent': 'My User Agent 1.0',
    }
)

response = requests.get(url, headers=headers)

The above is the detailed content of How to Properly Send a User-Agent Header with Python\'s Requests Library?. For more information, please follow other related articles on the PHP Chinese website!