python - 代理导致Scrapy无法访问网站？

Answer 1

Turn off Lanten~

Answer 2

Answer source address: CSDN blog: Scrapy usage problems

At the end of the answer, it is mentioned that proxy problems cause some websites to be inaccessible. The solution is to modify it in settings.py:
DOWNLOADER_MIDDLEWARES = {

'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': None,

}

After testing and modification, the program can run

Answer 3

It should be that Lanten has changed the system's proxy, causing your crawler to be forced to use this proxy IP to access