python - pyspider爬pdf爬了一小段时间后就不动了

Question

下载了一小部分之后就不动了，stop之后重新跑也没有任何反应，有人知道是怎么回事吗？谢谢大家。

Answer 1

Post the code, Saonian

Answer 2

According to the information at the top of the dashboard

There are 100 tasks in the queue from scheduler to fetcher
There are also 100 tasks in the queue from fetcher to processor
The downstream of processor are all empty

Because the default queue capacity is 100, this means that the processor is blocked. It depends on what the processor is doing and whether it is dead.