When I was writing the crawler, I found that after setting every in the code, after crawling once on the 21st, I saw that the result was not updated today, and the lastcrawltime was still on the 21st. Is my parameter setting incorrect?
迷茫2017-05-18 10:55:29
The picture of the task you posted, what task is it for?
The task posted is detail_page
The questioner set a time for index_page that is less than the cronjob interval. However, detail_page is not set. In this way, detail_page will not be rescheduled
Project queue status, what are the recent active tasks?
我想大声告诉你2017-05-18 10:55:29
It is possible that every and age do not match. If there is no problem with age, to be honest, this is a difficult disease. I often encounter it. I always go to taskdb to clear the corresponding table, then restart pyspider and re-run the project