what is scrapy

Initial use of scrapy

Basic steps to use scrapy

Introduction to basic concepts 1-scrapy command line tool

Introduction to basic concepts 3-Important objects in scrapy

Introduction to scrapy built-in services

Advanced crawling - crawling of the "Western Thorns" website

Interpretation of the core code of the "Xiqi" website crawler

Practical Tip 1—Crawling Techniques for Multi-Level Pages

Practical Tip 2—Picture Capture

Frequently asked questions during the crawling process 1—Use of proxy IP

Frequently asked questions during the crawling process 2—Handling of cookies

Common problems in the crawling process 3—js processing skills

Introduction to scrapy’s deployment tool-scrapyd

Deploy scrapy to scrapyd

Course Summary