Crawler overview

Software used in this course

Kill a small reptile with your hand (Part 1)

Kill a small reptile with your hand (Part 2)

Analysis of web request process (Part 1)

Analysis of web request process (Part 2)

http protocol (Part 1)

http protocol (below)

Getting Started with Requests-1

Getting Started with Requests-2

Getting Started with Requests-3

Getting Started with Requests-4

Getting Started with Requests-5

Added - turn off resp

Supplementary_py basics_character set issues

Data parsing overview

Re parsing regular expression-1

Re parsing regular expression-2

Re parsing regular expression-3

Re parsing regular expression-4

Python's re module uses -1

Python’s re module uses -2

Ranking of top 250 movies on Douban (Part 1)

Ranking of top 250 movies on Douban (Part 2)

Pirated Paradise Movie Information-1

Pirated Paradise Movie Information-2

Pirated Paradise Movie Information-3

Bs4 parsing foreplay-Html grammar rules-1

Introduction to Bs4 Analysis-Gagacai Price (1)

Introduction to Bs4 Analysis-Go Gao Cai Price (2)

Bs4 analysis case-grabbing beautiful gallery pictures (1)

Bs4 analysis case-grabbing beautiful gallery pictures (2)

Getting Started with Xpath-1

Getting Started with Xpath-2

Getting Started with Xpath-3

Getting Started with Xpath-4

Practical use of Xpath to capture Zhubajie.com information (1)

Practical use of Xpath to capture Zhubajie.com information (2)

Practical use of Xpath to capture Zhubajie.com information (3)

Advanced overview of Requests

Handling cookies Login to Novel Network (1)

Handling cookies Login to Novel Network (2)

Anti-hotlink capture pear video (1)

Anti-hotlink capture pear video (2)

Agent-1

Comprehensive training to capture NetEase Cloud music review information (1)

Comprehensive training to capture NetEase Cloud music review information (2)

Comprehensive training to capture NetEase Cloud music review information (3)

Comprehensive training to capture NetEase Cloud music review information (4)

Comprehensive training to capture NetEase Cloud music review information (5)

Comprehensive training to capture NetEase Cloud music review information (6)

Comprehensive training to capture NetEase Cloud music review information (7)

Multithreading(1)

Multithreading(2)

Multithreading-1

Getting Started with Thread Pools and Process Pools

Thread pool case_grabbing Xinfadi vegetable prices (Part 1)

Thread pool case_grabbing Xinfadi vegetable prices (Part 2)

Coroutine concept

Multi-task asynchronous coroutine (Part 1)

Multi-task asynchronous coroutine (Part 2)

Supplement - About asynchronous coroutines - obsolescence warning

Asynchronous http request aiohttp module explanation (Part 1)

Asynchronous http request aiohttp module explanation (Part 2)

Practical combat of asynchronous crawlers - stripping away a novel (Part 1)

Practical combat of asynchronous crawlers - stripping away a novel (Part 2)

Comprehensive training_How video websites work (Part 1)

Comprehensive training_How video websites work (Part 2)

Grab 91 and watch the drama_Simple version (Part 1)

Grab 91 to watch the drama_Simple version (Part 2)

Grab 91 and watch the drama_Simple version (Part 1)

Grab 91 to watch the drama_Simple version (Part 2)

Grab 91 to watch the drama_Complex Edition_1_Overview (Part 1)

Grab 91 to watch the drama_Complex Edition_1_Overview (Part 2)

Grab 91 to watch the drama_complex version_2_get the m3u8 path

Grab 91 to watch the drama_complex version_3_download m3u8 (Part 1)

Grab 91 to watch the drama_complex version_3_download m3u8 (Part 2)

Grab 91 to watch the drama_complex version_4_download video (Part 1)

Grab 91 to watch the drama_complex version_4_download video (Part 2)

Grab 91 to watch the drama_Complex version_5_Decryption (Part 1)

Grab 91 to watch the drama_Complex version_5_Decryption (Part 2)

_Catch 91 to watch the drama_Complex version_6_Merge video (Part 1)

Selenium introduces concepts (Part 1)

Selenium introduces concepts (Part 2)

selenium_Various operations_grabbing hook (Part 1)

selenium_Various operations_grabbing hook (Part 2)

selenium_various operations_switching between windows (Part 1)

selenium_Various operations_Switching between windows (Part 2)

selenium_Various Operations_Headless Browser (Part 1)

selenium_Various operations_Headless browser (Part 2)

selenium_Super Eagle processing verification code (Part 1)

selenium_Super Eagle processing verification code (Part 2)

selenium_super eagle fuck super eagle

selenium_solve the login problem of 12306 (1)

selenium_solve the login problem of 12306 (2)

selenium_solve the login problem of 12306 (4)

Python captures pictures of girls from the beautiful gallery

Grab Lagou.com recruitment information

Easy and simple explanation of recursion and small recursion cases

Simple analysis of lottery data

Use python automation tool selenium to capture 51job recruitment information

binary search

maze problem

Do movie box office

dry flask

Data visualization display

Regular expression_metacharacter

Regular expression_quantifier

Regular Expressions_Greedy and Lazy

re extract grouped data

Use Douban TOP250 data to capture

Capture movie paradise movie information_on

Capture movie paradise movie information_Part 2

html basic grammar rules

css selector syntax rules

css selector syntax rules_cut completed

bs4 practical case one

bs4 practical case 2

xpath analysis_on

xpath analysis_down

Anti-leech_grab pear video

Multithreading and multiprocessing

Multi-threading and multi-process-2

Multi-threading and multi-process-3

Multi-threading and multi-process-4

Multi-threading and multi-process-5

01_Multi-task asynchronous coroutine

02_Multi-task asynchronous coroutine

03_Multi-task asynchronous coroutine

04_Multi-task asynchronous coroutine

05_Multi-task asynchronous coroutine

06_Multi-task asynchronous coroutine

07_Multi-task asynchronous coroutine

08_Multi-task asynchronous coroutine

09_Multi-task asynchronous coroutine

01_Catch wbdy

02_Catch wbdy

04_Catch wbdy

05_Catch wbdy

06_Catch wbdy

07_Catch wbdy

08_Catch wbdy

09_Catch wbdy

10_grab wbdy

11_Catch wbdy

01_Getting started with selenium

02_Getting started with selenium

03_Getting started with selenium

Getting Started with Selenium-4

Getting Started with Selenium-5

Getting Started with Selenium-6

Getting Started with Selenium-7

Getting Started with Selenium-8

Getting Started with Selenium-9

Getting Started with Selenium-10

Selenium small advanced + case-1

Selenium small advanced + case-2

Selenium small advanced + case-3

Selenium small advanced + case-4

Selenium small advanced + case-5

Selenium small advanced + case-6

Selenium small advanced + case-7

Selenium small advanced + case-8

Selenium small advanced + case-9

Scrapy introduction and initial use-1

Scrapy introduction and initial use-2

Scrapy introduction and initial use-3

Scrapy introduction and initial use-4

Scrapy introduction and initial use-5

Scrapy introduction and initial use-6

Scrapy introduction and initial use-7

01 Scrapy pipeline

02 Scrapy pipeline

03 Scrapy pipeline

04 Scrapy pipeline

05 Scrapy pipeline

06 Scrapy pipeline

07 Scrapy pipeline

08 Scrapy pipeline

09 Scrapy pipeline

1Scrapy middleware uses -1

1Scrapy middleware usage-2

1Scrapy middleware usage-3

1Scrapy middleware usage -4

1Scrapy middleware uses -5

Scrapy simulated login and middleware-1

Scrapy simulated login and middleware-2

Scrapy simulated login and middleware-3

Scrapy simulated login and middleware-4

Scrapy simulated login and middleware-5

Scrapy simulated login and middleware-6

Scrapy simulated login and middleware-7

Scrapy simulated login and middleware-8

Scrapy simulated login and middleware-9

Scrapy site-wide data capture-1

Scrapy site-wide data capture-2