Crawler overview
09 minutes25 secondsSoftware used in this course
09 minutes40 secondsKill a small reptile with your hand (Part 1)
07 minutes30 secondsKill a small reptile with your hand (Part 2)
04 minutes15 secondsAnalysis of web request process (Part 1)
10 minutes59 secondsAnalysis of web request process (Part 2)
06 minutes06 secondshttp protocol (Part 1)
07 minutes00 secondshttp protocol (below)
06 minutes17 secondsGetting Started with Requests-1
07 minutes00 secondsGetting Started with Requests-2
08 minutes19 secondsGetting Started with Requests-3
06 minutes20 secondsGetting Started with Requests-4
08 minutes00 secondsGetting Started with Requests-5
08 minutes36 secondsAdded - turn off resp
02 minutes15 secondsSupplementary_py basics_character set issues
05 minutes55 secondsData parsing overview
02 minutes18 secondsRe parsing regular expression-1
10 minutes00 secondsRe parsing regular expression-2
09 minutes16 secondsRe parsing regular expression-3
07 minutes59 secondsRe parsing regular expression-4
09 minutes27 secondsPython's re module uses -1
10 minutes00 secondsPython’s re module uses -2
10 minutes59 secondsRanking of top 250 movies on Douban (Part 1)
10 minutes00 secondsRanking of top 250 movies on Douban (Part 2)
09 minutes31 secondsPirated Paradise Movie Information-1
10 minutes00 secondsPirated Paradise Movie Information-2
10 minutes13 secondsPirated Paradise Movie Information-3
10 minutes56 secondsBs4 parsing foreplay-Html grammar rules-1
11 minutes54 secondsIntroduction to Bs4 Analysis-Gagacai Price (1)
09 minutes59 secondsIntroduction to Bs4 Analysis-Go Gao Cai Price (2)
10 minutes08 secondsBs4 analysis case-grabbing beautiful gallery pictures (1)
12 minutes00 secondsBs4 analysis case-grabbing beautiful gallery pictures (2)
12 minutes35 secondsGetting Started with Xpath-1
07 minutes59 secondsGetting Started with Xpath-2
08 minutes49 secondsGetting Started with Xpath-3
07 minutes00 secondsGetting Started with Xpath-4
09 minutes09 secondsPractical use of Xpath to capture Zhubajie.com information (1)
10 minutes00 secondsPractical use of Xpath to capture Zhubajie.com information (2)
10 minutes12 secondsPractical use of Xpath to capture Zhubajie.com information (3)
06 minutes28 secondsAdvanced overview of Requests
02 minutes54 secondsHandling cookies Login to Novel Network (1)
10 minutes00 secondsHandling cookies Login to Novel Network (2)
08 minutes58 secondsAnti-hotlink capture pear video (1)
12 minutes00 secondsAnti-hotlink capture pear video (2)
13 minutes03 secondsAgent-1
09 minutes58 secondsComprehensive training to capture NetEase Cloud music review information (1)
10 minutes00 secondsComprehensive training to capture NetEase Cloud music review information (2)
10 minutes06 secondsComprehensive training to capture NetEase Cloud music review information (3)
10 minutes12 secondsComprehensive training to capture NetEase Cloud music review information (4)
10 minutes10 secondsComprehensive training to capture NetEase Cloud music review information (5)
10 minutes10 secondsComprehensive training to capture NetEase Cloud music review information (6)
10 minutes00 secondsComprehensive training to capture NetEase Cloud music review information (7)
06 minutes37 secondsMultithreading(1)
08 minutes00 secondsMultithreading(2)
07 minutes16 secondsMultithreading-1
06 minutes12 secondsGetting Started with Thread Pools and Process Pools
06 minutes59 secondsThread pool case_grabbing Xinfadi vegetable prices (Part 1)
09 minutes00 secondsThread pool case_grabbing Xinfadi vegetable prices (Part 2)
09 minutes41 secondsCoroutine concept
11 minutes31 secondsMulti-task asynchronous coroutine (Part 1)
12 minutes00 secondsMulti-task asynchronous coroutine (Part 2)
11 minutes54 secondsSupplement - About asynchronous coroutines - obsolescence warning
07 minutes09 secondsAsynchronous http request aiohttp module explanation (Part 1)
08 minutes00 secondsAsynchronous http request aiohttp module explanation (Part 2)
07 minutes44 secondsPractical combat of asynchronous crawlers - stripping away a novel (Part 1)
12 minutes00 secondsPractical combat of asynchronous crawlers - stripping away a novel (Part 2)
12 minutes15 secondsComprehensive training_How video websites work (Part 1)
09 minutes00 secondsComprehensive training_How video websites work (Part 2)
10 minutes02 secondsGrab 91 and watch the drama_Simple version (Part 1)
07 minutes00 secondsGrab 91 to watch the drama_Simple version (Part 2)
07 minutes40 secondsGrab 91 and watch the drama_Simple version (Part 1)
10 minutes00 secondsGrab 91 to watch the drama_Simple version (Part 2)
11 minutes13 secondsGrab 91 to watch the drama_Complex Edition_1_Overview (Part 1)
06 minutes00 secondsGrab 91 to watch the drama_Complex Edition_1_Overview (Part 2)
07 minutes40 secondsGrab 91 to watch the drama_complex version_2_get the m3u8 path
11 minutes00 secondsGrab 91 to watch the drama_complex version_3_download m3u8 (Part 1)
08 minutes00 secondsGrab 91 to watch the drama_complex version_3_download m3u8 (Part 2)
07 minutes36 secondsGrab 91 to watch the drama_complex version_4_download video (Part 1)
09 minutes00 secondsGrab 91 to watch the drama_complex version_4_download video (Part 2)
09 minutes01 secondsGrab 91 to watch the drama_Complex version_5_Decryption (Part 1)
07 minutes59 secondsGrab 91 to watch the drama_Complex version_5_Decryption (Part 2)
08 minutes16 seconds_Catch 91 to watch the drama_Complex version_6_Merge video (Part 1)
06 minutes00 secondsSelenium introduces concepts (Part 1)
07 minutes00 secondsSelenium introduces concepts (Part 2)
07 minutes39 secondsselenium_Various operations_grabbing hook (Part 1)
10 minutes00 secondsselenium_Various operations_grabbing hook (Part 2)
11 minutes21 secondsselenium_various operations_switching between windows (Part 1)
10 minutes00 secondsselenium_Various operations_Switching between windows (Part 2)
10 minutes49 secondsselenium_Various Operations_Headless Browser (Part 1)
10 minutes00 secondsselenium_Various operations_Headless browser (Part 2)
11 minutes51 secondsselenium_Super Eagle processing verification code (Part 1)
07 minutes00 secondsselenium_Super Eagle processing verification code (Part 2)
08 minutes08 secondsselenium_super eagle fuck super eagle
08 minutes58 secondsselenium_solve the login problem of 12306 (1)
10 minutes00 secondsselenium_solve the login problem of 12306 (2)
10 minutes05 secondsselenium_solve the login problem of 12306 (4)
09 minutes50 secondsPython captures pictures of girls from the beautiful gallery
41 minutes29 secondsGrab Lagou.com recruitment information
37 minutes26 secondsEasy and simple explanation of recursion and small recursion cases
52 minutes32 secondsSimple analysis of lottery data
43 minutes04 secondsUse python automation tool selenium to capture 51job recruitment information
52 minutes32 secondsbinary search
maze problem
Do movie box office
dry flask
Data visualization display
39 minutes11 secondsRegular expression_metacharacter
Regular expression_quantifier
Regular Expressions_Greedy and Lazy
re extract grouped data
Use Douban TOP250 data to capture
Capture movie paradise movie information_on
17 minutes27 secondsCapture movie paradise movie information_Part 2
14 minutes46 secondshtml basic grammar rules
css selector syntax rules
css selector syntax rules_cut completed
bs4 practical case one
12 minutes59 secondsbs4 practical case 2
xpath analysis_on
18 minutes35 secondsxpath analysis_down
06 minutes33 secondsAnti-leech_grab pear video
24 minutes56 secondsMultithreading and multiprocessing
Multi-threading and multi-process-2
Multi-threading and multi-process-3
Multi-threading and multi-process-4
Multi-threading and multi-process-5
01_Multi-task asynchronous coroutine
20 minutes00 seconds02_Multi-task asynchronous coroutine
20 minutes00 seconds03_Multi-task asynchronous coroutine
20 minutes00 seconds04_Multi-task asynchronous coroutine
05_Multi-task asynchronous coroutine
06_Multi-task asynchronous coroutine
07_Multi-task asynchronous coroutine
08_Multi-task asynchronous coroutine
09_Multi-task asynchronous coroutine
01_Catch wbdy
20 minutes00 seconds02_Catch wbdy
20 minutes00 seconds04_Catch wbdy
05_Catch wbdy
06_Catch wbdy
07_Catch wbdy
08_Catch wbdy
09_Catch wbdy
20 minutes00 seconds10_grab wbdy
11_Catch wbdy
01_Getting started with selenium
02_Getting started with selenium
03_Getting started with selenium
Getting Started with Selenium-4
Getting Started with Selenium-5
20 minutes01 secondsGetting Started with Selenium-6
Getting Started with Selenium-7
Getting Started with Selenium-8
Getting Started with Selenium-9
Getting Started with Selenium-10
09 minutes08 secondsSelenium small advanced + case-1
20 minutes01 secondsSelenium small advanced + case-2
20 minutes02 secondsSelenium small advanced + case-3
20 minutes05 secondsSelenium small advanced + case-4
Selenium small advanced + case-5
Selenium small advanced + case-6
Selenium small advanced + case-7
Selenium small advanced + case-8
Selenium small advanced + case-9
Scrapy introduction and initial use-1
20 minutes00 secondsScrapy introduction and initial use-2
20 minutes09 secondsScrapy introduction and initial use-3
20 minutes05 secondsScrapy introduction and initial use-4
Scrapy introduction and initial use-5
Scrapy introduction and initial use-6
Scrapy introduction and initial use-7
01 Scrapy pipeline
02 Scrapy pipeline
03 Scrapy pipeline
04 Scrapy pipeline
05 Scrapy pipeline
06 Scrapy pipeline
07 Scrapy pipeline
08 Scrapy pipeline
09 Scrapy pipeline
1Scrapy middleware uses -1
1Scrapy middleware usage-2
20 minutes04 seconds1Scrapy middleware usage-3
1Scrapy middleware usage -4
1Scrapy middleware uses -5
Scrapy simulated login and middleware-1
20 minutes00 secondsScrapy simulated login and middleware-2
20 minutes07 secondsScrapy simulated login and middleware-3
Scrapy simulated login and middleware-4
Scrapy simulated login and middleware-5
Scrapy simulated login and middleware-6
Scrapy simulated login and middleware-7
Scrapy simulated login and middleware-8
Scrapy simulated login and middleware-9
Scrapy site-wide data capture-1
19 minutes59 secondsScrapy site-wide data capture-2
The course is reproduced from Bilibili: https://www.bilibili.com/video/BV1ZT4y1d7JM