Name: Complete version of Python crawler tutorial
Uploaded: 2023-05-17T14:47:09+8:00
Duration: 1567 min 37 s
Description: The course is reproduced from Bilibili: https://www.bilibili.com/video/BV1ZT4y1d7JM

Chapter1Chapter One: Crawler overview
09 minutes25 seconds; Software used in this course
09 minutes40 seconds; Kill a small reptile with your hand (Part 1)
07 minutes30 seconds; Kill a small reptile with your hand (Part 2)
04 minutes15 seconds; Analysis of web request process (Part 1)
10 minutes59 seconds; Analysis of web request process (Part 2)
06 minutes06 seconds; http protocol (Part 1)
07 minutes00 seconds; http protocol (below)
06 minutes17 seconds; Getting Started with Requests-1
07 minutes00 seconds; Getting Started with Requests-2
08 minutes19 seconds; Getting Started with Requests-3
06 minutes20 seconds; Getting Started with Requests-4
08 minutes00 seconds; Getting Started with Requests-5
08 minutes36 seconds; Added - turn off resp
02 minutes15 seconds; Supplementary_py basics_character set issues
05 minutes55 seconds
Chapter2Chapter two: Data parsing overview
02 minutes18 seconds; Re parsing regular expression-1
10 minutes00 seconds; Re parsing regular expression-2
09 minutes16 seconds; Re parsing regular expression-3
07 minutes59 seconds; Re parsing regular expression-4
09 minutes27 seconds; Python's re module uses -1
10 minutes00 seconds; Python’s re module uses -2
10 minutes59 seconds; Ranking of top 250 movies on Douban (Part 1)
10 minutes00 seconds; Ranking of top 250 movies on Douban (Part 2)
09 minutes31 seconds; Pirated Paradise Movie Information-1
10 minutes00 seconds; Pirated Paradise Movie Information-2
10 minutes13 seconds; Pirated Paradise Movie Information-3
10 minutes56 seconds; Bs4 parsing foreplay-Html grammar rules-1
11 minutes54 seconds; Introduction to Bs4 Analysis-Gagacai Price (1)
09 minutes59 seconds; Introduction to Bs4 Analysis-Go Gao Cai Price (2)
10 minutes08 seconds; Bs4 analysis case-grabbing beautiful gallery pictures (1)
12 minutes00 seconds; Bs4 analysis case-grabbing beautiful gallery pictures (2)
12 minutes35 seconds; Getting Started with Xpath-1
07 minutes59 seconds; Getting Started with Xpath-2
08 minutes49 seconds; Getting Started with Xpath-3
07 minutes00 seconds; Getting Started with Xpath-4
09 minutes09 seconds; Practical use of Xpath to capture Zhubajie.com information (1)
10 minutes00 seconds; Practical use of Xpath to capture Zhubajie.com information (2)
10 minutes12 seconds; Practical use of Xpath to capture Zhubajie.com information (3)
06 minutes28 seconds
Chapter3third chapter: Advanced overview of Requests
02 minutes54 seconds; Handling cookies Login to Novel Network (1)
10 minutes00 seconds; Handling cookies Login to Novel Network (2)
08 minutes58 seconds; Anti-hotlink capture pear video (1)
12 minutes00 seconds; Anti-hotlink capture pear video (2)
13 minutes03 seconds; Agent-1
09 minutes58 seconds; Comprehensive training to capture NetEase Cloud music review information (1)
10 minutes00 seconds; Comprehensive training to capture NetEase Cloud music review information (2)
10 minutes06 seconds; Comprehensive training to capture NetEase Cloud music review information (3)
10 minutes12 seconds; Comprehensive training to capture NetEase Cloud music review information (4)
10 minutes10 seconds; Comprehensive training to capture NetEase Cloud music review information (5)
10 minutes10 seconds; Comprehensive training to capture NetEase Cloud music review information (6)
10 minutes00 seconds; Comprehensive training to capture NetEase Cloud music review information (7)
06 minutes37 seconds; Multithreading(1)
08 minutes00 seconds; Multithreading(2)
07 minutes16 seconds; Multithreading-1
06 minutes12 seconds; Getting Started with Thread Pools and Process Pools
06 minutes59 seconds; Thread pool case_grabbing Xinfadi vegetable prices (Part 1)
09 minutes00 seconds; Thread pool case_grabbing Xinfadi vegetable prices (Part 2)
09 minutes41 seconds
Chapter4Chapter Four: Coroutine concept
11 minutes31 seconds; Multi-task asynchronous coroutine (Part 1)
12 minutes00 seconds; Multi-task asynchronous coroutine (Part 2)
11 minutes54 seconds; Supplement - About asynchronous coroutines - obsolescence warning
07 minutes09 seconds; Asynchronous http request aiohttp module explanation (Part 1)
08 minutes00 seconds; Asynchronous http request aiohttp module explanation (Part 2)
07 minutes44 seconds; Practical combat of asynchronous crawlers - stripping away a novel (Part 1)
12 minutes00 seconds; Practical combat of asynchronous crawlers - stripping away a novel (Part 2)
12 minutes15 seconds; Comprehensive training_How video websites work (Part 1)
09 minutes00 seconds; Comprehensive training_How video websites work (Part 2)
10 minutes02 seconds; Grab 91 and watch the drama_Simple version (Part 1)
07 minutes00 seconds; Grab 91 to watch the drama_Simple version (Part 2)
07 minutes40 seconds; Grab 91 and watch the drama_Simple version (Part 1)
10 minutes00 seconds; Grab 91 to watch the drama_Simple version (Part 2)
11 minutes13 seconds; Grab 91 to watch the drama_Complex Edition_1_Overview (Part 1)
06 minutes00 seconds; Grab 91 to watch the drama_Complex Edition_1_Overview (Part 2)
07 minutes40 seconds; Grab 91 to watch the drama_complex version_2_get the m3u8 path
11 minutes00 seconds; Grab 91 to watch the drama_complex version_3_download m3u8 (Part 1)
08 minutes00 seconds; Grab 91 to watch the drama_complex version_3_download m3u8 (Part 2)
07 minutes36 seconds; Grab 91 to watch the drama_complex version_4_download video (Part 1)
09 minutes00 seconds; Grab 91 to watch the drama_complex version_4_download video (Part 2)
09 minutes01 seconds; Grab 91 to watch the drama_Complex version_5_Decryption (Part 1)
07 minutes59 seconds; Grab 91 to watch the drama_Complex version_5_Decryption (Part 2)
08 minutes16 seconds; _Catch 91 to watch the drama_Complex version_6_Merge video (Part 1)
06 minutes00 seconds
Chapter5chapter Five: Selenium introduces concepts (Part 1)
07 minutes00 seconds; Selenium introduces concepts (Part 2)
07 minutes39 seconds; selenium_Various operations_grabbing hook (Part 1)
10 minutes00 seconds; selenium_Various operations_grabbing hook (Part 2)
11 minutes21 seconds; selenium_various operations_switching between windows (Part 1)
10 minutes00 seconds; selenium_Various operations_Switching between windows (Part 2)
10 minutes49 seconds; selenium_Various Operations_Headless Browser (Part 1)
10 minutes00 seconds; selenium_Various operations_Headless browser (Part 2)
11 minutes51 seconds; selenium_Super Eagle processing verification code (Part 1)
07 minutes00 seconds; selenium_Super Eagle processing verification code (Part 2)
08 minutes08 seconds; selenium_super eagle fuck super eagle
08 minutes58 seconds; selenium_solve the login problem of 12306 (1)
10 minutes00 seconds; selenium_solve the login problem of 12306 (2)
10 minutes05 seconds; selenium_solve the login problem of 12306 (4)
09 minutes50 seconds
Chapter6Chapter Six: Python captures pictures of girls from the beautiful gallery
41 minutes29 seconds; Grab Lagou.com recruitment information
37 minutes26 seconds; Easy and simple explanation of recursion and small recursion cases
52 minutes32 seconds; Simple analysis of lottery data
43 minutes04 seconds; Use python automation tool selenium to capture 51job recruitment information
52 minutes32 seconds; binary search; maze problem; Do movie box office; dry flask; Data visualization display
39 minutes11 seconds; Regular expression_metacharacter; Regular expression_quantifier; Regular Expressions_Greedy and Lazy; re extract grouped data; Use Douban TOP250 data to capture; Capture movie paradise movie information_on
17 minutes27 seconds; Capture movie paradise movie information_Part 2
14 minutes46 seconds; html basic grammar rules; css selector syntax rules; css selector syntax rules_cut completed
Chapter7Chapter VII: bs4 practical case one
12 minutes59 seconds; bs4 practical case 2; xpath analysis_on
18 minutes35 seconds; xpath analysis_down
06 minutes33 seconds; Anti-leech_grab pear video
24 minutes56 seconds; Multithreading and multiprocessing; Multi-threading and multi-process-2; Multi-threading and multi-process-3; Multi-threading and multi-process-4; Multi-threading and multi-process-5; 01_Multi-task asynchronous coroutine
20 minutes00 seconds; 02_Multi-task asynchronous coroutine
20 minutes00 seconds; 03_Multi-task asynchronous coroutine
20 minutes00 seconds; 04_Multi-task asynchronous coroutine; 05_Multi-task asynchronous coroutine; 06_Multi-task asynchronous coroutine; 07_Multi-task asynchronous coroutine; 08_Multi-task asynchronous coroutine; 09_Multi-task asynchronous coroutine
Chapter8chapter eight: 01_Catch wbdy
20 minutes00 seconds; 02_Catch wbdy
20 minutes00 seconds; 04_Catch wbdy; 05_Catch wbdy; 06_Catch wbdy; 07_Catch wbdy; 08_Catch wbdy; 09_Catch wbdy
20 minutes00 seconds; 10_grab wbdy; 11_Catch wbdy; 01_Getting started with selenium; 02_Getting started with selenium; 03_Getting started with selenium; Getting Started with Selenium-4; Getting Started with Selenium-5
20 minutes01 seconds; Getting Started with Selenium-6; Getting Started with Selenium-7; Getting Started with Selenium-8; Getting Started with Selenium-9; Getting Started with Selenium-10
09 minutes08 seconds
Chapter9Chapter nine: Selenium small advanced + case-1
20 minutes01 seconds; Selenium small advanced + case-2
20 minutes02 seconds; Selenium small advanced + case-3
20 minutes05 seconds; Selenium small advanced + case-4; Selenium small advanced + case-5; Selenium small advanced + case-6; Selenium small advanced + case-7; Selenium small advanced + case-8; Selenium small advanced + case-9; Scrapy introduction and initial use-1
20 minutes00 seconds; Scrapy introduction and initial use-2
20 minutes09 seconds; Scrapy introduction and initial use-3
20 minutes05 seconds; Scrapy introduction and initial use-4; Scrapy introduction and initial use-5; Scrapy introduction and initial use-6; Scrapy introduction and initial use-7
Chapter10chapter Ten: 01 Scrapy pipeline; 02 Scrapy pipeline; 03 Scrapy pipeline; 04 Scrapy pipeline; 05 Scrapy pipeline; 06 Scrapy pipeline; 07 Scrapy pipeline; 08 Scrapy pipeline; 09 Scrapy pipeline; 1Scrapy middleware uses -1; 1Scrapy middleware usage-2
20 minutes04 seconds; 1Scrapy middleware usage-3; 1Scrapy middleware usage -4; 1Scrapy middleware uses -5
Chapter11Chapter 11: Scrapy simulated login and middleware-1
20 minutes00 seconds; Scrapy simulated login and middleware-2
20 minutes07 seconds; Scrapy simulated login and middleware-3; Scrapy simulated login and middleware-4; Scrapy simulated login and middleware-5; Scrapy simulated login and middleware-6; Scrapy simulated login and middleware-7; Scrapy simulated login and middleware-8; Scrapy simulated login and middleware-9; Scrapy site-wide data capture-1
19 minutes59 seconds; Scrapy site-wide data capture-2

部分浏览器不支持，请下载APP观看

Next Section： selenium_搞定12306的登录问题（4）623 plays

Complete version of Python crawler tutorial

部分浏览器不支持，请下载APP观看

Next Section： selenium_搞定12306的登录问题（4）623 plays

Complete version of Python crawler tutorial

Allpost a note