Home  >  Q&A  >  body text

Why can’t some web pages be crawled, such as Zhihu?

Why some web pages cannot be crawled, such as Zhihu

苦咖啡苦咖啡2391 days ago1575

reply all(1)I'll reply

  • PHP中文网

    PHP中文网2018-04-26 14:46:44

    HTTPS and special sites have a protection mechanism to prevent hotlinking, and you will not be able to crawl HTTPS requires special means

    reply
    0
  • Cancelreply