Home  >  Q&A  >  body text

javascript - How does QWebEngineView crawl angular's dynamic data?

Test URL: www.om.cn

Click on the picture to jump to the inner page. No useful information found in html before jumping

The html obtained by inspecting the element.

Baidu checked, angular data is difficult to obtain through ordinary crawlers. So I used QWebEngineView of Qt5.8 for visualization,
But how can I get this data? Looking for direction and ideas!

阿神阿神2734 days ago583

reply all(1)I'll reply

  • 过去多啦不再A梦

    过去多啦不再A梦2017-05-19 10:09:18

    I don’t know exactly what you need, but it seems that the data you want can be analyzed through packet capture. They are just ajax requests. For example, detailed product descriptions, product lists under specific product list categories. Anyway, the king of crawlers is to capture packets + analyze JS. This only involves packet capture and does not let you analyze JS

    reply
    0
  • Cancelreply