All geek questions in one place

Javascript screen latency scrambling

I am trying to clear a site that has a two second delay.

I am currently using python for cleaning. Whenever I “get” the page, the javascript delay is not over yet and the new dom has not yet fully loaded.

How could I clear such a pge?

+4
source share
2 answers

A reliable way is to clean it using a web browser or a web browser, for example. using i-Macros scraping commands . It also works through Python / Linux .

You can also program this yourself using the webbrowser control on Windows: http://www.codeproject.com/KB/cs/webbrowser.aspx

+1
source

You can extend Mozilla to create a web scraper that can use the full power of a web browser. After all the data has been loaded and the DOM has been created, you can extract the necessary data from the DOM using XSLT. If the DOM has changed dynamically after the boot, you can take several approaches to wait for the changes. For more information, visit http://www.gooseeker.com . GooSeeker publishes a similar tool for everyone. Most of the codes are in javascript and are readable, from which you can find how it works.

+1
source

Source: https://habr.com/ru/post/1338218/

More articles:


All Articles