A look to clear the site

Question

I want to clear a site, for example, yelp.com, to get a list of all the bars that they have. Are there any tools or scripts to help me do this.

Answer 1

I did such work on Superpages and citySearch using screen-scraper . From there, you can write your results to a CSV, database, or something else.

Answer 2

From a Python perspective

• HTTPLib2 to automate page loading.
• Beautiful Soup to parse the HTML source to get the information you need.

, , .

Answer 3

Python, pyQuery , . jQuery, CSS DOM, , .

Answer 4

HTTrack - -,

Answer 5

dot-com, . perl, . "" , "" .

, , , - , , , . Perl .

. ( ), , , .

, , , , .