All geek questions in one place

Writing the first web browser

I was trying to find something good, or some kind of example that is good for beginners when it comes to writing your first web crawler. I would like to write it in C #. Does anyone have a good example code for sharing or some tips on some sites where I can find information for C # and some bacic webcrawling.

thank

+3
source share
3 answers

HtmlAgilityPack is your friend.

+4
source

Yes, HtmlAgeilityPack is a good tool for parsing HTML, but this is clearly not enough.

There are 3 elements to work around:

1) , .. -:. , IP-, , - IP- HTTP , IP . , IP-, -, .

google ( ) .

2) .. - HTML- JavaScript , , , , . , , Webkit.net, , -.

3) HTML: HTML-, . .

+3

Some time ago, I also wanted to write my own web crawler and found this document:

Web crawler

He has some great info, and he's very well written IMO.

+2
source

Source: https://habr.com/ru/post/1774180/

More articles:


All Articles