Search engine without crawl?

Is there a way to collect web content to use it in a search engine without going through the web crawl phase? Any alternative to web crawling?

thank

+3
source share
5 answers

No, to collect the content you need ... to collect the content. :-)

+5
source

Yes (and no sorting).

:)

You can load existing data dumps from various sites (wikipedia, stackoverflow, etc.) and thus create a partial index. This, obviously, will not be a complete Internet index.

-, . API . citosearch opensearch. duckduckgo yahoo boss api ( yahoo bing...) .

API , . datasift . , / .

+3

, - pubsubhubbub push- . , superfeedr, .

+2

-, .

+1

, , - , ( , ). , .

, +/-, .

, .

, . - .

.

, , .

(. Google bomb, ..), , , , ...

At least Wikipedia and Stack Exchange are still not sent to useless levels ...

PS: http://xkcd.com/810/

0
source

Source: https://habr.com/ru/post/1776399/


All Articles