Running a search robot for selected sites in the Google App Engine?

I need to write a crawler to extract information from several pre-selected websites.

I know this is just work, but I'm thinking of using the Google engine for this.

Maybe I can try Nutch to do this for me.

How is it possible to do this?

1) placement of a search robot in google infrastructure 2) Nutch + app engine - will it be possible?

+3
source share
1 answer

nutch docs, , "[t], Nutch Hadoop " , App Engine. App Engine Python Java .

, App Egnine. , , , , urlfetch, , , , , . .

+4
source

Source: https://habr.com/ru/post/1778697/


All Articles