I need to write a crawler to extract information from several pre-selected websites.
I know this is just work, but I'm thinking of using the Google engine for this.
Maybe I can try Nutch to do this for me.
How is it possible to do this?
1) placement of a search robot in google infrastructure 2) Nutch + app engine - will it be possible?
source
share