Do you know Yahoo! Pipes This is a very flexible feed aggregator, and you can manipulate it using YQL, which is quite powerful and has Python librabry, python-yql :). YQL also has special “tables” for Twitter and other services and news sources, so depending on what you want, you won’t even need Pipes.
Here is a quick example of using Pipes + YQL at http://blog.ouseful.info/2009/04/27/using-yql-with-yahoo-pipes/ , but you can play with them in the YQL Console .
So this is your “Question 1”. But, using YQL, “Question 2” (if I understood correctly) comes naturally, since you use it almost like regular SQL, imposing restrictions, ordering, etc.
source share