I; m using Lucene.net (2.9.2.2) at the 70Gig index (currently). I can perform a rather complicated search and return all document identifiers in 1 ~ 2 seconds. But to really download all the hits (about 700 thousand in my test requests) take 5+ minutes.
We do not use lucene for the user interface, it is a data warehouse between processes in which we have hundreds of millions of pre-cached data elements, and the part in which I work exports several specific fields from each document found. (ergo, pagination does not occur, since it is an export between processes).
My question is the best way to get all the documents in the search results? I am currently using a custom collector that accesses a document (with MapFieldSelector) as its collection. I also tried sorting through the list after the collector finished .. but it was even worse.
I am open to ideas :-).
Thanks in advance.
source
share