I have about 2 million rows with different lengths that I need to compress and put into MongoDb GridFS as files.
Rows are currently stored in the MS SQL TEXT field of the table. I wrote an example application to read each line, compress it, and save it as a GridFS file.
There is one reader and a thread pool of 50 threads storing the results. It works, but it is very slow (an average of 100 records per second).
I was wondering if there is a way to speed up import to GridFS?
I am using MongoDb 1.6 for Windows with the MongoCSharp driver in C # and .NET.
source
share