I am writing an application to do a file conversion, and part of this is replacing old account numbers with new account numbers.
Now I have a CSV file matching old and new account numbers with 30K entries. I read this and saved it as a dict, and when writing a new file, I grabbed a new account from the dict key.
My question is the best way to do this if the CSV file is expanded to 100K + records?
Would it be more efficient to convert account mappings from CSV to sqlite instead of storing them as a dict in memory?
source
share