Store large version control CSV file

Question

We have a precedent in which we need to store large csv files (each file can be from 1 to 5 GB and can contain only about 50-100 files) and manage them for version control. We also need to support operations such as

• File export
• Update, add, delete lines from a file and save them as a new version. Edit / add / delete operations are likely to be smaller (e.g. 1000 max lines)
• Search for the difference between the two versions of the file.
• Upload the file to the database.
• Export file from database to version control system
• Get the file for a specific version number.

With file size and operations that would be better, like Perforce Vs Git Vs SVN.

Answer 1

The best option for large file versions is Mercurial with the extension LargeFiles.