Performance creating multiple small files

Question

I need a test application that will create a large number of small files on disk as quickly as possible.

Will asynch ops help create files or just write them? Is there a way to speed up the whole process (writing to one file is not possible)

Answer 1

Would the physical IO device be the bottleneck here? You will probably get different results if you write to a disk with a frequency of 4200 rpm against a drive with a frequency of 10 000 rpm against an ultrafast SSD.

Answer 2

, , , , . , , .

Answer 3

ramdisk, , , .

Answer 4

If possible, do not write them all in the same directory. Many file systems slow down when working with directories containing a large number of files. (I once brought our file server to work, which usually gladly serves the entire office, to my knees, writing thousands of files to the same directory).

Instead, create a new directory for every 1000 files or so.