What is the fastest project to download and convert a large binary file?

I have a 1 GB binary on another system.

Requirement: ftp / download and convert binary to CSV on the host system.

The converted file will be larger than ~ 8 GB

What is the most common way to do something like this? If it is a two-step independent process, download - then convert?
Should I load small chunks at a time and convert at boot time?

I don’t know how effective the way to do this is ... also that I have to be careful with files of this size?

Any advice is appreciated.

Thank.

(Visual Studio C ++)

+3
source share
6

, CSV. stdin stdout.

wget URL_of_remote_binary_file --output-document=- | my_converter_program > output_file.csv

, ( ), . , .

+5

- , ftp, . , . FTP -.

+4

, . , - , , , .

- , , , . , / . . , 2 4 , .

+3

. ? ​​ X ( ), , ( )?

, , , , - . , . .

, / , , , , . , , , //.

+2

. , .

+1

:

  • ? -, , , /, , , .
  • / ? , .
  • , ? -, , .
+1

Source: https://habr.com/ru/post/1750716/