Maximum size for xml files

Question

what is the rule for maximum size for xml files.

What if I ask for the maximum number of records and one record has 10 values? Another condition is that we download it from the Internet.

Answer 1

My rule is that if it is too slow to do what I want, then it is too large , and your data probably needs to be transferred to some other database ... or such.

Moving XML nodes or using XPath can be a dog.

Answer 2

This may not be what you want to hear, but ... If you are thinking about the size of your XML files, most likely you should use a database instead of files (even if they are not flat files, but structured like XML). Databases are highly optimized for efficient storage of huge amounts of data. The best algorithms for extracting data are in the database code database.

Answer 3

No. Maximum file sizes depending on the file system used.

Answer 4

There is no limitation on the XML file size , but it takes up memory (RAM) as the file size of the strong> XML file , so the long XML file parsing size is amazing performance .
Long XML size is recommended using SAX for .NET to parse long XML documents.

Answer 5

I don’t think you should have a rule for maximum data size, be it XML or something else. If you need to store several gigabytes of data, you save this data. What matters is which API you use to process this data. However, XML may not be the best choice if your data set is very large. In these cases, a relational or XML database is likely to work better than a single XML file.

Answer 6

I think it depends on the context from which the / file is generated, what you are going to work from, the throughput of any connection that it should go through, the size of RAM, etc.

What is your context?

Answer 7

Even if not all parsers read the entire file into memory, if you really need the correct rule, I would say that no more than half of your available bar. Anything more is likely to be too slow :)

Answer 8

I was working on a project in 2010, when I had to move the newspaper website from Typo 3 to Drupal 7, and the fastest way at that time was to export all the content as xml and then parse them on drupal (Xpath), We tried to do this at one time, but we had problems on 4Gigs. So, we split xmls per year, and each file had less time to parse and the file size in MB, and everything went fine. Other readings suggest that the maximum file may depend on your bar.