search

etf-validator / etf-webapp

:earth_africa: :mag: ETF is an open source testing framework for spatial data and services
https://www.etf-validator.net
European Union Public License 1.2
19 stars 19 forks source link

Support for large GML files (from survey) #89

Closed lorenahq closed 7 years ago

lorenahq commented 7 years ago

Some users need support for larger GML files. In particular, someone tried with a file of 840'000KB but the validator ended up crashing.

jonherrmann commented 7 years ago
  1. crash should be avoided if possible (bug)
  2. The upload size should be adjusted to RAM (enhancement)

Internal note: validate upload size with window.FileReader -> file.size

cportele commented 7 years ago

As a note, the crash occurs, because the current test deployment is on a machine that does not have sufficient RAM for executing the xqueries on files of that size. However, the software is capable of handling very large files (and has been used with XML files of more than 200GB), but the machine needs to have sufficient RAM.