search

clarin-eric / VLO

Virtual Language Observatory
GNU General Public License v3.0
14 stars 6 forks source link

Increase maximum file size limit for records #81

Closed twagoo closed 7 years ago

twagoo commented 7 years ago

I tested an import with a number of large files (those that would currently be skipped for being over 10MB after conversion to CMDI 1.2) and no file size related issues seem to occur either in the importer or in the web app. The largest file I tested with was a test record from BAS with 12165 resources of 34MB.

After some discussion with Florian of BAS and @dietervu we concluded that is should be ok to raise the maximum file limit, but not lift it completely. We can set it to 50MB to guard ourselves against (unlikely) extreme cases.

twagoo commented 7 years ago

Recently (b70a418a32d2575d42dd9fac3c6839a4b3290922) I have increased the limit to 15MB to add a margin to the documented 10MB limit since CMDI 1.2 conversion has the potential of increasing the file size (in practice I have seen about +25%).