Previous behaviour: findGeoFiles will return the entire directory as one result if all files inside are of the same type. As a result, GDAL will attempt to load the entire directory into RAM at the beginning of the upload, which can lead to out-of-memory error for large-scale upload.
New behaviour: findGeoFiles will return each file on its own. Only a single file is uploaded via GDAL in a single call, and the RAM usage is reduced.
Previous behaviour: findGeoFiles will return the entire directory as one result if all files inside are of the same type. As a result, GDAL will attempt to load the entire directory into RAM at the beginning of the upload, which can lead to out-of-memory error for large-scale upload.
New behaviour: findGeoFiles will return each file on its own. Only a single file is uploaded via GDAL in a single call, and the RAM usage is reduced.