search

goat-community / goat

This is the home of Geo Open Accessibility Tool (GOAT)
GNU General Public License v3.0
91 stars 47 forks source link

Speed up CSV upload #2718

Open EPajares opened 10 months ago

EPajares commented 10 months ago

There are issues with CSV upload when the file reaches a certain size. The thing is that the data is converted to excel as excel let's ogr2ogr guess better the data types. We might have to change the strategy here and instead guess the data types with pandas and pass the guessed data types to ogr2ogr.

EPajares commented 10 months ago

An alternative could also be using another data type like sqllite