GeospatialResearch / Digital-Twins

https://geospatialresearch.github.io/Digital-Twins/
GNU Affero General Public License v3.0
14 stars 7 forks source link

Rec data download #143

Closed LukeParky closed 1 month ago

LukeParky commented 2 months ago

Add instructions on how to do this, or automatically do it in code. Currently, rec data is downloaded into the docker image, however, if developers are running non-docker versions of the code then they do not have the rec data downloaded.

LukeParky commented 1 month ago

Putting this task down, for now. I was working on it and it was hanging on uploading data to the postgis database. Sometimes this would happen in master, but always happened in the issue branch.

The dataframe being uploaded to database takes about 10 minutes to read from a file and is ~520,000 rows.

May try again at some point, but if anyone else looks into it please note how long it takes to upload the data to the database, The actual fetching of data from arcGIS works fine.