tsdataclinic / scout

Scout is a data discovery tool to explore open data portals worldwide.
https://scout.tsdataclinic.com
Apache License 2.0
33 stars 12 forks source link

[BUG] UPDATE_ON_BOOT should be safe to run multiple times #276

Closed jps327 closed 1 year ago

jps327 commented 2 years ago

Re-running data sync should safely overwrite Elasticsearch and postgres records and should not duplicate anything

Currently, the dataset_column table ends up with many duplicated values every time the script runs.