bcgov / FIT_opendatadownloader

Monitor open data, report when changes are detected
Apache License 2.0
0 stars 0 forks source link

drop duplicates #19

Closed smnorris closed 1 week ago

smnorris commented 1 week ago

Discard any rows from a download where all fields and geometry are equivalent - warning user and logging the duplicate features dropped.

Is a tolerance required for analysis of the geometries? Or would script only discard if they are exactly equal? https://geopandas.org/en/latest/docs/reference/api/geopandas.GeoSeries.set_precision.html#geopandas-geoseries-set-precision