gbif / pipelines

Pipelines for data processing (GBIF and LivingAtlases)
Apache License 2.0
40 stars 28 forks source link

Occurrence data as an extension doesn't get removed when the dataset changes #1029

Open muttcg opened 5 months ago

muttcg commented 5 months ago

Example 1) Crawl checklist with occurrence as extension 2) Remove occurrences from the dataset 3) Recrawl dataset

The occurrence data must be removed from both the index and avro files.