Add bucketutil cull - Githubissues

earthcube / scheduler

Scheduling approaches related to gleaner tooling

Apache License 2.0

0 stars 0 forks source link

Add bucketutil cull #71

Open valentinedwv opened 1 year ago

valentinedwv commented 1 year ago

This was cull, but there are some cases where there may be more than one JSONLD from a page (aka org datacatalog and dataset).

Need to provide a report that there are duplicates, and let us decide if that it ok,

(option1) just create one that culls dupes older than (reharvest period)
(option 2) just cull files older than (reharvest period)