NASA-PDS / registry-sweepers

Scripts that run regularly on the registry database, to clean and consolidate information
Apache License 2.0
0 stars 1 forks source link

Analyse if we doo or can fix missing or invalid LDD at harvest time with sweeper #150

Open tloubrieu-jpl opened 4 hours ago

tloubrieu-jpl commented 4 hours ago

💡 Description

For example when the product is loaded in the registry with harvest:

  1. a LDD HTTP referenced in a product label might not be published yet . Or 2. The LDD might be accessible but invalid (invalidate dat, xml parsing issues)

This issues might be fixed later, I would like to know if sweeper can update the registry-ldd after harvest ran in these cases.

⚔️ Parent Epic / Related Tickets

No response

alexdunnjpl commented 3 hours ago

@tloubrieu-jpl as a general statement given the following, we can put any post-hoc update in a sweeper, easy

So this seems like a simple. Is the issue that records exist in registry-dd which are incomplete, or that records do were not created in registry-dd in the first place?

What is the delta between the current state and desired state after a given LDD is live and valid?