DumpUrl Ingest Code - Githubissues

NASA-IMPACT / COSMOS

COSMOS is a web application designed to manage collections indexed in NASA's Science Discovery Engine (SDE), facilitating precise content selection and allowing metadata modification before indexing.

https://sde-indexing-helper.nasa-impact.net/

3 stars 1 forks source link

DumpUrl Ingest Code #1064

Closed CarsonDavis closed 1 week ago

CarsonDavis commented 1 month ago

Description

Purges DumpUrl for that collection
Saves incoming data to DumpUrl
Runs the rules on it
Purges the DeltaUrl model for that collection
Populates the DeltaUrl model for that collection
- Urls not found should be marked with a boolean of delete true
- Only the delta fields should be written to the model, not fields that have remained the same
Purges DumpUrl for that collection

Implementation Considerations

type your first consideration here

Deliverable

ingest functions that run when new urls are imported and populate the DumpUrl model and the DeltaUrl model

Dependencies

depends on