search

monarch-initiative / dipper

Data Ingestion Pipeline for Monarch
https://dipper.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
57 stars 26 forks source link

Fix retrieved_on subject for items retrieved from DipperCache #905

Closed justaddcoffee closed 4 years ago

justaddcoffee commented 4 years ago

I previously was using URL for remote file, not DipperCache URL as the subject for this triple.

TomConlin commented 4 years ago

JR> # Here we assume that the timestamp of the cached file on JR> # DipperCache is the date it was retrieved from the upstream source

TC> # Here the timestamp on the file in DipperCache is a best effort representation TC> # of the earliest time the file could have been retrieved from source.

if the updated assumption still holds then the pr is good to go