search

monarch-initiative / dipper

Data Ingestion Pipeline for Monarch
https://dipper.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
56 stars 26 forks source link

announce changes to data file locations #922

Closed balhoff closed 4 years ago

balhoff commented 4 years ago

The paths and file names of the Monarch RDF downloads have changed several times during the past year. I only notice this when my pipeline breaks. The latest was moving https://archive.monarchinitiative.org/latest/rdf/mgi_slim.ttl to https://archive.monarchinitiative.org/latest/rdf/mgislim.ttl Could we have announcements of these changes posted somewhere? My apologies if I am not subscribed to the right thing. Please let me know how to stay up to date.

TomConlin commented 4 years ago

Hi Jim, The changes are me making the dipper automation process smoother, (for example that output file name differed from its ingest file name with the inserted underscore which only medata files have in the output) there will likely be a few more going forward but I will take this nudge to be sure you are pinged. You might be interested in the ntriples_YYYYMM.tgz file that also went up there unannounced....

balhoff commented 4 years ago

Thanks Tom! I just want to make sure I am getting the right notifications, and also register a vote for a more formal announcement process once things settle down.

TomConlin commented 4 years ago

If you are subscribed here you could have seen https://github.com/monarch-initiative/dipper/pull/904 but I know I do not have the bandwidth to register everything I am subscribed to so I am not sure how more notifications help unless you have someone else taking the time to curate them for you.

matentzn commented 4 years ago

I strongly suggest that changes to filenames/locations should be announced somehow when the data release is done.. Isnt there anything like a public Monarch mailing list?

TomConlin commented 4 years ago

Including "Release Notes" in the archive would most definitely be a step in the right direction.

matentzn commented 4 years ago

Yeah.. still think this needs to be announced more widely to users. But yes release notes is a good first step.