Open lrnv opened 5 months ago
Hi Oskar
Thanks for the note.
Yeah that would definitely doable and rather pull from an archive up on GitHub. I'll look at what Alec did for his packages that distribute datasets. I initially did the password version to keep everything on their servers + access control.
I'll look at an automated runner to check once a month and then flag if they add new countries or tables that aren't considered yet.
Patrick,
For the moment, I drafted a script to download offline what i need in https://github.com/JuliaSurv/RateTables.jl (look in the data folder) but of course if I can depend directly on HMD.jl to obtain these datas that would be much cleaner :)
This would also require that HMD is registered.
Hey, great work on this.
I am currently using some HMD data for my work, and would really like to be able to store datasets directly into the packages (i.e. without asking end users for credentials). Taking a look at your code, I wander if you considered this option: did you saw somewhere a clause that does not allow you to redistribute the datas ?
I could for example think of a routine check in CI, ran say weekly or monthly, that would download and store the main zip file in some artefact dependency.
What do you think ?
Edit: From their user agreement, it looks like the datasets are CC BY 4.0, which means that we are free to redistribute them.