search

patrickm663 / HMD.jl

Makes it easy to get data from Human Mortality Database (HMD) into Julia!
https://patrickm663.github.io/HMD.jl/dev/
MIT License
5 stars 0 forks source link

What about storing data for password-less access ? #10

Open lrnv opened 5 months ago

lrnv commented 5 months ago

Hey, great work on this.

I am currently using some HMD data for my work, and would really like to be able to store datasets directly into the packages (i.e. without asking end users for credentials). Taking a look at your code, I wander if you considered this option: did you saw somewhere a clause that does not allow you to redistribute the datas ?

I could for example think of a routine check in CI, ran say weekly or monthly, that would download and store the main zip file in some artefact dependency.

What do you think ?

Edit: From their user agreement, it looks like the datasets are CC BY 4.0, which means that we are free to redistribute them.

patrickm663 commented 5 months ago

Hi Oskar

Thanks for the note.

Yeah that would definitely doable and rather pull from an archive up on GitHub. I'll look at what Alec did for his packages that distribute datasets. I initially did the password version to keep everything on their servers + access control.

I'll look at an automated runner to check once a month and then flag if they add new countries or tables that aren't considered yet.

lrnv commented 5 months ago

Patrick,

For the moment, I drafted a script to download offline what i need in https://github.com/JuliaSurv/RateTables.jl (look in the data folder) but of course if I can depend directly on HMD.jl to obtain these datas that would be much cleaner :)

This would also require that HMD is registered.