search

oxinabox / DataDeps.jl

reproducible data setup for reproducible science
Other
150 stars 43 forks source link

Experience with Dropbox #166

Open rofinn opened 10 months ago

rofinn commented 10 months ago

I'd like to hear if anyone has tested GoogleDrive or DropBox etc.

The only issue I ran into was that the default HTTP.jl based method was truncating my file download.

https://github.com/invenia/Impute.jl/pull/138/commits/9ac12c3a595d348ef932ba73331c19cb8d332a9d

Unless you want a note in the docs, feel free to close.

oxinabox commented 10 months ago

we probably should note in the docs.

occationally things go wrong, this has been observed in DropBox. Rather than using the default HTTP.jl based fetch_method, it can be useful to specify fetch_method=DataDeps.fetch_base which using the download from julia stdlib (which on modern julia uses libcurl). This has upside of handling some corner cases of HTTP better, but the downside of not supporting determining filenames from headers.