JuliaClimate / CDSAPI.jl

Julia API to the Climate Data Store (a.k.a. CDS)
https://cds.climate.copernicus.eu
MIT License
23 stars 6 forks source link

More information while downloading data from CDS #26

Closed michiboo closed 4 years ago

michiboo commented 4 years ago

Ideally it will include the following information:

The example below displayed information while downloading from CDS using ECMWF's CDSAPI: 2020-07-06 17:37:01,345 INFO Welcome to the CDS 2020-07-06 17:37:01,345 INFO Sending request to https://cds.climate.copernicus.eu/api/v2/resources/reanalysis-era5-pressure-levels 2020-07-06 17:37:03,596 INFO Request is completed 2020-07-06 17:37:03,597 INFO Downloading http://136.156.133.41/cache-compute-0013/cache/data1/d3adac2-f735-4638-ae0b-3c85684e3848.grib to download.grib (61.4M) 2020-07-06 17:38:05,176 INFO Download rate 1020.9K/s
Result(content_length=64374600,content_type=application/x-grib,location=http://136.156.133.41/cache-compute-0013/cache/data1/adaptor.mars.internal--1d3adac2-f735-4638-ae0b-3c85684e3848.grib)

juliohm commented 4 years ago

I love this idea of showing a more informative progress. Please take a look at the ProgressMeter.jl and the more recent ProgressLogging.jl packages, they can help here.

juliohm commented 4 years ago

The new HTTP.download provides some progress information already. It is not the cleanest output though. Should we close this issue? I think in order to improve the progress information we would need to submit PRs to HTTP.jl instead.

LakshyaKhatri commented 4 years ago

@michiboo,

Are covered by #29, so only thing remaining is a progress bar (we have to do something with HTTP.download() if more customization is required )

michiboo commented 4 years ago

@juliohm @LakshyaKhatri Thanks for the comments! I agreed that this issue should be close!