search

ICOS-Carbon-Portal / data

ICOS Carbon Portal's Data Service
GNU General Public License v3.0
2 stars 3 forks source link

netcdf download failed #51

Closed claudiodonofrio closed 5 years ago

claudiodonofrio commented 5 years ago

The data file https://meta.icos-cp.eu/objects/II93UyEd61Gdp_lXwgRqrS4W can be "previewed" but if I download the file, the zip file is empty. I'am aware that the data is not ICOS, but strange that we have the preview, but can't download. The corresponding link on the landing page leads to a website, where a "login" is required (https://apps.ecmwf.int/datasets/data/cams-ghg-inversions/). In general we should check if a "data" file is availalbe to prevent the user of downloading an empty zip file.

atverm commented 5 years ago

If you click the Access URL on the landing page you will be referred to the COPERNICUS CAMS page where you need to login and accept their data license first. This works as designed and required.

Alex

From: claudiodonofrio [mailto:notifications@github.com] Sent: 7 mei 2019 10:20 To: ICOS-Carbon-Portal/data data@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [ICOS-Carbon-Portal/data] netcdf download failed (#51)

The data file https://meta.icos-cp.eu/objects/II93UyEd61Gdp_lXwgRqrS4W can be "previewed" but if I download the file, the zip file is empty. I'am aware that the data is not ICOS, but strange that we have the preview, but can't download. The corresponding link on the landing page leads to a website, where a "login" is required (https://apps.ecmwf.int/datasets/data/cams-ghg-inversions/). In general we should check if a "data" file is availalbe to prevent the user of downloading an empty zip file.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/ICOS-Carbon-Portal/data/issues/51, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ACSQC3GKVALP2CZES4Q6XF3PUE3SFANCNFSM4HLGO2RQ.

claudiodonofrio commented 5 years ago

I am aware of that, but maybe we should "prevent" the download of an empty zip file?

mirzov commented 5 years ago

Direct, unofficial download of this data object actually works. Downloading a data cart containing only this object also works, and results not in an empty zip file, but in a zip archive with two files: licence and table of contents. The latter lists all the files in the cart, and the reason for omission of the missing ones. The behaviour is as designed.

jonathanthiry commented 5 years ago

This behavior can be surprising as the portal doesn't mention that the data will not be downloaded. The cart even reports a download size of 152.03 MB for this object which hints that the data will be inside the zip.

I would suggest to display the actual size of the cart by counting only the files included in the zip. The data portal could also display in the results/cart that the file is available for download only though the external link.

atverm commented 5 years ago

I would suggest that we for this we include as planned license info in the data object specification metadata. ICOS data gets a CC4BY license spec and URL and is handled through the ICOS license check. Objects with other (and limiting) licenses get a referral to their own license check/login/repo. All CC0 and free objects just go straight into the cart. An item OtherLicenseInfo can be used as help text in the search result to show that this file cannot be downloaded directly (download checkbox greyed out) and that the user will be referred to an external site. Level 0 data would get this info as for example: This data is available on request from Thematic Center at info@icos-etc.eumailto:info@icos-etc.eu. The license info could be shown as a little icon in the search result.

Alex

From: Jonathan Thiry [mailto:notifications@github.com] Sent: 7 mei 2019 13:51 To: ICOS-Carbon-Portal/data data@noreply.github.com Cc: Alex Vermeulen alex.vermeulen@icos-cp.eu; Comment comment@noreply.github.com Subject: Re: [ICOS-Carbon-Portal/data] netcdf download failed (#51)

This behavior can be surprising as the portal doesn't mention that the data will not be downloaded. The cart even reports a download size of 152.03 MB for this object which hints that the data will be inside the zip.

I would suggest to display the actual size of the cart by counting only the files included in the zip. The data portal could also display in the results/cart that the file is available for download only though the external link.

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/ICOS-Carbon-Portal/data/issues/51#issuecomment-490047026, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ACSQC3AUMGASIPXWKMCKRX3PUFULFANCNFSM4HLGO2RQ.