CDSE to EO guide - Githubissues

CSCfi / csc-user-guide

User guides, FAQs and tutorials related to CSC services

https://docs.csc.fi

Creative Commons Attribution 4.0 International

47 stars 83 forks source link

CDSE to EO guide #1967

Closed samumantha closed 7 months ago

samumantha commented 9 months ago

Removed one more mention of Sentinel mosaics on Puhti. Left Landsat there, as still available on Puhti.
Added general section about CDSE to EO-guide
Added landsat back to spatial data in Puhti page
Added direct read instructions for CDSE to GDAL cloud page (by Kylli)
Added some suggestions for download from CDSE
Added most of smaller suggestions from #1549

Please read if understandable and sufficient (or too much?) info + grammar check :) @EetuHuuskoCSC, as you have nice and clean setup in Puhti, could you test if the instructions on using CDSE in GDAL cloud tutorial work for you on Puhti and if they are sufficient to set up the connection? A real life test so to say :)

https://csc-guide-preview.rahtiapp.fi/origin/swi_eoguide/support/tutorials/gis/eo_guide/

EetuHuuskoCSC commented 8 months ago

Should this command work on Puhti? $ gdalinfo /vsicurl/https://www.nic.funet.fi/index/geodata/mml/orto/normal_color_3067/mara_v_25000_50/2023/N33/02m/1/N3324F.jp2 @ktiits

Gives error: ERROR 4: /vsicurl/https://www.nic.funet.fi/index/geodata/mml/orto/normal_color_3067/mara_v_25000_50/2023/N33/02m/1/N3324F.jp2: No such file or directory

EetuHuuskoCSC commented 8 months ago

Didn't get the gdalinfo reading working on Puhti, might be just on my end. However, I found a couple points in the gdal_cloud.md that might be added:

A clearer indication that both the "S3 connection set up for Copernicus Data Space Ecosystem" and the "Several connection profiles" need to followed for being able to use CDSE on Puhti. If the idea is to be a more general tutorial and not connected to Puhti at all, this can be ignored
Setting the environment variable "AWS_PROFILE" is given as Python code and above the environment variables are set via CLI. Adding CLI version after the Python code would make it clearer.
Adding a link where to set up the CDSE credentials in the gdal_cloud.md could be beneficial as finding the right site through the main pages of Copernicus seems to be almost impossible

ktiits commented 8 months ago

Should this command work on Puhti? $ gdalinfo /vsicurl/https://www.nic.funet.fi/index/geodata/mml/orto/normal_color_3067/mara_v_25000_50/2023/N33/02m/1/N3324F.jp2 @ktiits

Gives error: ERROR 4: /vsicurl/https://www.nic.funet.fi/index/geodata/mml/orto/normal_color_3067/mara_v_25000_50/2023/N33/02m/1/N3324F.jp2: No such file or directory

This is Puhti GDAL module problem, the commands are correct here. Will add a note to GDAL-page.

ktiits commented 8 months ago

Didn't get the gdalinfo reading working on Puhti, might be just on my end. However, I found a couple points in the gdal_cloud.md that might be added:

A clearer indication that both the "S3 connection set up for Copernicus Data Space Ecosystem" and the "Several connection profiles" need to followed for being able to use CDSE on Puhti. If the idea is to be a more general tutorial and not connected to Puhti at all, this can be ignored

Setting the environment variable "AWS_PROFILE" is given as Python code and above the environment variables are set via CLI. Adding CLI version after the Python code would make it clearer.

Adding a link where to set up the CDSE credentials in the gdal_cloud.md could be beneficial as finding the right site through the main pages of Copernicus seems to be almost impossible

I updated the Readme file of download script in geocomputing Github. Does that look ok now?
Changed to Linux style.
CDSE links added to GDAL page.

samumantha commented 8 months ago

Good to go from my end, thanks for comments and fixes