EcoExtreML / STEMMUS_SCOPE_Processing

Python modules and notebooks to process data and run STEMMUS-SCOPE model
https://pystemmusscope.readthedocs.io/en/latest/
Apache License 2.0
5 stars 1 forks source link

valid_eth_canopy_height_files not found #83

Open QianqianHan96 opened 1 year ago

QianqianHan96 commented 1 year ago

"The valid filenames are all in download_scripts/valid_eth_canopy_height_files.txt." I can not find this file anymore. Could Bart help check?

BSchilperoort commented 1 year ago

We moved the file to a compressed archive to save space. I had forgotten to update the documentation however.

You can use their website to easily pick the right tiles to download: https://share.phys.ethz.ch/~pf/nlangdata/ETH_GlobalCanopyHeight_10m_2020_version1/tile_index.html

QianqianHan96 commented 1 year ago

Hi Bart, I need to download all the global tiles. Is it possible to access the compressed archive or can you share the file "valid_eth_canopy_height_files.txt" with me? Thanks!

BSchilperoort commented 1 year ago

You should be able to use the following wget command:

wget --recursive -e robots=off --no-parent https://share.phys.ethz.ch/~pf/nlangdata/ETH_GlobalCanopyHeight_10m_2020_version1/3deg_cogs/

However, be aware that this is about 600 GB of data.

If you only want the data files (not the uncertainty):

wget --recursive -e robots=off --reject="*_SD.tif" --no-parent https://share.phys.ethz.ch/~pf/nlangdata/ETH_GlobalCanopyHeight_10m_2020_version1/3deg_cogs/
QianqianHan96 commented 1 year ago

Thanks, Bart, I also found the command to extract the urls: curl -s "https://share.phys.ethz.ch/~pf/nlangdata/ETH_GlobalCanopyHeight_10m_2020_version1/3deg_cogs/" | grep -o -P '(?<=href=")[^"]+' | awk -F"/" '{print $NF}' > file_list.txt