The dataset links have cookie-based anti-bot protection against automated downloads, which went unnoticed when adding them to the workflow.
I have reached out to Global Energy Monitor to see if they would be willing to offer an official Zenodo repository (or similar).
The TUBcloud is used as an intermediary solution.
If we do not get the official Zenodo repository, the CC-BY 4.0 license permits redistribution on a Zenodo mirror provided attribution is given. This would be a long-term solution but requires updates from us to the latest GEM datasets once in a while.
closes #1260
The dataset links have cookie-based anti-bot protection against automated downloads, which went unnoticed when adding them to the workflow.
I have reached out to Global Energy Monitor to see if they would be willing to offer an official Zenodo repository (or similar).
The TUBcloud is used as an intermediary solution.
If we do not get the official Zenodo repository, the CC-BY 4.0 license permits redistribution on a Zenodo mirror provided attribution is given. This would be a long-term solution but requires updates from us to the latest GEM datasets once in a while.