Scenario Archive plugin: download raw and processed results

[leendertvanwolfswinkel]

Any simulations older than 7 days are no longer available for download from the 3Di API. Customers with a Lizard subscription should be able to work with their 3Di scenarios stored in Lizard seamlessly. Making this a separate plugin improves maintainability

Features

• Download raw results & logging (see https://demo.lizard.net/api/v4/scenarios/): dialog allows users to choose which files they want to download. Note: also test this for results > 2GB, this has been giving issues in the past.
  • gridadmin.h5
  • results_3di.nc
  • aggregate_results_3di.nc
  • structure_control_actions.nc
  • log.zip
• Download raster results (https://demo.lizard.net/api/v4/scenarios/)
  • Users should be able to choose the CRS and nodatavalue of the rasters they download. Default nodatavalue must be -9999 and already prepopulated in the UI
  • Rasters that are larger than 1x10^8 pixels should be downloaded in parts and merged locally (e.g. using VRT)
• Download scenario results to 3Di Models & Simulations directory structure (if available) (see also nens/ThreeDiToolbox#805)

Existing code & examples This python package (developed by 3Di user @emielverstegen) may be helpful: https://github.com/nens/threedi-scenario-downloader. This python API tutorial shows how to download 3Di rasters: https://demo.lizard.net/media/tutorials/How_to_download_a_maximum_waterdepth_raster_from_a_3Di_scenario_stored_in_the_Scenario_Archive_in_Lizard_.ipynb.

UI sketch Private Zenhub Image

[ldebek]

Implementation branch: https://github.com/nens/lizard-qgis-plugin/tree/download_results

[leendertvanwolfswinkel]

@ldebek Things that need to be fixed before release:

• [x] Nodatavalue of downloaded max water depth tiles (.tif) is NoData Value=3.4028234663852886e+38, while the nodatavalue in the the VRT is NoData Value=-9999
• [x] I don't understand what is downloaded for the temporal rasters, e.g. water level (timeseries). In the download folder I see 4 tiles and a VRT, which suggests that only 1 timestep was downloaded. But which one?

Other, minor things in #10

[ldebek]

• [x] I don't understand what is downloaded for the temporal rasters, e.g. water level (timeseries). In the download folder I see 4 tiles and a VRT, which suggests that only 1 timestep was downloaded. But which one? Downloading of temporal rasters is disabled now for a time beign.