interTwin-eu / DT-flood

Deltares bits and pieces to use in flood modeling

MIT License

1 stars 1 forks source link

Use the polytype python API to read input data for models #4

Open backeb opened 3 months ago

backeb commented 3 months ago

Short Description of the issue

The polytope API can be used to read input data needed to run the models for DT Flood Early Warning and DT Flood Climate Impacts.

Here we explore using the API in our workflow.

WOTrompDeltares commented 3 months ago

The Polytope API is being integrated with our workflows in the DestinE 370a project. For InterTwin, Polytope would have to be integrated with Rucio (see issue #6 )

backeb commented 3 months ago

notes from meeting with Thomas

could consider reading data from polytope to rucio to benefit from smart caching etc. --> action for WP5?
also need to think about link between DCache, rucio and polytope.

action

discuss with Paul / Dijana

backeb commented 2 months ago

notes from meeting with Andrea

smart caching in rucio done at file level not on "loading subset of data into memory" level.
is the client smart enough to cache the data? When we download the data each time using polytope.
[ ] action could be to access data from DestinE using polytope API from interTwin resources and check speeds