interTwin-eu / DT-flood

Deltares bits and pieces to use in flood modeling

MIT License

1 stars 1 forks source link

Workflow triggering and logging #7

Open backeb opened 3 months ago

backeb commented 3 months ago

Short Description of the issue

Here we discuss workflow triggering and logging capabilities.

In interTwin, OSCAR will be evaluated for data-driven triggering of workflows, including notifications of data being written to the datalake and making post-processing routines aware that new data is available for analysis.

First steps are being taken to design the architecture of the full workflow within OSCAR.

backeb commented 3 months ago

notes from meeting with Thomas

where would we deploy OSCAR?
What is the overhead of deploying OSCAR?
OSCAR has an integration with interLink (run Kubernetes cluster connected with HPC). We would use OSCAR to spin up Kubernetes clusters / pods.
Continue exploring use case and requirements and make a case for using it or not.

action

copy-paste questions received from OSCAR team here and continue discussions here.