Challenge 11

“Synoptic” view of ecFlow suites with Blender

Goal: Development of an alternative design and monitoring tool for ecFlow. It should provide an eye catching monitoring tool that allows to spot critical differences in suites through colors, shapes, and volumes.


Mentors	@morianemo , @juanjodd
Skills required	- Python - Ecflow Python API - Blender Python API

Challenge description

What data/system(s) should be used?

We plan to use ecFlow the ECMWF job scheduling software.

What is the current problem / limitation?

Most of the computational systems at ECMWF are hosted, scheduled and executed using in-house software called ecFlow. The ecFlow server hosts ‘suites’, representing individual computational tasks and their inter-relations, their scripts, their associated jobs, their configuration (nodes, processes, threads). Suites are currently visualised as a series of 2D boxes. The differences between suites could be made more eye catching through this project.

What could be the solution?

We would like to explore the possibility to visualise ecFlow suites using newly available 3D visualisation software.

For example it could be possible to display an ecFlow suite with the blender 3D engine, through a city metaphor representation (city, suburbs, buildings, size, colors, floors).
It would then be possible to display the differences between two suites (variables, script templates) and spot critical differences .

ECMWFCode4Earth / challenges_2019

Challenge #11 - Synoptic view of ecFlow suites with Blender #13