It4innovations / hyperqueue

Scheduler for sub-node tasks for HPC systems with batch scheduling
https://it4innovations.github.io/hyperqueue
MIT License
269 stars 20 forks source link

I/O streaming in Python API #668

Open Kobzol opened 5 months ago

Kobzol commented 5 months ago

I/O streaming is currently not exposed to the Python API. It should be added there, together with some simple way to examine the streamed output of a finished job. Perhaps the binary contents of the streaming log could be exported to the Python API through JSON, or a set of objects that describe the streamed output.