search

oar-team / batsim

Batsim: Infrastructure simulator for job and I/O scheduling
GNU Lesser General Public License v3.0
30 stars 15 forks source link

Streamed output #6

Closed mpoquet closed 3 years ago

mpoquet commented 7 years ago

When large instances are executed, they might be stopped for many reasons : timeout reached, discharged battery, stopped by the user because it is too long... In these cases, nearly all Batsim's outputs are lost, as most are written at the end of the simulation.

It would be way better to write outputs throughout the simulation rather than what is currently done. The Pajé trace outputting is already streamed, the same should be applied to other output files.

Mommessc commented 5 years ago

UP! After discussion with @mickours we think that a flush of the buffers into the output files at regular time would do the trick.

mpoquet commented 3 years ago

This has been done for jobs by @Mommessc IIRC. Closing this issue as it is super old and solved for the main output file. Please reopen it if needed for other output files.