search

SainsburyWellcomeCentre / aeon_experiments

Experiment workflows for Project Aeon
BSD 3-Clause "New" or "Revised" License
2 stars 0 forks source link

Environment state recovery (.tmp files) should be written out more regularly than on workflow stops #487

Open jkbhagatio opened 5 months ago

jkbhagatio commented 5 months ago

Currently, tmp files are written out when the workflow is stopped. However, if the process is killed, tmp files are not written out. Therefore tmp files should be written out more regularly, e,g, each Subject write.

jkbhagatio commented 5 months ago

We'll mainly look at saved ceph data for state recovery.

jkbhagatio commented 5 months ago

@NeuroThom suggested deleting tmp files on start of workflow as well

jkbhagatio commented 5 months ago

@aspaNeuro suggested tmp dir for tmp files as well

glopesdev commented 2 months ago

@NeuroThom suggested deleting tmp files on start of workflow as well

This has been resolved in https://github.com/SainsburyWellcomeCentre/aeon_acquisition/pull/208

@aspaNeuro suggested tmp dir for tmp files as well

Do we still need this? If so, we should probably open a new issue to discuss naming in more detail. I would probably leave it for the big refactoring too.