Currently state is being updated from the outer loop and after all threads have been joined. That holds up the main action and risks loosing updates if script crashes or is Ctrl-C'ed. Status updating belongs in a thread of it's own, so that updates can be written to state.yaml as soon as the threads drop them into state_q.
Currently state is being updated from the outer loop and after all threads have been joined. That holds up the main action and risks loosing updates if script crashes or is Ctrl-C'ed. Status updating belongs in a thread of it's own, so that updates can be written to state.yaml as soon as the threads drop them into state_q.