Figure out a graceful exit for data generation script

[nshdesai]

It seems as though default signal handling doesn't work out of the box with the data generation script because big-sleep also uses this to gracefully exit during training.

So basically,

for prompt in prompts:
    imagine() # Handles graceful exit
    if terminate:
        exit() # This doesn't work because the top-level signal handler doesn't get called

This means that during each iteration imagine() thinks that the program has been terminated, but this message is not passed on to the script performing the loop.

[baronet2]

So you're saying there's no way to identify whether imagine() crashed?

[nshdesai]

imagine() can handle its own interrupts (from user), but there's no obvious way to communicate this to the parent function.