search

LSSTDESC / DESC_DC2_imSim_Workflow

BSD 3-Clause "New" or "Revised" License
3 stars 3 forks source link

fix now that fits files are no longer gzipped #14

Closed villarrealas closed 5 years ago

villarrealas commented 6 years ago

Modification to the job success check now that we are no longer outputting gzip files and checkpoints are no longer being removed.

benclifford commented 6 years ago

I think this will incorrectly detect work as done if a partially written fits file exists?

villarrealas commented 6 years ago

As far as we can tell, there is no current high-speed workaround for that. There is some circumstantial evidence that the writing of a .fits file with astropy should be atomic, which should mean that case does not come up.

benclifford commented 6 years ago

from some further poking, there's some path weirdness that I've chatted with @villarrealas on the slack channel about, and he's going to investigate before further review.

benclifford commented 5 years ago

@villarrealas - is this PR still relevant? I can't remember.