search

scimma / blast

Django web app for the automatic characterization of supernova hosts
MIT License
1 stars 2 forks source link

Trim image sizes #260

Closed djones1040 closed 3 weeks ago

djones1040 commented 4 weeks ago

Fixes # .

Description of the Change

added image trimming system task to reduce storage space needs on disk potentially(?) fixed a bug where tasks where not being re-initialized when TNS updated a redshift

Checklist

Please check all that apply to your proposed changes

Additional context

manning-ncsa commented 4 weeks ago

A few questions:

  1. Have you tested that this works on a Blast instance already populated with image data and completed transient workflows prior to applying the migration and code updates?
  2. Why is the trimming task not part of the transient workflow?
djones1040 commented 4 weeks ago

A few questions:

  1. Have you tested that this works on a Blast instance already populated with image data and completed transient workflows prior to applying the migration and code updates? -> I'll check it out on full_dev tonight/tomorrow, spot checks of all the changes seem to work though
  2. Why is the trimming task not part of the transient workflow? -> I'd like it to do the trimming no matter if the transient workflow succeeds or fails. I figured it could just be a system task that sorts through every hour and sees if any images are ready to be cut down even if the transient workflow is still in progress