Refactor the local development environment initialization and persistent data management

scimma / blast

Django web app for the automatic characterization of supernova hosts

MIT License

1 stars 2 forks source link

Refactor the local development environment initialization and persistent data management #191

Closed manning-ncsa closed 7 months ago

manning-ncsa commented 7 months ago

Description of the Change

(1) Refactors the local development environment initialization scripts and (2) replaces local directory bind mounts with Docker named volumes for the persistent data storage associated with the Django database, static files, and astronomical data in order to
- align local dev deployment with the recent Kubernetes deployment and
- improve the logic of data initialization and subsequent management of persistent data.
Updates relevant dev documentation.

Checklist

Please check all that apply to your proposed changes

[ ] HTML code change
[ ] Added package dependency
[ ] Added data
[ ] Changed django model
[x] Documentation change
[ ] Added or changed TaskRunner

Additional context

manning-ncsa commented 7 months ago

@djones1040 It looks like the refactoring of the initialization scripts has broken the continuous integration pipeline due to a failure to install required astro data:

...
app_ci-1         |   File "h5py/h5f.pyx", line 106, in h5py.h5f.open
app_ci-1         | FileNotFoundError: [Errno 2] Unable to open file (unable to open file: name = '/../sbipp_phot/sbi_phot_global.h5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)
Aborting on container exit...

I will attempt to debug and correct this, although I admit I don't know how to do it efficiently (a quick search yields this article but not sure I want to go down that rabbit hole). Hopefully it will only take a few iterations of the change+commit+push cycle.

manning-ncsa commented 7 months ago

@djones1040 Notice I also switched to MariaDB instead of using the old, end-of-life MySQL image.

codecov[bot] commented 7 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 53.62%. Comparing base (cebcd3d) to head (2ed3c98).

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #191 +/- ## ======================================= Coverage 53.62% 53.62% ======================================= Files 28 28 Lines 3355 3355 ======================================= Hits 1799 1799 Misses 1556 1556 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

manning-ncsa commented 7 months ago

Ready to merge when you are @djones1040