search

populse / capsul

Collaborative Analysis Platform : Simple, Unifying, Lean
Other
7 stars 14 forks source link

Switch to redis database #244

Closed sapetnioc closed 1 year ago

sapetnioc commented 2 years ago

This PR requires a change in the Singularity image to work. Therefore it must be discussed. However, it contains a reorganization of database and engine API. There is no much change but many code is now done in the database or in the Engine based class. Derived engined (such as LocalEngine) are much smaller and easier to understand.

This PR also adds the possibility to have an execution report (dispalying all jobs information including stdout, stderr, etc.). So it may be interesting to consider to merge it. I could go back to populse_db for the database if necessary.

sapetnioc commented 2 years ago

I created two backends for databases, one using populse_db an one using redis. I still have to adapt Celery and Soma-workflow engines.

denisri commented 1 year ago

redis and celery have been added to new casa-distro images (use casa_distro pull_image to update)