search

transientskp / tkp

A transients-discovery pipeline for astronomical image-based surveys
http://docs.transientskp.org/
BSD 2-Clause "Simplified" License
19 stars 14 forks source link

restructure the points of commit to database #361

Open gijzelaerr opened 9 years ago

gijzelaerr commented 9 years ago

At the moment queries that manipulate a database are directly committed. I propose that we commit transactions at the end of every step (where step is a logical unit as in persistence, quality, etc). This way if a step fails, the set of queries in a step fail and can be rolled back.

An other advantage is that we can rollback every database test and thus not polluting the database. Also it should be easier to reason about in what state the database is.

This is probably wise to combine with the switch to SQLAlchemy.

This issue has been moved from the LOFAR issue tracker: https://support.astron.nl/lofar_issuetracker/issues/4227

gijzelaerr commented 9 years ago

depends on https://github.com/transientskp/tkp/issues/362

AntoniaR commented 3 weeks ago

Maybe useful for the TraP redesign?