SwissDataScienceCenter / renku-python

A Python library for the Renku collaborative data science platform.
https://renku-python.readthedocs.io/
Apache License 2.0
37 stars 29 forks source link

General clean-up strategy after Renku commands fail #736

Open m-alisafaee opened 5 years ago

m-alisafaee commented 5 years ago

Is your feature request related to a problem? Please describe. Sometimes, when one of Renku commands fails, the repository is in a dirty state and we cannot run any other commands before a manual clean up (e.g. broken metadata references, unfinished dataset creation, etc.).

Describe the solution you'd like There should be a general clean up strategy where we can run after failure of a command (e.g. a cleanup function implemented by each command).

Additional context Related issue: https://github.com/SwissDataScienceCenter/renku-python/issues/684

ableuler commented 5 years ago

I'd like this feature a lot. One possibility would be to add a --atomic flag and do a hard rebase to the previous commit if a command fails. We could also make this behaviour the default, but this would basically require repositories to be clean before running any command which is also annoying.

m-alisafaee commented 4 years ago

Related: https://github.com/SwissDataScienceCenter/renku-python/issues/800

Panaetius commented 3 years ago

Add this to the new builder in https://github.com/SwissDataScienceCenter/renku-python/issues/1626