apache / submarine

Submarine is Cloud Native Machine Learning Platform.
https://submarine.apache.org/
Apache License 2.0
691 stars 254 forks source link

Combine k8s and database transactions #983

Open cdmikechen opened 2 years ago

cdmikechen commented 2 years ago

The current k8s and database transactions are separate, which will result in situations where a commit/processing failure of k8s will not trigger a rollback of a database transaction. We need to design a unified transaction management or processing logic to ensure submarine-server to be able to handle exceptions and transaction rollbacks correctly.

For example, by using the @Transactional, or by putting the relevant operations codes/methods into one of our transaction services.

cdmikechen commented 2 years ago

Add a JIRA issue in https://issues.apache.org/jira/browse/SUBMARINE-1309