apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

https://amoro.apache.org/

Apache License 2.0

875 stars 292 forks source link

[Subtask]: Generalize TaskRuntime to support more task types that can be delegated to the optimizer. #3237

Closed majin1102 closed 1 month ago

majin1102 commented 1 month ago

Search before asking

[X] I have searched in the issues and found no similar issues.

Description

Right now TaskRuntime is only for optimizing running tasks. To make plan, commit and evaluate tasks all delegated to optimizers, TaskRuntime need to be generalized.

Parent issue

2596

Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct