[AMORO-3066] Optimizing the efficiency for optimizing-processes rest api - Githubissues

apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

https://amoro.apache.org/

Apache License 2.0

874 stars 290 forks source link

[AMORO-3066] Optimizing the efficiency for optimizing-processes rest api #3257

Closed klion26 closed 1 month ago

klion26 commented 1 month ago

Why are the changes needed?

Close #3066.

Brief change log

remove the ServerCatalog#tableExists(db, table) in TableController#getOptimizingProcesses because we can reuse the table load logic in the following logic
push the offset and limit in mapper#selectOptimizingProcesses(MixedAndIcebergTableDescriptor#getOptimizingProcessesInfo) to db (this can limit the items retrieved from db)

How was this patch tested?

[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
[ ] Add screenshots for manual tests if appropriate
[x] Run test locally before making a pull request

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

klion26 commented 1 month ago

@zhoujinsong @majin1102 could you please have a look when you're free thanks.

klion26 commented 1 month ago

thanks for the review and merging! @zhoujinsong @majin1102