[AMORO-3220] Optimize table summary metrics to fetch data - Githubissues

apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

https://amoro.apache.org/

Apache License 2.0

875 stars 292 forks source link

[AMORO-3220] Optimize table summary metrics to fetch data #3221

Closed MarigWeizhi closed 2 months ago

MarigWeizhi commented 2 months ago

Why are the changes needed?

Close #3220.

Brief change log

fetch totalFileRecords,totalFileSize,totalFileCount from snapshot summary
add table_summary_dangling_delete_files metric
danglingDeleteFiles = totalDeleteFiles - eqDeleteFiles - posDeleteFiles

How was this patch tested?

[X] Add some test cases that check the changes thoroughly including negative and positive cases if possible
[ ] Add screenshots for manual tests if appropriate
[X] Run test locally before making a pull request

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)