apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
https://amoro.apache.org/
Apache License 2.0
748 stars 261 forks source link

[Bug]: The number of optimize records on the snapshots tab does not match the number of records on the optimizing tag page. #2937

Closed Aireed closed 2 weeks ago

Aireed commented 2 weeks ago

What happened?

catalog: unifiedSessionCatalog metastore: hms table-format: mixed-hive

optmizing Tab: image

snapshots tab: image image

Affects Versions

master

What table format are you seeing the problem on?

Mixed-Hive

What engines are you seeing the problem on?

AMS, Optimizer

How to reproduce

1、upgrade a hive table to mixed-hive 2、crud the table

Relevant log output

No response

Anything else

No response

Are you willing to submit a PR?

Code of Conduct

zhoujinsong commented 2 weeks ago

@Aireed Thanks for reporting.

At this stage, the committing phase of Mixed-Hive table self-optimizing may indeed generate multiple snapshots. We can try to optimize this in future versions, but for now, it is expected behavior.