Closed zhongqishang closed 1 month ago
There are many details to consider.
BTW, we can access these detailed metrics information on the snapshots page.
Add eq delete count ratio for data count Add pos delete count ratio for data count
@zhongqishang I'm a little curious about the real requirements for displaying these ratios :)
There are many details to consider.
- separate parameter designs may be necessary for different Table Formats.
Each format requires a different design, or even none display. The original idea came from iceberg native format.
- when users are using the Iceberg Table in an append scenario, there are no delete files, so it's better not to display delete-related metrics at that time.
Displaying 0 without delete is fine.
- Change Store and Base Store of Mixed Format also need separate designs BTW, we can access these detailed metrics information on the snapshots page.
Yes, All this information can be found on the page, but it is not intuitive enough.
Add eq delete count ratio for data count Add pos delete count ratio for data count
@zhongqishang I'm a little curious about the real requirements for displaying these ratios :)
The query results need to be merged with delete files. For some abnormal situations, the number of deletes has a very intuitive reflection on the query analysis of the analysis table.
For example, a larger self-optimizing.major.trigger.duplicate-ratio is configured or the compaction of eq delete is not completed in time.
@wangtaohz
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
Search before asking
What would you like to be improved?
Current Base table metric only have
File count
/Total size
/Average File Size
Statistics are mixed data file and delete file.How should we improve?
Are you willing to submit PR?
Subtasks
No response
Code of Conduct