delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.48k stars 1.68k forks source link

[Feature][Spark] Add deletion vector metrics in Merge #2441

Open andreaschat-db opened 8 months ago

andreaschat-db commented 8 months ago

Feature request

Which Delta project/connector is this regarding?

Overview

This issue is a follow up of the recent implementation of Deletion Vectors in Merge (https://github.com/delta-io/delta/issues/2296). Merge needs to report deletion vector metrics similarly with UPDATE and DELETE commands.

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

felipepessoto commented 4 months ago

I believe this is done.

BTW do we have metrics for reads?