delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.22k stars 1.62k forks source link

[Feature Request][Spark] Update UniForm related comment to include description to Hudi #3252

Open harperjiang opened 2 weeks ago

harperjiang commented 2 weeks ago

Feature request

Which Delta project/connector is this regarding?

Overview

UniForm now supports both Hudi and Iceberg. But the comment in UniversalFormat.scala is outdated, only mentioning support to Iceberg. These comment in UniversalFormat.scala should be updated to describe the UniForm support to Hudi.

Example comments from the file:

Currently, UniForm only supports Iceberg. When `delta.universalFormat.enabledFormats` contains"iceberg", we say that Universal Format (Iceberg) is enabled.

Link

Motivation

Further details

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

Gali-Sai-Divakar-Reddy commented 1 week ago

Hi, I would be willing to contribute to this feature with guidance from the Delta Lake community.