delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.61k stars 1.71k forks source link

[Feature Request][Spark] Update UniForm related comment to include description to Hudi #3252

Open harperjiang opened 5 months ago

harperjiang commented 5 months ago

Feature request

Which Delta project/connector is this regarding?

Overview

UniForm now supports both Hudi and Iceberg. But the comment in UniversalFormat.scala is outdated, only mentioning support to Iceberg. These comment in UniversalFormat.scala should be updated to describe the UniForm support to Hudi.

Example comments from the file:

Currently, UniForm only supports Iceberg. When `delta.universalFormat.enabledFormats` contains"iceberg", we say that Universal Format (Iceberg) is enabled.

Link

Motivation

Further details

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

Gali-Sai-Divakar-Reddy commented 5 months ago

Hi, I would be willing to contribute to this feature with guidance from the Delta Lake community.

enriqueqs commented 2 months ago

this looks like it has been addressed already if you look at master @harperjiang