delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.62k stars 1.71k forks source link

[Feature Request] [python] addColumns to have columns comments, and additional attributes that are supported by addColumn #3709

Open vdantuluri-takeda opened 2 months ago

vdantuluri-takeda commented 2 months ago

Feature request

Which Delta project/connector is this regarding?

This is for the python DeltaTableAPI, where we do not see provision to add columns comments for multiple columns

image

Overview

The method is missing feasibility to add multiple columns, same way we add individual columns.

Motivation

The feature will be used to create external tables to add multiple columns with all the fields supported by individual column method, This would not differentiate between the 2 add methods.

Further details

I believe we need to have a column dictionary that would be supported by the delta table, and use this dictionary as an input for both methods.

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?