awslabs / amazon-s3-tagging-spark-util

Apache License 2.0
10 stars 2 forks source link

Databricks Delta format isnt supported by this library #7

Open kakampassi opened 8 months ago

kakampassi commented 8 months ago

Databrick delta format isnt supported by this library.

kakampassi commented 8 months ago

Spark supports delta format to store dataframe in data lake. But as spark doesnt support taggings, I want to save tags along with delta formats in my use case.

data_frame.write.format("delta").save("/mnt/.../delta/sdf")