search

ytsaurus / ytsaurus-spyt

YTsaurus SPYT provides an integration with Apache Spark
Apache License 2.0
12 stars 5 forks source link

Support hive-style partitioning when writing. #17

Closed paulpaul1076 closed 2 months ago

paulpaul1076 commented 2 months ago

Looking at this link: https://ytsaurus.tech/docs/en/user-guide/data-processing/spyt/best-practices

It seems like spyt is only able to read data partitioned using hive-style partitioning.

Could you also please add support to write yt tables using hive style partitioning?

Also please add support for this behavior: spark.sql.sources.partitionOverwriteMode=dynamic.

Alexvsalexvsalex commented 2 months ago

This feature was added. It will be available in the next release

paulpaul1076 commented 2 months ago

When is the next release?

alextokarew commented 2 months ago

When is the next release?

I think we'll release a new version within 2 or three weeks.