search

databricks / iceberg-kafka-connect

Apache License 2.0
219 stars 49 forks source link

Add config for setting partition spec on auto table create #108

Closed bryanck closed 1 year ago

bryanck commented 1 year ago

This PR adds a config option to set the table partition spec to use when auto creating tables.

dorsegal commented 2 months ago

@bryanck Does it support hidden partitions transformation https://iceberg.apache.org/spec/#partition-transforms?

bryanck commented 2 months ago

@bryanck Does it support hidden partitions transformation https://iceberg.apache.org/spec/#partition-transforms?

Yes it does, note that the syntax follows the Java API, e.g. bucket(col, 5) (in Spark the params are reversed).