cloudquery / filetypes

A helper library to create destination file plugins for CloudQuery
4 stars 3 forks source link

feat: Expose Parquet version and root repetition spec options #567

Closed erezrokah closed 2 months ago

erezrokah commented 2 months ago

Summary

Some old parquet readers like Snowflake imported need the root repetition to be undefined, and they also only support Parquet v1.

This PR exposes both options.

Related to https://github.com/cloudquery/cloudquery-issues/issues/2106 (internal issue)


Use the following steps to ensure your PR is ready to be reviewed

erezrokah commented 2 months ago

Testing this via https://github.com/cloudquery/cloudquery/pull/18906

erezrokah commented 2 months ago

Testing this via cloudquery/cloudquery#18906

Waiting on a confirmation from a customer before merging this PR