Unity exporter: support Parquet tables

treeverse / lakeFS

lakeFS - Data version control for your data lake | Git for data

https://docs.lakefs.io

Apache License 2.0

4.32k stars 342 forks source link

Open talSofer opened 7 months ago

talSofer commented 7 months ago

Add support for reading parquet tables managed by lakeFS from Unity catalog.

Users can add a table descriptor for parquet tables, and the tables are exported and registered to Unity.

---
name: someParquetTable
type: parquet
catalog: my-catalog-name
path: tables/some-parquet-table

The table's data is not copied on export.

talSofer commented 7 months ago