search

adjust / parquet_fdw

Parquet foreign data wrapper for PostgreSQL
PostgreSQL License
333 stars 37 forks source link

Delta Lake extension, anyone? #39

Closed MironAtHome closed 2 years ago

MironAtHome commented 2 years ago

How hard is it to extend this to delta lake. For the moment just looking at very rough high level assessment, input from maintainers, to assess effort. List of affected modules and entry point would be appreciated. I will cross post between here is Kafka native binding in Rust, which seems to be the best candidate to piggy back on. Here is the binding in Rust programming language: https://github.com/delta-io/delta-rs

zilder commented 2 years ago

Hi @MironAtHome,

I'm not familiar with Delta Lake so I can't really advise anything. But since you are looking to use a different API to read data and specifically a rust binding I don't think there is much you can get from parquet_fdw.