adjust / parquet_fdw

Parquet foreign data wrapper for PostgreSQL
PostgreSQL License
333 stars 37 forks source link

Parquet with type struct #11

Open benjdv opened 4 years ago

benjdv commented 4 years ago

As announced in documentation (https://github.com/adjust/parquet_fdw) It will be useful to supports the column type: STRUCT. The STRUCT parquet column type may be converted into TEXT or JSON in SQL.

zilder commented 4 years ago

Hi,

that was our intention in the first place, we also had some nested structures. But unfortunately libparquet (which we use to read parquet files) does not fully support them. Particularly it doesn't support lists of structs (see this issue), but it should work fine with simpler structs without repetition. I think it makes sense to at least support those is parquet_fdw. I'll see what I can do.

jarofromel commented 2 years ago

Hi, any update on this feature, please? The underlying issue has been solved. I know, it is the feature, so I'll be happy also with the answer " we don't have a plan for this in foreseeable future" --> I would know I need to find the workaround. Thanks a lot.

andyndang commented 1 year ago

Looks like libparquet now supports STRUCT based on the latest update from the issue