search

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
9.88k stars 2.86k forks source link

With new Trino internal Serde reader for hive, allow to override catalog Serde class settings for compatible Serde classes by config flag. #16502

Open jweaver-personal opened 1 year ago

jweaver-personal commented 1 year ago

We currently have AWS Glue crawlers creating table entries in the AWS GLUE Catalog for the HIVE connector.

With the new support in 409 for the internal Serde it would be nice to have a configuration flag that would allow not using the serde class specified in the catalog (AWS Glue Crawlers set openXserde by default) and instead use the new internal Serde for the HIVE and OpenXSerde classes from the catalog when found.

This would allow us to use the AWS Glue Crawlers without having to build the OpenXSerde fork from Starburst and instead use the new native Trino serdes.

raunaqmorarka commented 1 year ago

cc: @dain @electrum