trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.39k stars 2.99k forks source link

Actual columns other than single summy column for Hive Metastore(+AWS Glue) views #23837

Open EugeneChung opened 1 week ago

EugeneChung commented 1 week ago
ebyhr commented 1 week ago

There're some situations we can't store column definitions in Glue.

  1. Trino views supports column types Glue can't represent. e.g. UUID, HyperLogLog, and etc. https://trino.io/docs/current/language/types.html
  2. Glue has stricter rules for length. For instance, their max length of column's name and comment is 255 though a Trino view doesn't have such limitations. https://docs.aws.amazon.com/glue/latest/webapi/API_Column.html
EugeneChung commented 1 week ago

Then can we use the single dummy column only when it meets those cases?