search

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
9.85k stars 2.85k forks source link

Bigquery connector: no caching of metadata #10741

Open grantatspothero opened 2 years ago

grantatspothero commented 2 years ago

Currently JDBC based connectors have a metadata cache (see this PR: https://github.com/trinodb/trino/pull/2290/files)

However, the bigquery connector is not based on JDBC and thus does not benefit from the metadata caching layer.

Ideally the metadata caching layer implemented here could also be utilized in : https://github.com/trinodb/trino/issues/10740

Additionally, when implementing this caching layer make sure to handle cache invalidation (ie: dropping a table through trino should result in SHOW TABLES not returning the dropped table)

ebyhr commented 2 years ago

Relates to #4580