search

rilldata / rill

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
https://www.rilldata.com
Apache License 2.0
1.72k stars 117 forks source link

Add Trino Connector Support in Rill #5798

Open sorieux opened 1 month ago

sorieux commented 1 month ago

I would like to connect Rill to Trino, a distributed SQL query engine, for data analysis. Currently, Trino is not available as a connector. Rill is a fantastic product, and integrating Trino would enhance its utility for my BI as Code projects.

Please add a native connector for Trino in Rill. I believe this feature would not only support my projects but also attract more users from the Trino community.

mindspank commented 1 month ago

Hey @sorieux, would you envision a Trino connector to ingest data into Rill or do you envision it would federate queries to Trino similar to our ClickHouse and Pinot connectors?

sorieux commented 1 month ago

Hi @mindspank,

Thanks for your response. Trino allows me to federate queries across different sources, including running SQL directly on files stored in Hadoop. I envision the connector enabling Rill to query Trino directly, similar to how it works with the ClickHouse and Pinot connectors, without ingesting the data.

mindspank commented 1 month ago

Gotcha. We can evaluate it however we tend to be quite conservative on direct query systems.

Due to the nature of Rill and it's quite query heavy dashboards we normally prefer dedicated olap engines that can keep up performance wise (hence we don't support direct query against Snowflake for instance)

mindspank commented 1 month ago

@brianwmunz Guessing you are prepping for Trino Summit but let's catch up and talk connectors!

brianwmunz commented 1 month ago

@mindspank whoops, I missed this until now. small world. let's talk!