metrico / qryn

Polyglot Observability Stack. Lightweight & Drop-in compatible with Loki, Prometheus, Tempo, Pyroscope, Opentelemetry, Datadog & more! WASM powered ⭐️ Star to Support
https://qryn.dev
GNU Affero General Public License v3.0
1.05k stars 63 forks source link

Feature Request: Trino support #470

Closed bcarlock-mycarrier closed 3 months ago

bcarlock-mycarrier commented 4 months ago

Trino is a crazy fast query engine that we would like to start using as a caching/fast data layer between Qryn and Clickhouse. It would also provide the added benefit of enabling connectivity between Qryn and any other Trino supported storage. Full List Clickhouse is a standard connection for Trino. There are some minor SQL dialect differences as noted in the link above.

Here is an existing project which implements a Javascript client for Trino.

lmangani commented 4 months ago

@bcarlock-mycarrier thanks for the proposal. qryn is pretty tightly integrated with ClickHouse and uses several advanced techniques to achieve its results, most likely unviable with other supported options, and one of our design principles is to keep things simple with qryn-js and while adding Trino as an option could be generally interesting, adding another layer of complexity and moving parts would require substantial arguments in favor.

Feel free to let us know more about what your reasoning and experience is and what limitations you are trying to get around. If you decide to embark into this challenge we'll gladly support your efforts and assist as we can!