opensource-observer / oso

Measuring the impact of open source software
https://opensource.observer
Apache License 2.0
73 stars 16 forks source link

Create a bq2clickhouse variant for trino #2479

Open ravenac95 opened 2 days ago

ravenac95 commented 2 days ago

What is it?

For anything currently downstream of events we need to have a way to export the data for trino to query. For the event data this should likely be done in a way that is incremental. For non-event data it might be possible to simply query a "hive" db directly so we can continuously rewrite those tables.