Feat/pyroscope integration - theoretical prototype

metrico / qryn

⭐️ All-in-One Polyglot Observability with OLAP Storage for Logs, Metrics, Traces & Profiles. Drop-in Grafana Cloud replacement compatible with Loki, Prometheus, Tempo, Pyroscope, Opentelemetry, Datadog and beyond :rocket:

https://qryn.dev

GNU Affero General Public License v3.0

1.24k stars 68 forks source link

Feat/pyroscope integration - theoretical prototype #347

Closed tomershafir closed 1 year ago

CLAassistant commented 1 year ago

All committers have signed the CLA.

lmangani commented 1 year ago

Q: I don't see anything related to ingestion, how the data should be inserted into the new tables or any API mapping. Are there more files missing, or what was the testing method to develop? Some TODO with the missing APIs? Thanks @tomershafir

akvlad commented 1 year ago

I see no handlers in the PR. How do we ingest the data?

lmangani commented 1 year ago

We might have to wait for @tomershafir to return from Japan to complete this integration

lmangani commented 1 year ago

welcome back @tomershafir please let us know if you can help us with the above questions once you have a moment 🙏

lmangani commented 1 year ago

New Plan:

MVP write integration in qryn-js for pprof ingestion to the proposed CH schema
MVP read integration in qryn-js to serve Grafana Pyroscope API off the proposed CH schema
Opentelemetry qryn-otel-collector extensions to ingest pprof, jfr to the proposed CH schema @tomershafir