search

hyperdxio / hyperdx

Resolve production issues, fast. An open source observability platform unifying session replays, logs, metrics, traces and errors powered by Clickhouse and OpenTelemetry.
https://hyperdx.io/
MIT License
6.59k stars 192 forks source link

Support for LLM observalibility #62

Open srinisubramanian opened 11 months ago

srinisubramanian commented 11 months ago

Any ideas for providing LLM observalibility options from frameworks like LangChain?

A simple approach (given OpenTelemetry integration) could be to use openllmetry. More details on a SDK for itnegration is here: https://github.com/traceloop/openllmetry

MikeShi42 commented 11 months ago

Definitely familiar with openllmetry - met with Nir a couple of times!

We should be supported already, though I'll want to test it out myself and submit a PR for their docs and ours if it works successfully. In theory you should be able to set them up and provide the following configs (assuming localhost, the base url would be https://in-otel.hyperdx.io for cloud):

TRACELOOP_BASE_URL=http://localhost:4318
TRACELOOP_HEADERS="authorization=<YOUR_HYPERDX_API_KEY_HERE>"

Any chance you already have openllmetry setup with HyperDX and want to give that a spin?

srinisubramanian commented 11 months ago

@MikeShi42 I havent tred this ,, but since you say it should work I will try and let you know for sure,

MikeShi42 commented 11 months ago

@srinisubramanian Traceloop has published an integration page about us, we'll hopefully do the same on our end soon!

https://www.traceloop.com/docs/openllmetry/integrations/hyperdx