search

deepset-ai / haystack-integrations

🚀 A list of Haystack Integrations, maintained by the community or deepset.
42 stars 52 forks source link

Add OpenLIT to Haystack Integrations #234

Open patcher9 opened 1 month ago

patcher9 commented 1 month ago

How OpenLIT works with Haystack?

OpenLIT basically wraps around OpenAI, Anthropic etc functions and configures OpenTelemetry tracing and metrics for it. In the Haystack pipelines whenever the user runs a pipeline(Since Haystack also uses the same LLM functions), We are automatically able to wrap the pipeline (without needing to create any additional instrumentation for Haystack).

We did add instrumentation just for Document loaders as the rest of the pipeline can directly be tracked for reasons mentioned above.

patcher9 commented 1 month ago

@bilgeyucel, Tagging you for sanity as not sure who to tag for review on this :)