search

AgentOps-AI / agentops

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
https://agentops.ai
MIT License
1.18k stars 93 forks source link

Groq support #283

Open acamenhas opened 2 days ago

acamenhas commented 2 days ago

Hello,

I'm using Ollama via Groq, can I track those LLM calls with agentops?

Thank you

areibman commented 2 days ago

Hello,

I'm using Ollama via Groq, can I track those LLM calls with agentops?

Thank you

We support Groq via our LiteLLM integration: https://docs.agentops.ai/v1/integrations/litellm

Also, if you use langchain groq, the langchain callback handler should work.

That said, we're planning on native Groq SDK support in the future.