search

AgentOps-AI / agentops

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
https://agentops.ai
MIT License
1.27k stars 101 forks source link

Instrument litellm #163

Closed HowieG closed 2 months ago

HowieG commented 2 months ago

📥 Pull Request

📘 Description Adding override of litellm.completion and litellm.acompletion

🎯 Goal Give users access to several LLM APIs using the OpenAI format (Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.)

🔍 Additional Context Adding litellm is mutually exclusive to adding openai or any of the other LLM APIs it overrides

🧪 Testing AgentOps-AI/lead-detective/test_litellm_sync.py AgentOps-AI/lead-detective/test_litellm_async.py AgentOps-AI/lead-detective/test_openai_v0.py