Add Gemini context window pricing

BerriAI / litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

https://docs.litellm.ai/docs/

Other

10.05k stars 1.12k forks source link

Closed krrishdholakia closed 1 week ago

krrishdholakia commented 1 week ago

Add Gemini context window pricing

🚄 Infrastructure

adds pricing by context window for gemini (google ai studio) + vertex ai
uses the default input_cost_per_token field for the base case (up to 128k)
adds new *_above_128k_tokens field for capturing gemini's new context window pricing

vercel[bot] commented 1 week ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 17, 2024 6:24pm