[Bug]: Fireworks models are missing from `model_prices_and_context_window.json`

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

13.62k stars 1.59k forks source link

[Bug]: Fireworks models are missing from `model_prices_and_context_window.json` #4570

Closed nehiljain closed 1 month ago

nehiljain commented 4 months ago

What happened?

I was trying to use Fireworks https://fireworks.ai/models/fireworks/phi-3-vision-128k-instruct model with litellm but the litellm.completion_cost fails because the model is missing from the pricing map

Relevant log output

No response

Twitter / LinkedIn details

@nehiljain

krrishdholakia commented 4 months ago

looking at it now

It looks like they do pricing similar to together ai (based on model size) - https://fireworks.ai/pricing

krrishdholakia commented 4 months ago

curious, what're you doing with the completion_cost info? @nehiljain