[Feature]: The cost repository is missing max content window sizes for all models

Helicone / helicone

🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23

https://www.helicone.ai

Apache License 2.0

1.82k stars 199 forks source link

[Feature]: The cost repository is missing max content window sizes for all models #2840

Open colegottdank opened 2 hours ago

colegottdank commented 2 hours ago

The Feature

Please update the /cost repo. Right now it stores the providers, models, cost per token, but it does not contain the max window size.

Please add it to all models and ensure you do research so the max window size is correct.

Motivation, pitch

To get more accurate data on models and providres.

Twitter / LinkedIn details

No response

use-tusk[bot] commented 2 hours ago

I'm working on this issue. Will comment once I have an update.

See activity logs for more info.

use-tusk[bot] commented 1 hour ago

I created a pull request for this issue. 🧑‍💻

Please approve and merge the PR once you've verified that the changes work. If there are nits, leave a "Request Changes" review for me. Otherwise, checkout the branch to make changes.

use-tusk[bot] commented 1 hour ago

You can see the changes for this task on this preview URL. Please approve and merge the PR if everything looks good! 🚀