search

Helicone / helicone

🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23
https://www.helicone.ai
Apache License 2.0
2.09k stars 239 forks source link

[Feature]: The cost repository is missing max content window sizes for all models #2840

Open colegottdank opened 1 month ago

colegottdank commented 1 month ago

The Feature

Please update the /cost repo. Right now it stores the providers, models, cost per token, but it does not contain the max window size.

Please add it to all models and ensure you do research so the max window size is correct.

Motivation, pitch

To get more accurate data on models and providres.

Twitter / LinkedIn details

No response

use-tusk[bot] commented 1 month ago

I'm working on this issue. Will comment once I have an update.

See activity logs for more info.

use-tusk[bot] commented 1 month ago

I created a pull request for this issue. 🧑‍💻

Please approve and merge the PR once you've verified that the changes work. If there are nits, leave a "Request Changes" review for me. Otherwise, checkout the branch to make changes.

use-tusk[bot] commented 1 month ago

You can see the changes for this task on this preview URL. Please approve and merge the PR if everything looks good! 🚀