search

pezzolabs / pezzo

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
https://pezzo.ai
Apache License 2.0
2.55k stars 211 forks source link

Add support for LLAMA : TogetherAI #315

Open parthmahajan008 opened 2 months ago

parthmahajan008 commented 2 months ago

Proposal

Using API Key from Together.ai , please extend the support to run prompt tests on llama3.1 as well.

Use-Case

Compared to GPT-4o, llama3.1:70B-instruct is equally good at returning structured outputs, and extremely lower cost : 0.88$/mil tokens.

Is this a feature you are interested in implementing yourself?

Yes