search

enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
https://big-agi.com
MIT License
5.45k stars 1.25k forks source link

Together AI vendor support. #346

Closed enricoros closed 9 months ago

enricoros commented 9 months ago

Add support for Together models; for instance, the new Nous Mixtral is released there first.

enricoros commented 9 months ago

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

https://github.com/enricoros/big-AGI/assets/32999/f997c93d-ba36-496e-a4e2-61d13bb416f8

enricoros commented 9 months ago

Very fast performance!

https://github.com/enricoros/big-AGI/assets/32999/027e5d77-2adc-4546-910c-67accacac0bf

qdrop17 commented 9 months ago

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

image

Unexpected token 'A', "An error o"... is not valid JSON

enricoros commented 9 months ago

@qdrop17 I just tried it now and it works perfectly here.

Screenshot_20240130_113543_Chrome.jpg

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

qdrop17 commented 8 months ago

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

enricoros commented 8 months ago

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.