🌈 A Robust Open Source AI studio. A Universal API for inferencing 100+ LLMs(OpenAI, Azure, Cohere, Anthropic, HuggingFace, Replicate, Stable Diffusion).
Provider | Provider Name | Support | Supported Endpoints | |
---|---|---|---|---|
OpenAI | openai | ✅ | /chat/completions , /chat/completions:stream |
|
Groq | groq | ✅ | /chat/completions , /chat/completions:stream |
|
Anyscale | anyscale | ✅ | /chat/completions |
|
Deepinfra | deepinfra | ✅ | /chat/completions |
|
Together AI | togetherai | ✅ | /chat/completions |
Not supported (yet): images, audio, files, fine-tunes, moderations
Missing studio can be deployed in a variety of ways. It is deployable on bare metal, or in dockerized environments.
To start missing studio server, simply run the following command:
make compose-dev
Your AI Gateway is now running on http://localhost:8080 💥
curl \
--header "Content-Type: application/json" \
--header "x-ms-provider: openai" \
--header "Authorization: Bearer {{OPENAI_API_KEY}}" \
--data '{"model":"gpt-3.5-turbo","messages":[{"role":"user","content":"who are you?"}]}' \
http://localhost:8080/v1/chat/completions
grpcurl \
-d '{"model":"gpt-3.5-turbo","messages":[{"role":"user","content":"hi"}]}' \
-H 'x-ms-provider: openai' \
-H 'Authorization: Bearer {{OPENAI_API_KEY}}' \
-plaintext localhost:8080 llm.v1.LLMService.ChatCompletions
AI studio is an open-source project, and contributions are welcome. If you want to contribute, you can create new features, fix bugs, or improve the infrastructure.
It's still very early days for this so your mileage will vary here and lots of things will break. But almost any contribution will be beneficial at this point. Check the current Issues to see where you can jump in!
If you've got an improvement, just send in a pull request!
git checkout -b my-new-feature
)git commit -am 'feat(module): add some feature'
)git push origin my-new-feature
)If you've got feature ideas, simply open a new issues!
Please refer to the CONTRIBUTING.md file in the repository for more information on how to contribute.
AI Studio is Apache 2.0 licensed.