🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
BricksLLM currently does not support OpenAI fine tuning endpoints. Here is an example PR where I add support for OpenAI voice and image API endpoints. Cost tracking is fairly complicated, and should be tackled in a separate PR.
BricksLLM currently does not support OpenAI fine tuning endpoints. Here is an example PR where I add support for OpenAI voice and image API endpoints. Cost tracking is fairly complicated, and should be tackled in a separate PR.