🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
Some endpoints are not behaving properly because we currently don't copy query params when forwarding requests.
For example, GET /threads/{thread_id}/messages (doc) takes in query params for pagination.
Added a line to copy query params before making the request.