🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
Hi @spikelu2016 , this PR changes all the correlation id log related code, both admin and proxy.
Now the sub logger with correlation id is stored inside the http request context.
Whenever we can get it from the http request context whenever we need it, especially when we are in some deeper place.
In such cases, we need to pass the http request context as the parameter to this "deeper place".
Please feel free to let me know if you have any comments.
Hi @spikelu2016 , this PR changes all the correlation id log related code, both admin and proxy. Now the sub logger with correlation id is stored inside the http request context. Whenever we can get it from the http request context whenever we need it, especially when we are in some deeper place. In such cases, we need to pass the http request context as the parameter to this "deeper place".
Please feel free to let me know if you have any comments.