andredewes / apim-aoai-smart-loadbalancing

Smart load balancing for OpenAI endpoints and Azure API Management
47 stars 17 forks source link

Error 431 - Too Large Request Header When Using Load Balancer #7

Open Amirshox opened 2 months ago

Amirshox commented 2 months ago
image image

I am using the "gpt-4o" model to send a PDF file to GPT via an HTTP request. The error suggests that the request headers are too large. But without load balancing getting response 200.