Portkey-AI / gateway

A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
5.21k stars 356 forks source link

Add support for x-portkey-request-timeout header #404

Closed VisargD closed 2 weeks ago

VisargD commented 2 weeks ago

request_timeout is currently only available in configs. It was implemented as a part of this ticket: https://github.com/Portkey-AI/gateway/issues/186

Due to this, user cannot send a top level header to overwrite config timeout on a request level. Add support for x-portkey-request-timeout header which will be given priority over timeout set in configs. This will be applied to all the targets of a config.