chore: openai add new 'prediction' param - Githubissues

Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

https://portkey.ai/features/ai-gateway

MIT License

6.34k stars 454 forks source link

chore: openai add new 'prediction' param #734

Closed narengogi closed 2 weeks ago

narengogi commented 2 weeks ago

Title:

Add new parameter, more details: https://platform.openai.com/docs/guides/latency-optimization#use-predicted-outputs https://platform.openai.com/docs/api-reference/chat/create

Related Issues: (optional)

https://github.com/Portkey-AI/gateway/issues/735