Prompt flow online endpoint maximum time-out

[glzbcrt]

The document below says that we can configure the connection time-out to up to 5 minutes (300,000 ms) for Prompt flows using online endpoint.

Upstream request timeout issue when consuming the endpoint

This information conflicts with the information provided in the following two articles, where the maximum time-out is 3 minutes (180,000 ms).

• RequestSettings property
• Azure Machine Learning online endpoints and batch endpoints

Please, clarify that for Prompt flow flows the maximum timeout is 5 minutes and link to the first article.

---

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

• ID: 6cc7f3ee-58e3-a669-d4e1-0956d4573768
• Version Independent ID: c93b2f75-36f6-6751-e69b-a4a8f6b4fb00
• Content: Deploy a flow in prompt flow to online endpoint for real-time inference with CLI - Azure Machine Learning
• Content Source: articles/machine-learning/prompt-flow/how-to-deploy-to-code.md
• Service: machine-learning
• Sub-service: prompt-flow
• GitHub Login: @likebupt
• Microsoft Alias: keli19

[TPavanBalaji]

@glzbcrt Thanks for your feedback! We will investigate and update as appropriate.

[AjayBathini-MSFT]

@glzbcrt Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.

[likebupt]

Hi @glzbcrt , Thanks for pointing out the issue and sorry for the confusion caused. The max timeout 300000ms only works for prompt flow deployment. You need to add the properties in your model specification as following screenshot. This is to indicate it's a deployment from prompt flow.

We'll update the article as well.