microsoft / vscode-tools-for-ai

Azure Machine Learning for Visual Studio Code, previously called Visual Studio Code Tools for AI, is an extension to easily build, train, and deploy machine learning models to the cloud or the edge with Azure Machine Learning service.
Other
321 stars 91 forks source link

Investigate disconnections due to unexpected responses during connection setup #2265

Open tbombach opened 5 months ago

tbombach commented 5 months ago

We need to investigate and possibly change our retry logic when we get unexpected responses from the Azure ML Proxy/Tundra during our connection.

We've received guidance from that team that when Tundra restarts, the connection can be disconnected from the Proxy/CI side. The guidance from that team is to add more retries - let's document our retry policy in the extension connection/reconnection logic and make any changes necessary to follow that guidance. Let's also make sure that any unexpected responses from the CI/Proxy output an easy to follow error message that we can provide in troubleshooting guides so that we know that the next steps are to follow up with the CI team.

tbombach commented 5 months ago

Investigations are currently in progress and we will update this item as we make progress.