opensearch-project / ml-commons

ml-commons provides a set of common machine learning algorithms, e.g. k-means, or linear regression, to help developers build ML related features within OpenSearch.
Apache License 2.0
95 stars 129 forks source link

[BUG] Connector doesn't return correct status code to client side #2618

Open ylwu-amzn opened 3 months ago

ylwu-amzn commented 3 months ago

What is the bug? Some user reports that the connector (Azure openAI) doesn't return correct throttling exception status code 429 to client side. So they can't detect that error and retry.

Related issue https://github.com/opensearch-project/OpenSearch/issues/14337

ylwu-amzn commented 3 months ago

This PR aded status code to response https://github.com/opensearch-project/ml-commons/pull/1443, need to debug why it doesn't return correct status code sometimes.

b4sjoo commented 3 months ago

Hi @ylwu-amzn, feel free to change the assignee to the most suitable one