Open ylwu-amzn opened 3 months ago
This PR aded status code to response https://github.com/opensearch-project/ml-commons/pull/1443, need to debug why it doesn't return correct status code sometimes.
Hi @ylwu-amzn, feel free to change the assignee to the most suitable one
What is the bug? Some user reports that the connector (Azure openAI) doesn't return correct throttling exception status code 429 to client side. So they can't detect that error and retry.
Related issue https://github.com/opensearch-project/OpenSearch/issues/14337