search

Azure / azure-openai-benchmark

Azure OpenAI benchmarking tool
MIT License
130 stars 55 forks source link

Fixing the while loop logic of retry mechanism for 429 requests #35

Closed sushaanttb closed 9 months ago

sushaanttb commented 9 months ago

The time calculation logic in the while loop should consider thread sleep's time in case of "RETRY_AFTER_MS_HEADER " condition.

Relates to - #33

sushaanttb commented 9 months ago

Closing this, as it got created redundantly. Since it will be taken care in #33