search

langchain-ai / langchain

🦜🔗 Build context-aware reasoning applications
https://python.langchain.com
MIT License
94.89k stars 15.37k forks source link

OpenAI chain crashes due to missing content key #4140

Closed venatir closed 1 year ago

venatir commented 1 year ago

To replicate: Make hundreds of simultaneous calls to AzureAI using gpt-3.5-turbo. I was using about 60 requests per minute. About once every 3 minute you get a response that is empty that has no content key. There is an easy fix for this. I pushed a PR that solves the problem: https://github.com/hwchase17/langchain/pull/4139

shreyabhadwal commented 1 year ago

What error do you get when it crashes?

dosubot[bot] commented 1 year ago

Hi, @venatir. I'm Dosu, and I'm helping the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you reported an issue where the OpenAI chain crashes occasionally when making simultaneous calls to AzureAI using gpt-3.5-turbo. It seems that there have been some discussions in the comments, with shreyabhadwal asking for more information about the error that occurs when the crash happens. However, the issue remains unresolved at this time.

Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself, or the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution to the LangChain project. If you have any further questions or concerns, please don't hesitate to reach out.