Open bradyneal opened 1 year ago
As the underlying gRPC library only provides a blocking iterator for response streaming methods (see here), we can't really provide an async native library like that. The best option for async will likely be through the REST API, which we are targeting to add SDK support for in the future.
I (and probably many other devs) desperately need this SDK to support async. This is why https://github.com/itayzit/openai-async was made and why OpenAI later added it to their API (see bottom of https://pypi.org/project/openai/).
Any chance there are plans to support async or there are alternative (forks) that support it?