[Feature] Support streaming for OpenAI chat API

ai-for-java / ai4j

Apache License 2.0

26 stars 3 forks source link

Open deep-learning-dynamo opened 1 year ago

deep-learning-dynamo commented 1 year ago

As a java developer, I want to be able to utilize streaming feature of OpenAI chat API:

I want to improve user experience of my chat app by receiving first pieces of response as soon as possible