search

kylebuildsstuff / aichatbestie

ChatGPT API wrapper
https://stately-axolotl-af08c8.netlify.app/
MIT License
63 stars 18 forks source link

how to enable output streaming ? #1

Open yonnic opened 1 year ago

yonnic commented 1 year ago

By default the API returns the whole message if its done processing which takes a while depending on length. the chatGPT interface outputs the message in a stream which is possible in the api by proving the stream: true parameter in the body. I tried to add the parameter but the app breaks.

Any quick way to switch to streaming output ?

kylebuildsstuff commented 1 year ago

Sorry I missed this issue, but I don't think it's supported right now. The site just does a normal fetch and plops the response in the UI. I'm not exactly sure what would be needed to support streamed responses the app.