I moved the option to stream a response to a fork since it is broken for the chat API and does not really do anything nice for the completions API. Originally, it looked like streaming the response would create a similar 'typing' effect like on the ChatGPT site. But once the API starts streaming, it just sends the whole reply very quickly. I (or someone who feels like it) could fix the feature at some point, but I think it makes more sense to just remove it.
I moved the option to stream a response to a fork since it is broken for the chat API and does not really do anything nice for the completions API. Originally, it looked like streaming the response would create a similar 'typing' effect like on the ChatGPT site. But once the API starts streaming, it just sends the whole reply very quickly. I (or someone who feels like it) could fix the feature at some point, but I think it makes more sense to just remove it.