Feature Request: Streamed code completions in the VS code editor

arbs-io / vscode-openai

vscode-openai seamlessly incorporates OpenAI features into VSCode, providing integration with SCM, Code Editor and Chat.

https://marketplace.visualstudio.com/items?itemName=AndrewButson.vscode-openai

MIT License

75 stars 18 forks source link

Feature Request: Streamed code completions in the VS code editor #222

Closed lotek4u closed 3 months ago

lotek4u commented 8 months ago

I realize this is a tall ask, but I looked around and didn't see any other discussions about this feature. I could have missed a previous discussion somewhere, or maybe it's just impossible...

However, I just noticed that an example of streaming completions was recently published by Open AI. Maybe this makes it a possibility, or perhaps not. I but wanted to at least ask so you can give your thoughts on the possibilities.

https://github.com/openai/openai-cookbook/blob/main/examples/How_to_stream_completions.ipynb

Thanks, Nick

arbs-io commented 7 months ago

Hi @lotekjunky sorry for the delayed response. I've changed country recently, and that's taken up most of my time. It's a good suggestion. I want to switch to streaming, but how vscode interacts with webviews makes the implementation tricky. I'll look into this feature and see if it's feasible.

arbs-io commented 3 months ago

Hi @lotek4u Streaming isn't feasible with the way that vscode and webview work (currently). I've added a response indicator to help know that the request is still being processed.