Enhancement Request: Implement Streaming API for Chat and Edit Features in Jarvis

alondmnt / joplin-plugin-jarvis

Joplin (note-taking) assistant running a very intelligent system (OpenAI/GPT, Hugging Face, Gemini, Llama, Universal Sentence Encoder, etc.)

GNU Affero General Public License v3.0

209 stars 22 forks source link

Enhancement Request: Implement Streaming API for Chat and Edit Features in Jarvis #8

Open ryanfreckleton opened 1 year ago

ryanfreckleton commented 1 year ago

OpenAI has a streaming API to allow for results to come token by token. It would be a nice addition to add this to both the chat and edit features of Jarvis.

Wladefant commented 7 months ago

Oh yes definitely, same goes for the local models. And additionaly a feature where you can stop the stream, when it goes into the wrong direction