search

ErikBjare / gptme

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.
https://gptme.org/docs/
MIT License
792 stars 61 forks source link

Add streaming responses to web UI #47

Open ErikBjare opened 10 months ago

ErikBjare commented 10 months ago

This might require significant rewrite of how tokens are output, turning the request into a generator that emits tokens instead of a full message. The tokens can then be collected until an end of message token, returned over the API, while being consummated into a message at the end.

nslieske commented 10 months ago

In my opinion, the web interface should be a lower priority. The tool works very well on the command line, so to divert your efforts towards a web UI is not efficient. If someone else wants to step up, then it makes sense. What's the motivation for the web interface at all?

ErikBjare commented 10 months ago

It is a lower priority :)

It's not that much of a distraction, the changes required would improve the code overall anyway.

The web UI is nice for browsing past conversations, and in theory it'd be nice if it could act like a Jupyter-notebook style thing with inline plots and such. But you're right, I'm not going to divert significant efforts towards it right now.