search

RubricLab / create-rubric-app

CLI tool to get started with a full-stack AI project.
https://todo.rubric.sh
Other
138 stars 9 forks source link

possibility to stream responses from agent #4

Closed sahanxdissanayake closed 1 year ago

sahanxdissanayake commented 1 year ago

to recreate the issue:

ask for "Tell me 10 jokes" expectation: each character to be streamed to the client

usecase: I want the user to be informed of what is happening on the backend(intermediate steps etc)

tedspare commented 1 year ago

@sahanxdissanayake want to give this a shot?

Two places to start would be in the agent's streaming code and the incoming stream code in the ChatBox component.

Here for any questions or brainstorming if you do take it on 🙌

arihanv commented 1 year ago

Hey! I added some additional callbacks + client code to get detailed intermediate steps (function calls) back to the client. I got streaming to work on the client and am working on presenting the streamed response in one line.

Will make a PR really soon! ⚡️