Add text streaming to CLI and WebUI

LincolnSteinLab / jbrowse-config-assistant-bot

Apache License 2.0

0 stars 0 forks source link

Open carolinebridge opened 3 days ago

carolinebridge commented 3 days ago

Add text streaming to CLI and WebUI to improve UX when asking the bot a question. Some stipulations:

bot responses typically come back formatted with Markdown, ensure printing the generated response in chunks accommodates for this
properly stream chunks of data through the API endpoint and back to the WebUI

carolinebridge commented 2 days ago

https://github.com/langchain-ai/weblangchain ☝️ LangChain's exemplar repo for using LangChain with a web interface -- utilizes LangServe, so might require refactoring from LangGraph (or some workarounds)