DAGWorks-Inc / burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
https://burr.dagworks.io
BSD 3-Clause Clear License
561 stars 29 forks source link

Streaming errors in sequence ID #177

Closed elijahbenizzy closed 2 weeks ago

elijahbenizzy commented 2 weeks ago

Short description explaining the high-level reason for the new issue.

Current behavior

If you run the streamlit_application on chatbot_streaming, you'll hit some pain points. See the following:

image

Expected behavior

  1. Sequence ID should start at 0
  2. We should not skip 4

Additional context

What's actually happening is that it is initially incrementing twice, then failing to increment.

cat ~/.burr/demo_chatbot_streaming/chat_streaming:13ba2c/log.jsonl | jq ".sequence_id"
1
1
2
2
3
3
3
3
5
5
6
6
7
7
7
7
elijahbenizzy commented 2 weeks ago

See #178