search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
31.5k stars 4.58k forks source link

Integrating Streaming with Chat UI Frameworks like Streamlit or Chainlit #980

Open lianghsun opened 9 months ago

lianghsun commented 9 months ago

I have a question about the application of streaming beyond the terminal. Is it possible to integrate streaming with existing chat UI frameworks, such as Streamlit or Chainlit? I am curious to know if streaming can be effectively merged with these frameworks to enhance user interaction and interface capabilities.

cccc11231 commented 9 months ago

Waiting for it as well. I can see the response from llm is streaming in the terminal, but currently looks like cannot stream the final result.

thinkall commented 3 months ago

The iostream would support this now.

jonathanbouchet commented 1 week ago

Hello, I was wondering if there's any development in this possible feature.

I tried a simple test with streamlit 

import streamlit as st
from io import StringIO
import autogen

# Title
st.title("Hello World")

and just importing autogen makes a segmentation fault

env: Python 3.12.2 streamlit: 1.38.0 pyautogen: 0.3.0

Should I revert to previous versions of python, or autogen to have this code not crashing ?

thanks, Jonathan