search

run-llama / llama_index

LlamaIndex is a data framework for your LLM applications
https://docs.llamaindex.ai
MIT License
35.86k stars 5.09k forks source link

[Feature Request]: Streaming openai assistant api #12294

Closed illusion77 closed 1 week ago

illusion77 commented 6 months ago

Feature Description

Streaming assistant api is now available. https://community.openai.com/t/streaming-is-now-available-in-the-assistants-api/682011 https://platform.openai.com/docs/assistants/overview?context=with-streaming

Reason

No response

Value of Feature

No response

dosubot[bot] commented 6 months ago

It seems like you've got this under control, if you want help or have specific questions, let me know what I can do for you!

#### About Dosu This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant. If you want to continue the conversation, start your reply with @dosu-bot.
VJlaxmi commented 6 months ago

Hello @illusion77,

Thank you for highlighting the availability of the streaming feature in the OpenAI Assistants API. This is a valuable addition and could enhance real-time interactions significantly.

To proceed, we should define clear use cases and requirements for integrating streaming. A technical proposal will then be drafted to outline how this feature can be incorporated into our current API structure.

I suggest we start with a basic implementation to test the core functionality and ensure compatibility. Concurrently, we can work on comprehensive documentation and testing strategies.

Looking forward to your input and collaboration to bring this feature to life!

sveinjhu commented 3 months ago

Any updates on this?