How to use streaming for OpenAI models?

llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings

Apache License 2.0

334 stars 40 forks source link

Open benfiratkaya opened 7 months ago

benfiratkaya commented 7 months ago

Hey guys, I want to use streaming for OpenAI Models. How can I do that? Can you add this feature?

adhityan commented 6 months ago

This is on the todo now. Support will be added soon.