search

MadcowD / ell

A language model programming library.
http://docs.ell.so/
MIT License
5.18k stars 301 forks source link

streaming #139

Open MadcowD opened 2 months ago

MadcowD commented 2 months ago

get streaming to work but not using generators

simson2010 commented 1 month ago

Why not generators, any Pros and Cons for Streaming instead of generators? I found once I wrap the client with LangSmith wrapper, it doesn't work and report generator don't have a choices field. And the streaming checking is based on the type of instance returned by openai.chat.completions.create().