Implements event-driven streaming async

tidyverse / elmer

Call LLM APIs from R

http://elmer.tidyverse.org/

Other

208 stars 30 forks source link

Implements event-driven streaming async #158

Closed shikokuchuo closed 2 weeks ago

shikokuchuo commented 2 weeks ago

Minimal changes required here at elmer to enable streaming async.

Already reviewed by @jcheng5.

Also depends on an update to curl to allow us to use curl::multi_fdset() on the curl connection at resp$body, which Jeroen has already kindly merged.

Closes #157.

shikokuchuo commented 2 weeks ago

@hadley we're now good to go on this one! Thanks.

shikokuchuo commented 2 weeks ago

Also I don't have any permissions here so either you or Joe have to merge this!

hadley commented 2 weeks ago

Thanks for all your work to make this happen!