softwaremill / sttp-openai

Apache License 2.0
41 stars 9 forks source link

Easier stream chunk accumulation and conversion to full message #140

Open guersam opened 10 months ago

guersam commented 10 months ago

It's more difficult to deal with stream chunks than with full messages, especially when using tools or functions, because they have many nullables values as shown in #137 and #138.

It will be great if we can combine the chunks in a monoidal way and convert the accumulated chunk into a null-less message easily.