search

64bit / async-openai

Rust library for OpenAI
https://docs.rs/async-openai
MIT License
1.17k stars 178 forks source link

Support Azure Streaming #110

Open dougtallmadge opened 1 year ago

dougtallmadge commented 1 year ago

Addresses https://github.com/64bit/async-openai/issues/74 and adds support for Embedding Deserialization. This also allows for streaming completion to fail gracefully on any Stream ended event as supposed to hanging until a timeout.

64bit commented 1 year ago

Thanks for the fix and PR @dougtallmadge

Interesting fix, I'm still left to wonder why [DONE] marker doesn't work as expected.

There's a corresponding test (commented out) in examples/azure-openai-service to help test this - it would be much appreciated if you can see that works with this fix?