issues
search
stuartleeks
/
aoai-simulated-api
An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)
MIT License
11
stars
4
forks
source link
Align streaming response with OpenAI API and remove double latency
#45
Open
stuartleeks
opened
1 month ago
stuartleeks
commented
1 month ago
Fix differences between streaming response and OpenAI API content/format
Avoid adding latency on response for streamin as each chunk has added latency