search

spring-projects / spring-ai

An Application Framework for AI Engineering
https://docs.spring.io/spring-ai/reference/index.html
Apache License 2.0
3.33k stars 855 forks source link

Adding support for OpenAI's real-time model #1464

Open kevintsai1202 opened 1 month ago

kevintsai1202 commented 1 month ago

Added support for OpenAI realtime model, which is built on Websockets

Additionally, if Spring AI can provide a more convenient and rapid way to integrate Spring Websocket, it should be very helpful for developers

Azure's Samples about realtime model https://github.com/Azure-Samples/aoai-realtime-audio-sdk

The following is excerpted from the Readme

/realtime is built on the WebSockets API to facilitate fully asynchronous streaming communication between the end user and model. It's designed to be used in the context of a trusted, intermediate service that manages both connections to end users and model endpoint connections; it is not designed to be used directly from untrusted end user devices, and device details like capturing and rendering audio data are outside the scope of the /realtime API. 圖片

markpollack commented 1 month ago

Thanks for the submission ,very cool stuff being developed!