de-id / live-streaming-demo

Use D-ID's live streaming API to stream a talking presenter
MIT License
166 stars 147 forks source link

High latency for video generation #15

Closed juberti closed 8 months ago

juberti commented 1 year ago

/talks API response usually takes about 1 second, and often fails with a 429 error. Then, it usually takes another 2-3 seconds for the video to start playing. This is too slow for real-time applications.

Screenshot 2023-09-08 at 1 58 02 PM

orgoro commented 8 months ago

streaming latency comprises of network, tts, video creation and llm sometimes (Agents) the breakdown will be available in the client notification The latency was reduced significantly in the last few months - please lets us know what you think