search

mobiusml / aana_sdk

Aana SDK is a powerful framework for building AI enabled multimodal applications.
https://www.mobiuslabs.com/
Apache License 2.0
33 stars 4 forks source link

[enhancement] Streaming video support on the SDK. HLS, DASH #85

Open ashwinnair14 opened 8 months ago

ashwinnair14 commented 8 months ago

https://colab.research.google.com/drive/1OKAYxl6MtGufhEvj5ZexIewyvgPRvHge?authuser=1

https://github.com/mobiusml/sdk_prototype/blob/7f0fb49cf54b902fb988b2170afcebf62d1a29cb/sdk_prototype/video_utils.py#L46

HRashidi commented 6 months ago

Test problem: Currently the stream is blocked by the github test instance, throwing 403 error (403 Forbidden (access denied))

Supporting SRT via pyav: The pyav uses the ffmepg unver the hood to read the SRT. The default ubuntu ffpmeg package is not supporting the SRT. We need to compile it again The is a script which compile the fmpeg automatically. (https://gist.github.com/maheshgawali/1a288d58171ea45a920078855bb90e50) For pyav to use the new ffmpeg, we need to install it without binary which currently throw error, saying it can not compile with static files.

The poetry does not support --no-binary flag for now, which we need to run pip to install the pyav with no binary.

@movchan74

ashwinnair14 commented 6 months ago

SRT streaming to be done in a new ticket.