search

google / mediapy

This Python library makes it easy to display images and videos in a notebook.
https://pypi.org/project/mediapy/
Apache License 2.0
389 stars 18 forks source link

mediapy load, visualize or write a video with audio #4

Closed yangyi02 closed 11 months ago

yangyi02 commented 2 years ago

Hi, would like to ask if mediapy can load, visualize or write a video with audio in a colab notebook.

I checked the functions in mediapy, but cannot find any audio related code.

I wonder if adding audio into the function is possible or not?

Thank you.

hhoppe commented 2 years ago

Currently there is no way in mediapy to create a video with audio. It should be feasible because mediapy relies on ffmpeg to create the video container and ffmpeg allows the merging of audio and image streams. (The playback of the video container is done using an HTML <video> element which does support audio.) It's an interesting project that I could look at. One would have to define a separate 1D stream of audio samples, with sampling rate and bitrate different from the image stream. I'm curious what applications there are for this.

Note that, to simply play an existing video container (such as MP4) with audio, this can be done by embedding the data or URL in an HTML <video> element. For example see https://stackoverflow.com/a/60986234/1190077.