search

JuliaIO / VideoIO.jl

Reading and writing of video files in Julia via ffmpeg
https://juliaio.github.io/VideoIO.jl/stable
Other
128 stars 53 forks source link

Audio support #7

Open ssfrr opened 10 years ago

ssfrr commented 10 years ago

This seems like a good time to suggest that there should be some commonality and interoperability between AudioIO and VideoIO.

For instance, using VideoIO to strip out the audio should return the same sort of audio object as AudioIO gives you when you open a file. Currently that's an AudioFile but there should be something more abstract.

Another example would be if you set up a signal processing chain using AudioIO you could apply that to the sound track of a video, either during realtime playback or as an offline rendering operation.

There are lots of pieces in the AudioIO API that are either not yet designed or still changable, so this is a good time to make sure we're aligned.

There isn't any particular rush on this from my end, but if folks want to chat about how those interfaces should look I'm here.

kmsquire commented 10 years ago

Thanks, Spencer--I hadn't realized that you were the maintainer of AudioIO! It would definitely be good to coordinate. I also might not get to that soon, but will ping you when I do.

(Others should definitely feel free to chime in!)

WojciechMigda commented 9 years ago

Hi, is VideoIO capable of decoding MP3 audio files into an array of samples with resampling? I can do io = VideoIO.open("../data/train/000kouqjfnk.mp3") but it is not obvious if I can do anything meaningful with the result afterwards. I am new to julia and avcodec api. Thanks!

ssfrr commented 9 years ago

I'm working on a new set of abstractions that I'm hoping will make audio easier to incorporate into other packages in a uniform way without pulling in all the AudioIO stuff. See ssfrr/AudioIO.jl#48 for some initial discussion. Hopefully by the end of this week I should be announcing an initial package more publicly.

kmsquire commented 9 years ago

Awesome!

On Tue, Sep 15, 2015 at 9:27 AM, Spencer Russell notifications@github.com wrote:

I'm working on a new set of abstractions that I'm hoping will make audio easier to incorporate into other packages in a uniform way without pulling in all the AudioIO stuff. See ssfrr/AudioIO.jl#48 https://github.com/ssfrr/AudioIO.jl/issues/48 for some initial discussion. Hopefully by the end of this week I should be announcing an initial package more publicly.

— Reply to this email directly or view it on GitHub https://github.com/kmsquire/VideoIO.jl/issues/7#issuecomment-140451670.

adomasbaliuka commented 2 years ago

Is there any news on this? It's been years, AudioIO.jl seems dead... are there plans to include getting also the audio from videos? Are there any ways to achieve this right now in Julia?