Audio support

[ssfrr]

This seems like a good time to suggest that there should be some commonality and interoperability between AudioIO and VideoIO.

For instance, using VideoIO to strip out the audio should return the same sort of audio object as AudioIO gives you when you open a file. Currently that's an AudioFile but there should be something more abstract.

Another example would be if you set up a signal processing chain using AudioIO you could apply that to the sound track of a video, either during realtime playback or as an offline rendering operation.

There are lots of pieces in the AudioIO API that are either not yet designed or still changable, so this is a good time to make sure we're aligned.

There isn't any particular rush on this from my end, but if folks want to chat about how those interfaces should look I'm here.

[kmsquire]

Thanks, Spencer--I hadn't realized that you were the maintainer of AudioIO! It would definitely be good to coordinate. I also might not get to that soon, but will ping you when I do.

(Others should definitely feel free to chime in!)

[WojciechMigda]

Hi,
is VideoIO capable of decoding MP3 audio files into an array of samples with resampling? I can do io = VideoIO.open("../data/train/000kouqjfnk.mp3") but it is not obvious if I can do anything meaningful with the result afterwards. I am new to julia and avcodec api. Thanks!

[ssfrr]

I'm working on a new set of abstractions that I'm hoping will make audio easier to incorporate into other packages in a uniform way without pulling in all the AudioIO stuff. See ssfrr/AudioIO.jl#48 for some initial discussion. Hopefully by the end of this week I should be announcing an initial package more publicly.

[kmsquire]

Awesome!

On Tue, Sep 15, 2015 at 9:27 AM, Spencer Russell notifications@github.com
wrote:

I'm working on a new set of abstractions that I'm hoping will make audio
easier to incorporate into other packages in a uniform way without pulling
in all the AudioIO stuff. See ssfrr/AudioIO.jl#48
ssfrr/AudioIO.jl#48 for some initial
discussion. Hopefully by the end of this week I should be announcing an
initial package more publicly.

—
Reply to this email directly or view it on GitHub
#7 (comment).

[adomasbaliuka]

Is there any news on this? It's been years, AudioIO.jl seems dead... are there plans to include getting also the audio from videos? Are there any ways to achieve this right now in Julia?