search

fourMs / AudioVideoAnalysis

A standalone application for real-time analysis of audio and video.
https://www.uio.no/ritmo/english/research/labs/fourms/downloads/software/AudioVideoAnalysis/
11 stars 2 forks source link

Add option to layer the motiongram on top of the spectrogram #12

Closed aleksati closed 4 years ago

aleksati commented 4 years ago

This was mentioned as a possible enhancement to the VideoAnalysis. We could test this option here and see how it turns out.

aleksati commented 4 years ago

Added a router which lets the user display either spectrogram+motiongram together (the way it originally was implemented), only spectrogram, only motiongram or motiongram+spectrogram layered. The latter might require a few adjustments so it displays nicely so will leave this enhancement issue open as a reminder.

aleksati commented 4 years ago

Now using a [jit.alphablend] method where the red and green colors of the spectrogram are used to determine how the motiongram and spectrogram images are layered. The result is quite good. still needs more testing with different audio and images to determine if more fine-tuning or changes are needed.

aleksati commented 4 years ago

This is implemented. I Will, therefore, make more detailed issues on this if something arises in the future.