gburca / VirtMus

the modern music stand - virtmus.com
GNU General Public License v2.0
8 stars 2 forks source link

Add link to audio #4

Open Aphexus opened 6 years ago

Aphexus commented 6 years ago

It would be nice to assign audio(and possibly midi) to a song so that one can listen. In fact, it would be nice to be able to synchronize them so that one can listen to specific passages.

With the midi "issue" I mentioned, adding a play, forward measure, backward measure, next section, previous section, type of triggers would really help one learn specific passages quickly.

This is a bit of work and requires loading songs(ffmpeg can be used from the command line to parse songs if necessary) but would be worth it.

gburca commented 6 years ago

Adding a link to an audio file is doable, and in fact can be done now using the song properties (there's a generic Notes field). A dedicated field and the ability to launch the default mp3 or midi player would be a good idea.

Synchronizing the visual and auditory portions is orders of magnitude more difficult and unlikely to ever happen for VirtMus since neither JPGs nor MP3s have any metadata indicating where the notes, measures, or pages fall.

Aphexus commented 6 years ago

What I mean is not to sync audio to the notes but to the page changes. It allows one to read the music. If you look on youtube you will find many videos that have the audio and sheet music synced.

So, all one has to do is assign page changes(of the pdf/score) to time(corresponding to a specific audio file).

So, it would require a bit more than just opening an external audio player with the file but have a player embedded and probably also "embeds/save" the audio to the project(since different audio files could provide sync issues).

Having a metronome that one could sync too then one could play to the metronome without ever having to change pages also.

Lots of potential but nothing fancy or impossible is needed.