search

tskarhed / doremi.studio

An app for displaying a setlist and giving start notes
http://stage.doremi.studio/
2 stars 2 forks source link

Automatic note generation from image #50

Open MrTengil opened 4 years ago

MrTengil commented 4 years ago

Use ML to train a CNN to pickout the notes automatically from an image.

Import the sheet music or take a photo, have the app scan the Keys and starting notes.

This is low prio but would be hella cool.

tskarhed commented 4 years ago

If some computing is required locally, it would be wise to run it on a Web Worker.

Not sure if this is something to take inspiration from https://www.sibelius.com/products/photoscore/midi.html

tskarhed commented 4 years ago

Apparently there is an entire field of study for this https://en.wikipedia.org/wiki/Optical_music_recognition

If we use MusicXML we can easily display it with https://opensheetmusicdisplay.org/