nathanleiby / drum-break

Drum training tool
https://drumbreak.nathanleiby.me/
0 stars 0 forks source link

Compute a drum part from audio #32

Open nathanleiby opened 19 hours ago

nathanleiby commented 19 hours ago

Might we be able to compute a drum part using some ML 🧙 ?

Here's a blog post on the audio-to-midi model from Spotify, with a model architecture diagram https://engineering.atspotify.com/2022/06/meet-basic-pitch/

And more details of the ByteDance model: https://github.com/PolyMeilex/Neothesia/pull/212#issuecomment-2489925414 https://arxiv.org/pdf/2010.01815