magenta / mt3

MT3: Multi-Task Multitrack Music Transcription
Apache License 2.0
1.41k stars 185 forks source link

mt3 model prefer 3/4 beats? #121

Closed LmYjQ closed 1 year ago

LmYjQ commented 1 year ago

It seems the mt3 model tend to recognize those 4/4 beats songs as 3/4 beats, one of my sample is in the attachment. I just run the mp3 file in the colab and got the midi output. What can I do to solve this? And I wonder why this happened.

Thanks a lot.

secret.zip

iansimon commented 1 year ago

While I wouldn't consider it impossible for mt3 to have such a bias, I'd be surprised as a) the model is transcribing 2-second segments independently and then concatenating them, and b) the model isn't transcribing an explicit time signature, just raw note on/off timings.

That said, we have more accurate models that hopefully should be accessible via the colab soon.

-Ian

On Thu, Apr 27, 2023 at 7:12 AM LmYjQ @.***> wrote:

It seems the mt3 model tend to recognize those 4/4 beats songs as 3/4 beats, one of my sample is in the attachment. I just run the mp3 file in the colab and got the midi output. What can I do to solve this? And I wonder why this happened.

Thanks a lot.

secret.zip https://github.com/magenta/mt3/files/11344384/secret.zip

— Reply to this email directly, view it on GitHub https://github.com/magenta/mt3/issues/121, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKMO34V3BKYLFAFFT6DPQTXDJ5D5ANCNFSM6AAAAAAXN5TNVY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

LmYjQ commented 1 year ago

While I wouldn't consider it impossible for mt3 to have such a bias, I'd be surprised as a) the model is transcribing 2-second segments independently and then concatenating them, and b) the model isn't transcribing an explicit time signature, just raw note on/off timings. That said, we have more accurate models that hopefully should be accessible via the colab soon. -Ian On Thu, Apr 27, 2023 at 7:12 AM LmYjQ @.> wrote: It seems the mt3 model tend to recognize those 4/4 beats songs as 3/4 beats, one of my sample is in the attachment. I just run the mp3 file in the colab and got the midi output. What can I do to solve this? And I wonder why this happened. Thanks a lot. secret.zip https://github.com/magenta/mt3/files/11344384/secret.zip — Reply to this email directly, view it on GitHub <#121>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKMO34V3BKYLFAFFT6DPQTXDJ5D5ANCNFSM6AAAAAAXN5TNVY . You are receiving this because you are subscribed to this thread.Message ID: @.>

I said 3/4 beats because I imported the midi file in Musescore, I tried to change the time signature setting but failed. I'm still trying some other solutions to transform the midi file to sheet music.

Chunyuan-Li commented 1 year ago

@LmYjQ Hello, do you have any good methods for converting MIDI files to sheet music (MusicXML)? I've tried Musescore, but the results were not satisfactory. There were errors with the partitura and the conversion was very slow.

LmYjQ commented 1 year ago

@Chunyuan-Li I'm not sure what kind of error in your result. I have known how to change the time signature. 1.click the "show MIDI import panel" button

image

2.Then you can set it here image

After this, the result has about 60%-70% correctness. The main problem left is about instrument: some note are assigned to the wrong instrument, or even some instruments not included in the piece.

Chunyuan-Li commented 1 year ago

@LmYjQ I'm using the ismir2021 model to convert piano music into sheet music, but the generated MIDI file appears poor when opened in Musescore. (I mean these notes 'look' abnormal) image

I also tried using Partitura to convert the MIDI file to MusicXML, but when I open the MusicXML file in Musescore, there is a warning (although it can still be opened). musicxml-error

LmYjQ commented 1 year ago

@Chunyuan-Li you can try this. https://www.bilibili.com/video/BV1XG4y1X7Li/?spm_id_from=333.999.0.0&vd_source=d20aefd6c49cb2db0da1563b3904a2bb

Chunyuan-Li commented 1 year ago

@LmYjQ Thank you, it's really very useful.