bytedance / piano_transcription

1.67k stars 198 forks source link

Incorporate Beat Detection #29

Open mpl-cwassen opened 1 year ago

mpl-cwassen commented 1 year ago

First and foremost, I'd like to express my admiration and commend the incredible work you've accomplished with the piano_transcription project. As a user, I am consistently impressed by its performance and accuracy in transcribing piano music to MIDI format. Your dedication to advancing music technology is evident and greatly appreciated by the community.

That being said, I believe there is an opportunity to further enhance the functionality and utility of piano_transcription by implementing a beat detection feature. Currently, the transcribed MIDI output defaults to 120 BPM, which is practical but doesn't account for the dynamic tempo variations that musicians often employ to convey emotion and emphasis in their performances.

Feature Suggestion: Dynamic Tempo Detection and Transcription

Implementing dynamic beat detection could be a game-changer for composers, arrangers, and anyone interested in creating faithful transcriptions of piano recordings. Understanding that this may be a complex feature to develop, I'm curious to learn about potential plans or considerations you might have regarding the capture of tempo variations in your transcriptions.

Thank you again for your exceptional work on this project—the impact it has had on the music tech community is remarkable. I look forward to any thoughts or discussions this suggestion might inspire.

qiuqiangkong commented 1 year ago

Thank you very much for the thoughts! Dynamic beat transcription is definitely an important research topic. There is a larger research scope called "audio to score transcription". Currently I have moved to some other projects. I will definitely think about the dynamic beat tracking in following researches.

On Sat, 11 Nov 2023 at 13:42, mpl-cwassen @.***> wrote:

First and foremost, I'd like to express my admiration and commend the incredible work you've accomplished with the piano_transcription project. As a user, I am consistently impressed by its performance and accuracy in transcribing piano music to MIDI format. Your dedication to advancing music technology is evident and greatly appreciated by the community.

That being said, I believe there is an opportunity to further enhance the functionality and utility of piano_transcription by implementing a beat detection feature. Currently, the transcribed MIDI output defaults to 120 BPM, which is practical but doesn't account for the dynamic tempo variations that musicians often employ to convey emotion and emphasis in their performances.

Feature Suggestion: Dynamic Tempo Detection and Transcription

  • The goal of this feature is to analyze the audio input and accurately detect the tempo, translating these findings to the MIDI output.
  • This proposed feature would enable the MIDI to reflect the actual tempo throughout the piece, accommodating accelerandos, ritardandos, and other tempo changes.
  • The resulting MIDI files would be musically correct, reflecting the true intent of the original performance.
  • This enhancement would significantly improve the experience for users looking to create sheet music from audio files, as it would provide a more accurate representation of the timing and pacing of the music.

Implementing dynamic beat detection could be a game-changer for composers, arrangers, and anyone interested in creating faithful transcriptions of piano recordings. Understanding that this may be a complex feature to develop, I'm curious to learn about potential plans or considerations you might have regarding the capture of tempo variations in your transcriptions.

Thank you again for your exceptional work on this project—the impact it has had on the music tech community is remarkable. I look forward to any thoughts or discussions this suggestion might inspire.

— Reply to this email directly, view it on GitHub https://github.com/bytedance/piano_transcription/issues/29, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADFXTSPSM2MOKMQQ6TOUXE3YD4F3VAVCNFSM6AAAAAA7HAQCRWVHI2DSMVQWIX3LMV43ASLTON2WKOZRHE4DQNZVGY2DMOA . You are receiving this because you are subscribed to this thread.Message ID: @.***>