This repository contains the code for the ISMIR 2020 paper "Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization."
The goal of this project is to automatically generate a piano score following video given an audio recording and its corresponding raw sheet music images. Our main contribution is a novel alignment algorithm called Hierarchical DTW that can handle jumps and repeats even when jump locations are not known.
You can find the ISMIR paper here.
You can find the extended TISMIR article here.
Mengyi Shan and TJ Tsai. "Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization" in Proceedings of the International Society for Music Information Retrieval Conference, 2020, pp. 62-69.
Mengyi Shan and TJ Tsai. "Automatic Generation of Piano Score Following Videos" in Transactions of the International Society for Music Information Retrieval, 4(1): 29-41, 2021.