mjhydri / Singing-Vocal-Beat-Tracking

This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.
MIT License
27 stars 4 forks source link
beat-tracking hubert linear-transformer music music-information-retrieval self-supervised singing-voice wavlm

Singing Beat Tracking With Self-supervised Front-end and Linear Transformers

The source code is available in this repo!

The readme file will be added soon!