mjhydri / Singing-Vocal-Beat-Tracking

This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.
MIT License
27 stars 4 forks source link

Paper for the code and the instructions for running it #1

Open kewlcoder opened 1 year ago

kewlcoder commented 1 year ago

hi Moji, Hope you are doing well. Wanted to check if this repo is a code base for the paper "SingNet: A Real-time Singing Voice Beat and Downbeat Tracking System". If yes, is this a complete code? Further, would you be able to add an example/instructions to run the code? Help would be much appreciated.

Thanks Kewlcoder

mjhydri commented 1 year ago

Hi Kewlcoder,

PLease send the request to @.***

Thank you in advance. Moji

On Sun, Jul 23, 2023 at 3:49 PM kewlcoder @.***> wrote:

hi Moji, Hope you are doing well. Wanted to check if this repo is a code base for the paper "SingNet: A Real-time Singing Voice Beat and Downbeat Tracking System". If yes, is this a complete code? Further, would you be able to add an example/instructions to run the code? Help would be much appreciated.

Thanks Kewlcoder

— Reply to this email directly, view it on GitHub https://github.com/mjhydri/Singing-Vocal-Beat-Tracking/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANWBSZM6QRRWMQGOTCMQOYDXRV54PANCNFSM6AAAAAA2UWUIIA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

kewlcoder commented 1 year ago

Hi Moji, I have received your message with the EMAIL ID shared as REDACTED. Check the attached screenshot.

Screenshot_20230726-083543

mjhydri commented 1 year ago

Hi there,

I hope you are well and apologize for my late reply. I recently got back from a summer travel. Please find the BeatNet training script below. Regarding the datasets, please note that some of them such as GTZAN are freely available and to obtain some others such as Rock-Corpus I signed a consent to not hand it over. However, you can get in touch with their maintainers and obtain them after signing a consent. Please feel free to ask if you have any questions regarding the training process. Good luck with your training.

Best, Moji

On Thu, Aug 3, 2023 at 3:54 AM amantanejams @.***> wrote:

Gentle reminder @mjhydri https://github.com/mjhydri :) !

— Reply to this email directly, view it on GitHub https://github.com/mjhydri/Singing-Vocal-Beat-Tracking/issues/1#issuecomment-1663468350, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANWBSZM3JNJP3UIZQGNQYB3XTNKJRANCNFSM6AAAAAA2UWUIIA . You are receiving this because you were mentioned.Message ID: @.***>

kewlcoder commented 1 year ago

hi @mjhydri, Still don't see any attachments. Would you like to add them to the repository directly?

Thanks

mjhydri commented 1 year ago

[image: Capture222.PNG] I hope it helps!

On Thu, Aug 3, 2023 at 2:29 PM kewlcoder @.***> wrote:

hi @mjhydri https://github.com/mjhydri, Still don't see any attachments. Would you like to add them to the repository directly?

Thanks

— Reply to this email directly, view it on GitHub https://github.com/mjhydri/Singing-Vocal-Beat-Tracking/issues/1#issuecomment-1664442565, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANWBSZIFSHJFTIWSRKETLJTXTPUXPANCNFSM6AAAAAA2UWUIIA . You are receiving this because you were mentioned.Message ID: @.***>

mjhydri commented 1 year ago

Also. Please note that the zip file contains the source code for training BeatNet. In order to train the singing vocal model please use the following code: vocal - beat - source.zip https://drive.google.com/file/d/1GTvHjJZ43sD64PJn8Mw-n43l9HfXcKrk/view?usp=drive_web

On Thu, Aug 3, 2023 at 2:54 PM Moji HHH @.***> wrote:

[image: Capture222.PNG] I hope it helps!

On Thu, Aug 3, 2023 at 2:29 PM kewlcoder @.***> wrote:

hi @mjhydri https://github.com/mjhydri, Still don't see any attachments. Would you like to add them to the repository directly?

Thanks

— Reply to this email directly, view it on GitHub https://github.com/mjhydri/Singing-Vocal-Beat-Tracking/issues/1#issuecomment-1664442565, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANWBSZIFSHJFTIWSRKETLJTXTPUXPANCNFSM6AAAAAA2UWUIIA . You are receiving this because you were mentioned.Message ID: @.***>

kewlcoder commented 1 year ago

Hi Moji, Still not able to get access. Your first msg is visible as follows - " [image: Capture222.PNG] I hope it helps! "

And the drive link does not give me access. I have requested access, though. Waiting for your approval. Thanks

musicgary commented 1 year ago

Also. Please note that the zip file contains the source code for training BeatNet. In order to train the singing vocal model please use the following code: vocal - beat - source.zip https://drive.google.com/file/d/1GTvHjJZ43sD64PJn8Mw-n43l9HfXcKrk/view?usp=drive_web On Thu, Aug 3, 2023 at 2:54 PM Moji HHH @.> wrote: [image: Capture222.PNG] I hope it helps! On Thu, Aug 3, 2023 at 2:29 PM kewlcoder @.> wrote: > hi @mjhydri https://github.com/mjhydri, > Still don't see any attachments. Would you like to add them to the > repository directly? > > Thanks > > — > Reply to this email directly, view it on GitHub > <#1 (comment)>, > or unsubscribe > https://github.com/notifications/unsubscribe-auth/ANWBSZIFSHJFTIWSRKETLJTXTPUXPANCNFSM6AAAAAA2UWUIIA > . > You are receiving this because you were mentioned.Message ID: > @.***> >

Hello Moji, Thanks for the repo and I would like to have a try on the code. Is this zip file contains the .pt model and .yaml file? I would like to get access to it if you don't mind. Thanks very much.

Gary

kewlcoder commented 1 year ago

Hi Moji, Sent a request again to google drive. Can you please check and approve? Thanks