ddlBoJack / emotion2vec

[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
637 stars 47 forks source link

Fine-tuning dataset for emotion2vec+ base #46

Open Choddeok opened 1 month ago

Choddeok commented 1 month ago

Hello, I am curious about the fine-tuning dataset for emotion2vec+ base. Can I assume that the fine-tuning was done using the downstream tasks datasets mentioned in 'Table 1: The datasets at a glance for emotion2vec pre-training and downstream tasks'?

ddlBoJack commented 1 month ago

Hi, emotion2vec+ seed is fine-tuned with academic speech emotion data from EmoBox and emotion2vec+ base is fine-tuned with filtered large-scale pseudo-labeled data labeled from emotion2vec+ seed.

Choddeok commented 1 month ago

Thank you for your response. I would like to know if there are any plans to release the model checkpoints that follow the 'Table 1: The datasets at a glance for emotion2vec pre-training and downstream tasks' setup?

ddlBoJack commented 2 weeks ago

Do you mean the downstream models?

zhoujiani0102 commented 16 hours ago

Do you mean the downstream models?你指的是下游模型吗?

Hello! I would like to know which funasr pipeline checkpoints should I use for downstream tasks?