search

bytedance / music_source_separation

Other
1.26k stars 194 forks source link

如何提升声伴分离在中国古典乐器上面的表现呢，MUSDB18没有这块的数据做训练 #17

Open ThinkInFuture opened 2 years ago

ThinkInFuture commented 2 years ago

我用预训练试了几首中国古典乐器，比如古琴、琵琶，相关乐器都分离到了人声上面了。

zhanh-he commented 2 years ago

musdb都是欧美风格的音乐，估计这个是主原因。

你需要自己设计一个全新的中国风歌曲dataset，要有足够歌曲的accomps收纳古琴\琵琶等乐器，模型才能学会如何区分这些乐器和人声。

如果要细分每个乐器这可能是一个很庞大的工作，但设计一个新dataset区分伴奏和人声应该不难。

On Fri, Oct 8, 2021 at 7:39 PM ThinkInFuture @.***> wrote:

我用预训练试了几首中国古典乐器，比如古琴、琵琶，相关乐器都分离到了人声上面了。

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/bytedance/music_source_separation/issues/17#issuecomment-938573087, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL2J6L2ZKNIKIXENLTGLDSTUF3J7JANCNFSM5FTNN54A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

qiuqiangkong commented 2 years ago

我用预训练试了几首中国古典乐器，比如古琴、琵琶，相关乐器都分离到了人声上面了。

感谢反馈！训练数据是欧美流行歌曲没有覆盖到民乐，因此表现会差一些。能否发一些样本到kongqiuqiang@bytedance.com测试下？谢谢！

mrlihellohorld commented 2 years ago

我用预训练试了几首中国古典乐器，比如古琴、琵琶，相关乐器都分离到了人声上面了。

您好，请问您制作该方面的数据集了吗？

qiuqiangkong commented 2 years ago

@.***测试一下吗？

On Mon, 25 Oct 2021 at 16:19, Mr.Li @.***> wrote:

我用预训练试了几首中国古典乐器，比如古琴、琵琶，相关乐器都分离到了人声上面了。

您好，请问您制作该方面的数据集了吗？

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/bytedance/music_source_separation/issues/17#issuecomment-950652044, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADFXTSMHLYUXAUTFMTRGKWLUIUHJZANCNFSM5FTNN54A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.