Please check whether this paper is about 'Voice Conversion' or not.
article info.
title: LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidance
summary: Any-to-any singing voice conversion (SVC) is an interesting audio editing
technique, aiming to convert the singing voice of one singer into that of
another, given only a few seconds of singing data. However, during the
conversion process, the issue of timbre leakage is inevitable: the converted
singing voice still sounds like the original singer's voice. To tackle this, we
propose a latent diffusion model for SVC (LDM-SVC) in this work, which attempts
to perform SVC in the latent space using an LDM. We pretrain a variational
autoencoder structure using the noted open-source So-VITS-SVC project based on
the VITS framework, which is then used for the LDM training. Besides, we
propose a singer guidance training method based on classifier-free guidance to
further suppress the timbre of the original singer. Experimental results show
the superiority of the proposed method over previous works in both subjective
and objective evaluations of timbre similarity.
Please check whether this paper is about 'Voice Conversion' or not.
article info.
title: LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidance
summary: Any-to-any singing voice conversion (SVC) is an interesting audio editing technique, aiming to convert the singing voice of one singer into that of another, given only a few seconds of singing data. However, during the conversion process, the issue of timbre leakage is inevitable: the converted singing voice still sounds like the original singer's voice. To tackle this, we propose a latent diffusion model for SVC (LDM-SVC) in this work, which attempts to perform SVC in the latent space using an LDM. We pretrain a variational autoencoder structure using the noted open-source So-VITS-SVC project based on the VITS framework, which is then used for the LDM training. Besides, we propose a singer guidance training method based on classifier-free guidance to further suppress the timbre of the original singer. Experimental results show the superiority of the proposed method over previous works in both subjective and objective evaluations of timbre similarity.
id: http://arxiv.org/abs/2406.05325v1
judge
Write [vclab::confirmed] or [vclab::excluded] in comment.