Please check whether this paper is about 'Voice Conversion' or not.
article info.
title: Utilizing Speaker Profiles for Impersonation Audio Detection
summary: Fake audio detection is an emerging active topic. A growing number of
literatures have aimed to detect fake utterance, which are mostly generated by
Text-to-speech (TTS) or voice conversion (VC). However, countermeasures against
impersonation remain an underexplored area. Impersonation is a fake type that
involves an imitator replicating specific traits and speech style of a target
speaker. Unlike TTS and VC, which often leave digital traces or signal
artifacts, impersonation involves live human beings producing entirely natural
speech, rendering the detection of impersonation audio a challenging task.
Thus, we propose a novel method that integrates speaker profiles into the
process of impersonation audio detection. Speaker profiles are inherent
characteristics that are challenging for impersonators to mimic accurately,
such as speaker's age, job. We aim to leverage these features to extract
discriminative information for detecting impersonation audio. Moreover, there
is no large impersonated speech corpora available for quantitative study of
impersonation impacts. To address this gap, we further design the first
large-scale, diverse-speaker Chinese impersonation dataset, named ImPersonation
Audio Detection (IPAD), to advance the community's research on impersonation
audio detection. We evaluate several existing fake audio detection methods on
our proposed dataset IPAD, demonstrating its necessity and the challenges.
Additionally, our findings reveal that incorporating speaker profiles can
significantly enhance the model's performance in detecting impersonation audio.
Please check whether this paper is about 'Voice Conversion' or not.
article info.
title: Utilizing Speaker Profiles for Impersonation Audio Detection
summary: Fake audio detection is an emerging active topic. A growing number of literatures have aimed to detect fake utterance, which are mostly generated by Text-to-speech (TTS) or voice conversion (VC). However, countermeasures against impersonation remain an underexplored area. Impersonation is a fake type that involves an imitator replicating specific traits and speech style of a target speaker. Unlike TTS and VC, which often leave digital traces or signal artifacts, impersonation involves live human beings producing entirely natural speech, rendering the detection of impersonation audio a challenging task. Thus, we propose a novel method that integrates speaker profiles into the process of impersonation audio detection. Speaker profiles are inherent characteristics that are challenging for impersonators to mimic accurately, such as speaker's age, job. We aim to leverage these features to extract discriminative information for detecting impersonation audio. Moreover, there is no large impersonated speech corpora available for quantitative study of impersonation impacts. To address this gap, we further design the first large-scale, diverse-speaker Chinese impersonation dataset, named ImPersonation Audio Detection (IPAD), to advance the community's research on impersonation audio detection. We evaluate several existing fake audio detection methods on our proposed dataset IPAD, demonstrating its necessity and the challenges. Additionally, our findings reveal that incorporating speaker profiles can significantly enhance the model's performance in detecting impersonation audio.
id: http://arxiv.org/abs/2408.17009v1
judge
Write [vclab::confirmed] or [vclab::excluded] in comment.