maum-ai / phaseaug

ICASSP 2023 Accepted
https://maum-ai.github.io/phaseaug/
BSD 3-Clause "New" or "Revised" License
188 stars 14 forks source link

about periodicity artifacts #6

Closed hdmjdp closed 1 year ago

hdmjdp commented 1 year ago

what is periodicity artifacts? can you show me the mel-image?

junjun3518 commented 1 year ago

Hi @hdmjdp!

We get a concept from CARGAN. Periodity artifacts are kind of failed reconstruction of periodicity, so we can hear it by tik sound or brief silence.

Periodity artifacts are occured at very short moment, so hard to observe by mel spectrogram. I will give you a example with raw audio images.

This image is raw audio plot by audacity, and you will find weird signal between 2.44s~2.5s for HiFiGAN without PhaseAug.

스크린샷 2022-12-08 오후 5 29 51

It is a first sample of a demo page's HiFiGAN section, and you can hear more speechs. Our method could not remove all artifacts, but it reduce occurrence in evaluation.

Thank you for your interest! Best regards, Junhyeok Lee

hdmjdp commented 1 year ago

thanks!