search

Voice-Privacy-Challenge / Voice-Privacy-Challenge-2022

Baseline Recipe for VoicePrivacy Challenge 2022: anonymization systems and evaluation software
62 stars 15 forks source link

Space Requirement for Running Primary Baseline and Evaluation for Proposed Methods #23

Open candyolivia opened 2 years ago

candyolivia commented 2 years ago

Excuse me if I am asking in the wrong place. I got similar problems with https://github.com/Voice-Privacy-Challenge/Voice-Privacy-Challenge-2022/issues/16. I really would like to know the estimation of time and space for running the primary baseline script. The baseline system has been running on my local PC for days, but I still found several errors; some are related to out of memory issues. Time spent to reach each error is also quite a lot, and sometimes I did not know that it was due to my mistakes (e.g., installation errors) or insufficient resources. In my opinion, as baseline systems, they should be easy to reproduce, so I am not sure if this is a normal thing to require this much resource for running the baseline systems.

Another question: if we proposed another anonymization system and obtained the output of anonymized wav files, is there any way for us to run only the evaluation parts? I found that it has partially been discussed in https://github.com/Voice-Privacy-Challenge/Voice-Privacy-Challenge-2022/issues/18, but I still do not understand it clearly. Without running the baselines, is it possible to obtain the evaluation results of our proposed methods?

Thank you.

kgalajit commented 2 years ago

Hi

I also face the same problem, I run the baseline on my personal computer, it took many days to pass each step. Some steps that I run out of space (my PC is 1 T HDD) so that I remove almost all of my data to external HDD and continue trying. My last attempt is I run B1 until stage 14 and again it runout of space. Due to space limitation i am not sure how much B2 and B3 use? FYI i spent almost 9 days to reach stage 14.

Can any one give me the requirement that how many memory or space required? for me only 1 baseline make 1T full and spent 9 days to reach stage 14 of B1

Thank you

minhduc0711 commented 2 years ago

I have run past stage 14 of B1.a (also took me almost a week) and now everything is taking ~1.2 TB, but I'm pretty sure I have seen it grew more to 1.5 TB while I was running the script (probably intermediate temp files).

Therefore I suggest you have 2 TB just to be safe.