search

andrewowens / multisensory

Code for the paper: Audio-Visual Scene Analysis with Self-Supervised Multisensory Features
http://andrewowens.com/multisensory/
Apache License 2.0
220 stars 60 forks source link

Questions about sourcesep.py #39

Open ruizewang opened 4 years ago

ruizewang commented 4 years ago

Hello Andrew, thanks for your great work again. I have some questions about the training of the source separation model. (1) I'm not sure what the meaning of these losses, could you please explain it for me? Iteration 13140, lr = 1e-04, total:gen: 0.169 gen:reg: 0.002 diff-fg: 0.080 phase-fg: 0.004 diff-bg: 0.080 phase-bg: 0.004 total:discrim: 0.000 discrim:reg: 0.000, time: 1.241

(2) I notice there is a code: "import sep_eval". But I could not find 'sep_eval.py'. Could you share this part of the code? I guess this might be used for evaluation and testing.

Thanks a lot 😁~

hmy410 commented 4 years ago

Hello, did you solve your 2rd problem? I don't know how to eval and test, either.

ruizewang commented 4 years ago

Hello, did you solve your 2rd problem? I don't know how to eval and test, either.

No, o(╥﹏╥)o. Looking for someone could give us some advice.