search

castorini / howl

Wake word detection modeling toolkit for Firefox Voice, supporting open datasets like Speech Commands and Common Voice.
Mozilla Public License 2.0
201 stars 30 forks source link

zero result on hey_firefox training? #102

Open dragen1860 opened 3 years ago

dragen1860 commented 3 years ago

Dear author: I succeed to start to training on hey firefox dataset. But i noticed the evaluation resulit is all zero? any one give some tips? thank you very much!

Training: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1664/1664 [00:23<00:00, 69.67it/s, loss=0.00108]
Dev positive: 0it [00:00, ?it/s]███████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1663/1664 [00:23<00:00, 95.07it/s, loss=0.00108]
2021-11-29 18:36:12,894 INFO evaluate_engine(77) **ConfusionMatrix(tp=0, fp=0, tn=0, fn=0)**
Training: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1664/1664 [00:22<00:00, 72.56it/s, loss=0.00111]
Dev positive: 0it [00:00, ?it/s]██████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1663/1664 [00:22<00:00, 119.07it/s, loss=0.00111]
2021-11-29 18:36:35,836 INFO evaluate_engine(77) **ConfusionMatrix(tp=0, fp=0, tn=0, fn=0)**
ljj7975 commented 2 years ago

can you confirm that the data samples are loaded correctly?

Xzryeah commented 1 year ago

@Hi,I meet a similiar problem.Do you solve this problem? @dragen1860