X-niper / UniTalker

Apache License 2.0
91 stars 7 forks source link

VOCA evaluation #19

Open hdjang opened 3 days ago

hdjang commented 3 days ago

Hi

I evaluated provided pretrained model (UniTalker-B-[D0-D7]) on VOCA test set, and got LVE as below. But its number is higher than one from paper. What should I do to get correct evaluation number? FYI, I tested both test data identity and random id(934) for evalution, but they showed the same evaluation numbers as below.

paper: 8.14E-06 my test: 1.06E-05

X-niper commented 3 days ago

Hi, do use use the correct identity in evaluation?