search

EricGuo5513 / momask-codes

Official implementation of "MoMask: Generative Masked Modeling of 3D Human Motions (CVPR2024)"
https://ericguo5513.github.io/momask/
MIT License
690 stars 56 forks source link

Can not reproduce the results of the RVQ #43

Open buptxyb666 opened 1 month ago

buptxyb666 commented 1 month ago

Thanks for your great work.

As mentioned other issues, i also find the RVQ FID score(0.02 v.s. 0.06) can't be reproduced even following released opt.txt. I wonder if the results are related to the GPU platform or Pytorch version ?

Murrol commented 1 month ago

We found that it might relate to the version differences in packages when processing the dataset. We are working on it. Please directly email me for dataset inquiry.

wang-zm18 commented 1 week ago

Thanks for the work! I have tried to repoduce the results of VRQ in Table 2 of the released paper, too. The repoduced results are roughly the same except the FID metric in the Generartion setting on HumanMLD (0.232 vs 0.051). The code is python eval_t2m_trans_res.py --res_name tres_nlayer8_ld384_ff1024_rvq6ns_cdp0.2_sw --dataset_name t2m --name t2m_nlayer8_nhead6_ld384_ff1024_cdp0.1_rvq6ns --gpu_id 1 --cond_scale 4 --time_steps 10 --ext evaluation. I have not figured the problem out up to now. Thank you in advance!

HitBadTrap commented 1 week ago

Thanks for your great work.

As mentioned other issues, i also find the RVQ FID score(0.02 v.s. 0.06) can't be reproduced even following released opt.txt. I wonder if the results are related to the GPU platform or Pytorch version ?

Have you solved the problem now? @buptxyb666

Thanks.