Hi,
We used the point_encoder_pointbert_wcolor.pth and gpt4point_pretrain_stage2_opt2.7b.pth files provided on Huggingface to evaluate, but we could not reproduce the accuracy reported in your paper. Here are the accuracy metrics we obtained:
Could you please explain why this discrepancy occurs? Additionally, will you be uploading other evaluation tasks including zero-shot learning and robot dialogue on GitHub?
Hi, We used the point_encoder_pointbert_wcolor.pth and gpt4point_pretrain_stage2_opt2.7b.pth files provided on Huggingface to evaluate, but we could not reproduce the accuracy reported in your paper. Here are the accuracy metrics we obtained:
And the accuracy metrics after local training and evaluation are:
Could you please explain why this discrepancy occurs? Additionally, will you be uploading other evaluation tasks including zero-shot learning and robot dialogue on GitHub?
Thanks!!