amazon-science / polygon-transformer

Apache License 2.0
131 stars 9 forks source link

pretrain weights polyformer_b shows bad metrics #10

Closed IL98 closed 1 year ago

IL98 commented 1 year ago

Hello! I've downloaded pretrain weights from link at Readme.md. Then I've run script evaluate_polyformer_b_refcoco.sh on refcoco_testA using these weights, and recieve the results with zero metrics. I've tried to tune this checkpoint weights, and after the evaluation I've recieved much better metrics. Seems like weights from link are random weights :( Could you send the link to the pretrained weigths please? Maybe I didn't find right weights(

joellliu commented 1 year ago

Hi, the pretrain weights are the checkpoint after the first stage fine-tuning on the referring expression comprehension task. You should use the checkpoint listed in the tables which are fine-tuned on both referring expression comprehension and referring image segmentation.