alibaba / AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
Apache License 2.0
1.98k stars 291 forks source link

Grounding checkpoint evaluation results #82

Open seventy7796 opened 1 year ago

seventy7796 commented 1 year ago

The checkpoint file is "output/vg_large_uni/checkpoint_best.pth" in grounding_mplug_large.sh. Is it same with "mplug_large_v2.pth"? I evaluate refcoco and the accuracy is only 0.02. Could you provide the grounding model? Thanks in advance.

# eval refcoco CUDA_VISIBLE_DEVICES=0 python -m torch.distributed.launch --nproc_per_node=1 --master_port=3222 --use_env grounding_mplug.py \ --config configs/grounding_mplug_large.yaml \ --dataset vg_unc \ --output_dir ./output/vg_large_unc \ --eval_checkpoint mplug_large_v2.pth \ --do_two_optim --evaluate

{'test_model:': 'mplug_large.pth', 'testA_set_accuracy': 0.020682340463143007}