search

jkli1998 / DRM

Code for paper 'Leveraging Predicate and Triplet Learning for Scene Graph Generation'. (CVPR 2024)
MIT License
24 stars 0 forks source link

About model evaluation #4

Open QiueY514 opened 2 months ago

QiueY514 commented 2 months ago

Hi, thanks for your great work! Now I'm trying to evaluate model on VG dataset but meet some problems.

  1. Only one file named vg_stage1_predcls.zip in the provided link in Evaluation. There is no predcls file for stage2.
  2. How to evaluate model on stage2? The command in Evaluation seems only for evaluating on stage1.
QiueY514 commented 2 months ago

Another problems, the file zeroshot_triplet_new.pytorch provided in your repo T-CAR is the same as the file zeroshot_triplet_0_new_order.pytorch required in this repo? Thanks!

jkli1998 commented 1 month ago

Hi, thanks for your great work! Now I'm trying to evaluate model on VG dataset but meet some problems.

  1. Only one file named vg_stage1_predcls.zip in the provided link in Evaluation. There is no predcls file for stage2.
  2. How to evaluate model on stage2? The command in Evaluation seems only for evaluating on stage1.

The original checkpoints of the second stage were lost due to the corrupte of our server hard disk. We have reproduced our results and the checkpoint has been uploaded to the link. The reproduced performance are 47.76 R@100, 49.17 mR@100 in predcls.

jkli1998 commented 1 month ago

As for evaluating the second stage, you should change the MODEL.STAGE to stage2 and the OUTPUT_DIR to ./experiments/vg_stage2_predcls.