search

jiasenlu / vilbert_beta

473 stars 96 forks source link

Referring Expression Evaluation #9

Closed arjunakula closed 5 years ago

arjunakula commented 5 years ago

Trying to evaluate referring expressions shows the following error: lmdb.Error: data/referExpression/refcoco+_resnet101_faster_rcnn_genome.lmdb: No such file or directory

Could you let me know how to get the file refcoco+_resnet101_faster_rcnn_genome.lmdb. thanks!

arjunakula commented 5 years ago

From Mattnet, I get the following two files:

  1. res101_coco_minus_refer_notime_det_feats.h5
  2. res101_coco_minus_refer_notime_ann_feats.h5

But not sure how to change them to the following: features_h5path1: data/referExpression/refcoco+_resnet101_faster_rcnn_genome.lmdb features_h5path2: data/referExpression/refcoco+_gt_resnet101_faster_rcnn_genome.lmdb

jiasenlu commented 5 years ago

you can download the feature directly from https://www.dropbox.com/home/vilbert_release/data/referExpression.

arjunakula commented 5 years ago

The above link might require permissions from you. (It doesn't open.)

Also, we would like to train the model on RefCOCOg. Would it be possible to get some pointers on how to use your code to train the model on RefCOCOg (for example, how to map/format the MattNet features to your features features_h5path1 and features_h5path2). This would be very helpful. (Did you also try RefCOCOg in addition to RefCOCO+). Thanks a lot!

lizhen2017 commented 4 years ago

you can download the feature directly from https://www.dropbox.com/home/vilbert_release/data/referExpression.

Sorry, this url is invalid, would you please share again?