search

YvanYin / Metric3D

The repo for "Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image" and "Metric3Dv2: A Versatile Monocular Geometric Foundation Model..."
https://jugghm.github.io/Metric3Dv2/
BSD 2-Clause "Simplified" License
1.41k stars 106 forks source link

eval on NYU dataset #154

Open shawnricecake opened 2 months ago

shawnricecake commented 2 months ago

why the json files are need for the evaluation on NYU dataset?

The dataset does not include any json files

YvanYin commented 2 months ago

We create JSON files for dataset construction, which aims to merge different datasets in the same format.

shawnricecake commented 2 months ago

We create JSON files for dataset construction, which aims to merge different datasets in the same format.

Hi, I can not reproduce the performance on NYUv2 dataset, the best result is 'median match', while the 'abs_rel' is 0.087175 and 'delta_1' is 0.91799

I used the test_nyu.sh with vit giant2

shawnricecake commented 1 month ago

can you provide detailed json generation file?

the current one can not fit to the NYUv2 or Kitti dataset (can not put all rgb files into one 'rgb' folder)

shawnricecake commented 1 month ago

Hi, is any other eval dataset supported? like DIODE, Eth3d?