search

YvanYin / Metric3D

The repo for "Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image" and "Metric3Dv2: A Versatile Monocular Geometric Foundation Model..."
https://jugghm.github.io/Metric3Dv2/
BSD 2-Clause "Simplified" License
1.41k stars 106 forks source link

What does the pkl file contain in training with Matterport3D? #96

Open Ulricall opened 5 months ago

Ulricall commented 5 months ago

I'm trying to train my own network following the tutorial in /training. The dataset is Matterport3D. I noticed an example json file about this dataset that includes "{"meta_data": "Matterport3D/data/SN83YJsR3w2/SN83YJsR3w2/meta/4a87c9150e8442a1b8abc51ed5073ca0_i1_4.pkl"}". I downloaded the dataset but did not find a pkl file, only many zip files.

ZachL1 commented 5 months ago

We provide an example of a json file here: https://github.com/YvanYin/Metric3D/blob/main/training/data_server_info/annos_test_normal_nyu_example.json. But for some larger datasets, like Matterport3D, we store the metadata for each sample as a .pkl, which includes something like this:

{
  "rgb": "NYU/nyu_normal/official/test/0000.png",
  "depth": "NYU/nyu_normal/official/test/0000_d.png",
  "cam_in": [518.8579, 519.4691, 325.58245, 253.73617],
  "normal": "NYU/nyu_normal/official/test/0000_n.png"
}