search

zju3dv / clean-pvnet

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral
Apache License 2.0
401 stars 106 forks source link

vsd metric reports as zero for tless evaluation despite setting test.vsd to True #284

Closed monajalal closed 11 months ago

monajalal commented 11 months ago

Could you please suggest a fix?

(clean-pvnet) mona@ada:~/clean-pvnet$ python run.py --type evaluate --cfg_file configs/tless/tless_01.yaml test.vsd True
/home/mona/anaconda3/envs/clean-pvnet/lib/python3.10/site-packages/imgaug/imgaug.py:184: DeprecationWarning: Function `ContrastNormalization()` is deprecated. Use `imgaug.contrast.LinearContrast` instead.
  warn_deprecated(msg, stacklevel=3)
loading annotations into memory...
Done (t=3.80s)
creating index...
index created!
loading annotations into memory...
Done (t=4.34s)
creating index...
index created!
yaml file path is:  data/tless/models_cad/models_info.yml
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2927/2927 [03:20<00:00, 14.57it/s]
0it [00:00, ?it/s]/home/mona/.local/lib/python3.10/site-packages/imageio/plugins/pillow.py:312: UserWarning: Loading 16-bit (uint16) PNG as int32 due to limitations in pillow's PNG decoder. This will be fixed in a future version of pillow which will make this warning dissapear.
  warnings.warn(
2927it [05:53,  8.28it/s]
vsd metric: 0.0
adi metric: 0.0009953550099535502
5 cm 5 degree metric: 0.0
monajalal commented 11 months ago

Fixed

Please check this issue for context https://github.com/zju3dv/clean-pvnet/issues/283

Thanks a lot @ZYLer0510

type(cur_mask):  <class 'torch.Tensor'>
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 2925/2927 [05:28<00:00,  8.59it/s]type(cur_mask):  <class 'torch.Tensor'>
type(cur_mask):  <class 'torch.Tensor'>
type(cur_mask):  <class 'torch.Tensor'>
type(cur_mask):  <class 'torch.Tensor'>
type(cur_mask):  <class 'torch.Tensor'>
type(cur_mask):  <class 'torch.Tensor'>
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2927/2927 [05:28<00:00,  8.90it/s]
0it [00:00, ?it/s]/home/mona/.local/lib/python3.10/site-packages/imageio/plugins/pillow.py:312: UserWarning: Loading 16-bit (uint16) PNG as int32 due to limitations in pillow's PNG decoder. This will be fixed in a future version of pillow which will make this warning dissapear.
  warnings.warn(
2927it [06:13,  7.84it/s]
vsd metric: 0.17186463171864633
adi metric: 0.21035169210351692
5 cm 5 degree metric: 0.19376244193762443