search

facebookresearch / Detectron

FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
Apache License 2.0
26.27k stars 5.45k forks source link

test_size_exceptions when running test in INSTALL.md #86

Open dailycafi opened 6 years ago

dailycafi commented 6 years ago

System information

I installed caffe2 & detectron with no error info, and ran caffe2 test successfully, however, when I ran Detectron's test in Install.md,

python2 $DETECTRON/tests/test_spatial_narrow_as_op.py, it prints:

E0131 03:03:33.275071 20995 init_intrinsics_check.cc:54] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0131 03:03:33.275094 20995 init_intrinsics_check.cc:54] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0131 03:03:33.275097 20995 init_intrinsics_check.cc:54] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU.

.E.

ERROR: test_size_exceptions (main.SpatialNarrowAsOpTest)

Traceback (most recent call last): File "/home/mm/Library/detectron/tests/test_spatial_narrow_as_op.py", line 78, in test_size_exceptions self._run_test(A, B) File "/home/mm/Library/detectron/tests/test_spatial_narrow_as_op.py", line 39, in _run_test workspace.RunOperatorOnce(op) File "/home/mm/Library/caffe2/build/caffe2/python/workspace.py", line 176, in RunOperatorOnce return C.run_operator_once(StringifyProto(operator)) SystemError: error return without exception set

Ran 3 tests in 1.497s

Is this the problem of CUDA 9? or something else? what should I do to fix this, thank you.

ir413 commented 6 years ago

Hi @feistar, we haven't been able to reproduce this issue (tried using CUDA 9 and cuDNN 7 too). What happens when you run one of the other tests? (e.g. tests/test_batch_permutation_op.py) Have you been able to run the infer_simple.py demo from the getting started page?

rbgirshick commented 6 years ago

@feistar: can you try removing the with self.assertRaises(RuntimeError): from line 77 so it will just run self._run_test(A, B)? It should raise an exception, in which case can you post what that exception is?

Related shot in the dark: see if you can upgrade the unittest Python package.

dailycafi commented 6 years ago

@ir413 Thank you very much, this one seems working correctly, with no error message:

E0202 01:33:31.632019 30187 init_intrinsics_check.cc:54] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 01:33:31.632040 30187 init_intrinsics_check.cc:54] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 01:33:31.632055 30187 init_intrinsics_check.cc:54] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. WARNING cnn.py: 40: [====DEPRECATE WARNING====]: you are creating an object from CNNModelHelper class which will be deprecated soon. Please use ModelHelper object with brew module. For more information, please refer to caffe2.ai and python/brew.py, python/brew_test.py for more information. INFO net.py: 54: Loading from: /tmp/detectron-download-cache/35861858/12_2017_baselines/e2e_mask_rcnn_R-101-FPN_2x.yaml.02_32_51.SgT4y1cO/output/train/coco_2014_train:coco_2014_valminusminival/generalized_rcnn/model_final.pkl INFO net.py: 91: conv1_w loaded from weights file into gpu_0/conv1_w: (64, 3, 7, 7) INFO net.py: 91: res_conv1_bn_s loaded from weights file into gpu_0/res_conv1_bn_s: (64,) INFO net.py: 91: res_conv1_bn_b loaded from weights file into gpu_0/res_conv1_bn_b: (64,) INFO net.py: 91: res2_0_branch2a_w loaded from weights file into gpu_0/res2_0_branch2a_w: (64, 64, 1, 1) INFO net.py: 91: res2_0_branch2a_bn_s loaded from weights file into gpu_0/res2_0_branch2a_bn_s: (64,) INFO net.py: 91: res2_0_branch2a_bn_b loaded from weights file into gpu_0/res2_0_branch2a_bn_b: (64,) INFO net.py: 91: res2_0_branch2b_w loaded from weights file into gpu_0/res2_0_branch2b_w: (64, 64, 3, 3) INFO net.py: 91: res2_0_branch2b_bn_s loaded from weights file into gpu_0/res2_0_branch2b_bn_s: (64,) INFO net.py: 91: res2_0_branch2b_bn_b loaded from weights file into gpu_0/res2_0_branch2b_bn_b: (64,) INFO net.py: 91: res2_0_branch2c_w loaded from weights file into gpu_0/res2_0_branch2c_w: (256, 64, 1, 1) INFO net.py: 91: res2_0_branch2c_bn_s loaded from weights file into gpu_0/res2_0_branch2c_bn_s: (256,) INFO net.py: 91: res2_0_branch2c_bn_b loaded from weights file into gpu_0/res2_0_branch2c_bn_b: (256,) INFO net.py: 91: res2_0_branch1_w loaded from weights file into gpu_0/res2_0_branch1_w: (256, 64, 1, 1) INFO net.py: 91: res2_0_branch1_bn_s loaded from weights file into gpu_0/res2_0_branch1_bn_s: (256,) INFO net.py: 91: res2_0_branch1_bn_b loaded from weights file into gpu_0/res2_0_branch1_bn_b: (256,) INFO net.py: 91: res2_1_branch2a_w loaded from weights file into gpu_0/res2_1_branch2a_w: (64, 256, 1, 1) INFO net.py: 91: res2_1_branch2a_bn_s loaded from weights file into gpu_0/res2_1_branch2a_bn_s: (64,) INFO net.py: 91: res2_1_branch2a_bn_b loaded from weights file into gpu_0/res2_1_branch2a_bn_b: (64,) INFO net.py: 91: res2_1_branch2b_w loaded from weights file into gpu_0/res2_1_branch2b_w: (64, 64, 3, 3) INFO net.py: 91: res2_1_branch2b_bn_s loaded from weights file into gpu_0/res2_1_branch2b_bn_s: (64,) INFO net.py: 91: res2_1_branch2b_bn_b loaded from weights file into gpu_0/res2_1_branch2b_bn_b: (64,) INFO net.py: 91: res2_1_branch2c_w loaded from weights file into gpu_0/res2_1_branch2c_w: (256, 64, 1, 1) INFO net.py: 91: res2_1_branch2c_bn_s loaded from weights file into gpu_0/res2_1_branch2c_bn_s: (256,) INFO net.py: 91: res2_1_branch2c_bn_b loaded from weights file into gpu_0/res2_1_branch2c_bn_b: (256,) INFO net.py: 91: res2_2_branch2a_w loaded from weights file into gpu_0/res2_2_branch2a_w: (64, 256, 1, 1) INFO net.py: 91: res2_2_branch2a_bn_s loaded from weights file into gpu_0/res2_2_branch2a_bn_s: (64,) INFO net.py: 91: res2_2_branch2a_bn_b loaded from weights file into gpu_0/res2_2_branch2a_bn_b: (64,) INFO net.py: 91: res2_2_branch2b_w loaded from weights file into gpu_0/res2_2_branch2b_w: (64, 64, 3, 3) INFO net.py: 91: res2_2_branch2b_bn_s loaded from weights file into gpu_0/res2_2_branch2b_bn_s: (64,) INFO net.py: 91: res2_2_branch2b_bn_b loaded from weights file into gpu_0/res2_2_branch2b_bn_b: (64,) INFO net.py: 91: res2_2_branch2c_w loaded from weights file into gpu_0/res2_2_branch2c_w: (256, 64, 1, 1) INFO net.py: 91: res2_2_branch2c_bn_s loaded from weights file into gpu_0/res2_2_branch2c_bn_s: (256,) INFO net.py: 91: res2_2_branch2c_bn_b loaded from weights file into gpu_0/res2_2_branch2c_bn_b: (256,) INFO net.py: 91: res3_0_branch2a_w [+ momentum] loaded from weights file into gpu_0/res3_0_branch2a_w: (128, 256, 1, 1) INFO net.py: 91: res3_0_branch2a_bn_s loaded from weights file into gpu_0/res3_0_branch2a_bn_s: (128,) INFO net.py: 91: res3_0_branch2a_bn_b loaded from weights file into gpu_0/res3_0_branch2a_bn_b: (128,) INFO net.py: 91: res3_0_branch2b_w [+ momentum] loaded from weights file into gpu_0/res3_0_branch2b_w: (128, 128, 3, 3) INFO net.py: 91: res3_0_branch2b_bn_s loaded from weights file into gpu_0/res3_0_branch2b_bn_s: (128,) INFO net.py: 91: res3_0_branch2b_bn_b loaded from weights file into gpu_0/res3_0_branch2b_bn_b: (128,) INFO net.py: 91: res3_0_branch2c_w [+ momentum] loaded from weights file into gpu_0/res3_0_branch2c_w: (512, 128, 1, 1) INFO net.py: 91: res3_0_branch2c_bn_s loaded from weights file into gpu_0/res3_0_branch2c_bn_s: (512,) INFO net.py: 91: res3_0_branch2c_bn_b loaded from weights file into gpu_0/res3_0_branch2c_bn_b: (512,) INFO net.py: 91: res3_0_branch1_w [+ momentum] loaded from weights file into gpu_0/res3_0_branch1_w: (512, 256, 1, 1) INFO net.py: 91: res3_0_branch1_bn_s loaded from weights file into gpu_0/res3_0_branch1_bn_s: (512,) INFO net.py: 91: res3_0_branch1_bn_b loaded from weights file into gpu_0/res3_0_branch1_bn_b: (512,) INFO net.py: 91: res3_1_branch2a_w [+ momentum] loaded from weights file into gpu_0/res3_1_branch2a_w: (128, 512, 1, 1) INFO net.py: 91: res3_1_branch2a_bn_s loaded from weights file into gpu_0/res3_1_branch2a_bn_s: (128,) INFO net.py: 91: res3_1_branch2a_bn_b loaded from weights file into gpu_0/res3_1_branch2a_bn_b: (128,) INFO net.py: 91: res3_1_branch2b_w [+ momentum] loaded from weights file into gpu_0/res3_1_branch2b_w: (128, 128, 3, 3) INFO net.py: 91: res3_1_branch2b_bn_s loaded from weights file into gpu_0/res3_1_branch2b_bn_s: (128,) INFO net.py: 91: res3_1_branch2b_bn_b loaded from weights file into gpu_0/res3_1_branch2b_bn_b: (128,) INFO net.py: 91: res3_1_branch2c_w [+ momentum] loaded from weights file into gpu_0/res3_1_branch2c_w: (512, 128, 1, 1) INFO net.py: 91: res3_1_branch2c_bn_s loaded from weights file into gpu_0/res3_1_branch2c_bn_s: (512,) INFO net.py: 91: res3_1_branch2c_bn_b loaded from weights file into gpu_0/res3_1_branch2c_bn_b: (512,) INFO net.py: 91: res3_2_branch2a_w [+ momentum] loaded from weights file into gpu_0/res3_2_branch2a_w: (128, 512, 1, 1) INFO net.py: 91: res3_2_branch2a_bn_s loaded from weights file into gpu_0/res3_2_branch2a_bn_s: (128,) INFO net.py: 91: res3_2_branch2a_bn_b loaded from weights file into gpu_0/res3_2_branch2a_bn_b: (128,) INFO net.py: 91: res3_2_branch2b_w [+ momentum] loaded from weights file into gpu_0/res3_2_branch2b_w: (128, 128, 3, 3) INFO net.py: 91: res3_2_branch2b_bn_s loaded from weights file into gpu_0/res3_2_branch2b_bn_s: (128,) INFO net.py: 91: res3_2_branch2b_bn_b loaded from weights file into gpu_0/res3_2_branch2b_bn_b: (128,) INFO net.py: 91: res3_2_branch2c_w [+ momentum] loaded from weights file into gpu_0/res3_2_branch2c_w: (512, 128, 1, 1) INFO net.py: 91: res3_2_branch2c_bn_s loaded from weights file into gpu_0/res3_2_branch2c_bn_s: (512,) INFO net.py: 91: res3_2_branch2c_bn_b loaded from weights file into gpu_0/res3_2_branch2c_bn_b: (512,) INFO net.py: 91: res3_3_branch2a_w [+ momentum] loaded from weights file into gpu_0/res3_3_branch2a_w: (128, 512, 1, 1) INFO net.py: 91: res3_3_branch2a_bn_s loaded from weights file into gpu_0/res3_3_branch2a_bn_s: (128,) INFO net.py: 91: res3_3_branch2a_bn_b loaded from weights file into gpu_0/res3_3_branch2a_bn_b: (128,) INFO net.py: 91: res3_3_branch2b_w [+ momentum] loaded from weights file into gpu_0/res3_3_branch2b_w: (128, 128, 3, 3) INFO net.py: 91: res3_3_branch2b_bn_s loaded from weights file into gpu_0/res3_3_branch2b_bn_s: (128,) INFO net.py: 91: res3_3_branch2b_bn_b loaded from weights file into gpu_0/res3_3_branch2b_bn_b: (128,) INFO net.py: 91: res3_3_branch2c_w [+ momentum] loaded from weights file into gpu_0/res3_3_branch2c_w: (512, 128, 1, 1) INFO net.py: 91: res3_3_branch2c_bn_s loaded from weights file into gpu_0/res3_3_branch2c_bn_s: (512,) INFO net.py: 91: res3_3_branch2c_bn_b loaded from weights file into gpu_0/res3_3_branch2c_bn_b: (512,) INFO net.py: 91: res4_0_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_0_branch2a_w: (256, 512, 1, 1) INFO net.py: 91: res4_0_branch2a_bn_s loaded from weights file into gpu_0/res4_0_branch2a_bn_s: (256,) INFO net.py: 91: res4_0_branch2a_bn_b loaded from weights file into gpu_0/res4_0_branch2a_bn_b: (256,) INFO net.py: 91: res4_0_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_0_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_0_branch2b_bn_s loaded from weights file into gpu_0/res4_0_branch2b_bn_s: (256,) INFO net.py: 91: res4_0_branch2b_bn_b loaded from weights file into gpu_0/res4_0_branch2b_bn_b: (256,) INFO net.py: 91: res4_0_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_0_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_0_branch2c_bn_s loaded from weights file into gpu_0/res4_0_branch2c_bn_s: (1024,) INFO net.py: 91: res4_0_branch2c_bn_b loaded from weights file into gpu_0/res4_0_branch2c_bn_b: (1024,) INFO net.py: 91: res4_0_branch1_w [+ momentum] loaded from weights file into gpu_0/res4_0_branch1_w: (1024, 512, 1, 1) INFO net.py: 91: res4_0_branch1_bn_s loaded from weights file into gpu_0/res4_0_branch1_bn_s: (1024,) INFO net.py: 91: res4_0_branch1_bn_b loaded from weights file into gpu_0/res4_0_branch1_bn_b: (1024,) INFO net.py: 91: res4_1_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_1_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_1_branch2a_bn_s loaded from weights file into gpu_0/res4_1_branch2a_bn_s: (256,) INFO net.py: 91: res4_1_branch2a_bn_b loaded from weights file into gpu_0/res4_1_branch2a_bn_b: (256,) INFO net.py: 91: res4_1_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_1_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_1_branch2b_bn_s loaded from weights file into gpu_0/res4_1_branch2b_bn_s: (256,) INFO net.py: 91: res4_1_branch2b_bn_b loaded from weights file into gpu_0/res4_1_branch2b_bn_b: (256,) INFO net.py: 91: res4_1_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_1_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_1_branch2c_bn_s loaded from weights file into gpu_0/res4_1_branch2c_bn_s: (1024,) INFO net.py: 91: res4_1_branch2c_bn_b loaded from weights file into gpu_0/res4_1_branch2c_bn_b: (1024,) INFO net.py: 91: res4_2_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_2_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_2_branch2a_bn_s loaded from weights file into gpu_0/res4_2_branch2a_bn_s: (256,) INFO net.py: 91: res4_2_branch2a_bn_b loaded from weights file into gpu_0/res4_2_branch2a_bn_b: (256,) INFO net.py: 91: res4_2_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_2_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_2_branch2b_bn_s loaded from weights file into gpu_0/res4_2_branch2b_bn_s: (256,) INFO net.py: 91: res4_2_branch2b_bn_b loaded from weights file into gpu_0/res4_2_branch2b_bn_b: (256,) INFO net.py: 91: res4_2_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_2_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_2_branch2c_bn_s loaded from weights file into gpu_0/res4_2_branch2c_bn_s: (1024,) INFO net.py: 91: res4_2_branch2c_bn_b loaded from weights file into gpu_0/res4_2_branch2c_bn_b: (1024,) INFO net.py: 91: res4_3_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_3_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_3_branch2a_bn_s loaded from weights file into gpu_0/res4_3_branch2a_bn_s: (256,) INFO net.py: 91: res4_3_branch2a_bn_b loaded from weights file into gpu_0/res4_3_branch2a_bn_b: (256,) INFO net.py: 91: res4_3_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_3_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_3_branch2b_bn_s loaded from weights file into gpu_0/res4_3_branch2b_bn_s: (256,) INFO net.py: 91: res4_3_branch2b_bn_b loaded from weights file into gpu_0/res4_3_branch2b_bn_b: (256,) INFO net.py: 91: res4_3_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_3_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_3_branch2c_bn_s loaded from weights file into gpu_0/res4_3_branch2c_bn_s: (1024,) INFO net.py: 91: res4_3_branch2c_bn_b loaded from weights file into gpu_0/res4_3_branch2c_bn_b: (1024,) INFO net.py: 91: res4_4_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_4_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_4_branch2a_bn_s loaded from weights file into gpu_0/res4_4_branch2a_bn_s: (256,) INFO net.py: 91: res4_4_branch2a_bn_b loaded from weights file into gpu_0/res4_4_branch2a_bn_b: (256,) INFO net.py: 91: res4_4_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_4_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_4_branch2b_bn_s loaded from weights file into gpu_0/res4_4_branch2b_bn_s: (256,) INFO net.py: 91: res4_4_branch2b_bn_b loaded from weights file into gpu_0/res4_4_branch2b_bn_b: (256,) INFO net.py: 91: res4_4_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_4_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_4_branch2c_bn_s loaded from weights file into gpu_0/res4_4_branch2c_bn_s: (1024,) INFO net.py: 91: res4_4_branch2c_bn_b loaded from weights file into gpu_0/res4_4_branch2c_bn_b: (1024,) INFO net.py: 91: res4_5_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_5_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_5_branch2a_bn_s loaded from weights file into gpu_0/res4_5_branch2a_bn_s: (256,) INFO net.py: 91: res4_5_branch2a_bn_b loaded from weights file into gpu_0/res4_5_branch2a_bn_b: (256,) INFO net.py: 91: res4_5_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_5_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_5_branch2b_bn_s loaded from weights file into gpu_0/res4_5_branch2b_bn_s: (256,) INFO net.py: 91: res4_5_branch2b_bn_b loaded from weights file into gpu_0/res4_5_branch2b_bn_b: (256,) INFO net.py: 91: res4_5_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_5_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_5_branch2c_bn_s loaded from weights file into gpu_0/res4_5_branch2c_bn_s: (1024,) INFO net.py: 91: res4_5_branch2c_bn_b loaded from weights file into gpu_0/res4_5_branch2c_bn_b: (1024,) INFO net.py: 91: res4_6_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_6_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_6_branch2a_bn_s loaded from weights file into gpu_0/res4_6_branch2a_bn_s: (256,) INFO net.py: 91: res4_6_branch2a_bn_b loaded from weights file into gpu_0/res4_6_branch2a_bn_b: (256,) INFO net.py: 91: res4_6_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_6_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_6_branch2b_bn_s loaded from weights file into gpu_0/res4_6_branch2b_bn_s: (256,) INFO net.py: 91: res4_6_branch2b_bn_b loaded from weights file into gpu_0/res4_6_branch2b_bn_b: (256,) INFO net.py: 91: res4_6_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_6_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_6_branch2c_bn_s loaded from weights file into gpu_0/res4_6_branch2c_bn_s: (1024,) INFO net.py: 91: res4_6_branch2c_bn_b loaded from weights file into gpu_0/res4_6_branch2c_bn_b: (1024,) INFO net.py: 91: res4_7_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_7_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_7_branch2a_bn_s loaded from weights file into gpu_0/res4_7_branch2a_bn_s: (256,) INFO net.py: 91: res4_7_branch2a_bn_b loaded from weights file into gpu_0/res4_7_branch2a_bn_b: (256,) INFO net.py: 91: res4_7_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_7_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_7_branch2b_bn_s loaded from weights file into gpu_0/res4_7_branch2b_bn_s: (256,) INFO net.py: 91: res4_7_branch2b_bn_b loaded from weights file into gpu_0/res4_7_branch2b_bn_b: (256,) INFO net.py: 91: res4_7_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_7_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_7_branch2c_bn_s loaded from weights file into gpu_0/res4_7_branch2c_bn_s: (1024,) INFO net.py: 91: res4_7_branch2c_bn_b loaded from weights file into gpu_0/res4_7_branch2c_bn_b: (1024,) INFO net.py: 91: res4_8_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_8_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_8_branch2a_bn_s loaded from weights file into gpu_0/res4_8_branch2a_bn_s: (256,) INFO net.py: 91: res4_8_branch2a_bn_b loaded from weights file into gpu_0/res4_8_branch2a_bn_b: (256,) INFO net.py: 91: res4_8_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_8_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_8_branch2b_bn_s loaded from weights file into gpu_0/res4_8_branch2b_bn_s: (256,) INFO net.py: 91: res4_8_branch2b_bn_b loaded from weights file into gpu_0/res4_8_branch2b_bn_b: (256,) INFO net.py: 91: res4_8_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_8_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_8_branch2c_bn_s loaded from weights file into gpu_0/res4_8_branch2c_bn_s: (1024,) INFO net.py: 91: res4_8_branch2c_bn_b loaded from weights file into gpu_0/res4_8_branch2c_bn_b: (1024,) INFO net.py: 91: res4_9_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_9_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_9_branch2a_bn_s loaded from weights file into gpu_0/res4_9_branch2a_bn_s: (256,) INFO net.py: 91: res4_9_branch2a_bn_b loaded from weights file into gpu_0/res4_9_branch2a_bn_b: (256,) INFO net.py: 91: res4_9_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_9_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_9_branch2b_bn_s loaded from weights file into gpu_0/res4_9_branch2b_bn_s: (256,) INFO net.py: 91: res4_9_branch2b_bn_b loaded from weights file into gpu_0/res4_9_branch2b_bn_b: (256,) INFO net.py: 91: res4_9_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_9_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_9_branch2c_bn_s loaded from weights file into gpu_0/res4_9_branch2c_bn_s: (1024,) INFO net.py: 91: res4_9_branch2c_bn_b loaded from weights file into gpu_0/res4_9_branch2c_bn_b: (1024,) INFO net.py: 91: res4_10_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_10_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_10_branch2a_bn_s loaded from weights file into gpu_0/res4_10_branch2a_bn_s: (256,) INFO net.py: 91: res4_10_branch2a_bn_b loaded from weights file into gpu_0/res4_10_branch2a_bn_b: (256,) INFO net.py: 91: res4_10_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_10_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_10_branch2b_bn_s loaded from weights file into gpu_0/res4_10_branch2b_bn_s: (256,) INFO net.py: 91: res4_10_branch2b_bn_b loaded from weights file into gpu_0/res4_10_branch2b_bn_b: (256,) INFO net.py: 91: res4_10_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_10_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_10_branch2c_bn_s loaded from weights file into gpu_0/res4_10_branch2c_bn_s: (1024,) INFO net.py: 91: res4_10_branch2c_bn_b loaded from weights file into gpu_0/res4_10_branch2c_bn_b: (1024,) INFO net.py: 91: res4_11_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_11_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_11_branch2a_bn_s loaded from weights file into gpu_0/res4_11_branch2a_bn_s: (256,) INFO net.py: 91: res4_11_branch2a_bn_b loaded from weights file into gpu_0/res4_11_branch2a_bn_b: (256,) INFO net.py: 91: res4_11_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_11_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_11_branch2b_bn_s loaded from weights file into gpu_0/res4_11_branch2b_bn_s: (256,) INFO net.py: 91: res4_11_branch2b_bn_b loaded from weights file into gpu_0/res4_11_branch2b_bn_b: (256,) INFO net.py: 91: res4_11_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_11_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_11_branch2c_bn_s loaded from weights file into gpu_0/res4_11_branch2c_bn_s: (1024,) INFO net.py: 91: res4_11_branch2c_bn_b loaded from weights file into gpu_0/res4_11_branch2c_bn_b: (1024,) INFO net.py: 91: res4_12_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_12_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_12_branch2a_bn_s loaded from weights file into gpu_0/res4_12_branch2a_bn_s: (256,) INFO net.py: 91: res4_12_branch2a_bn_b loaded from weights file into gpu_0/res4_12_branch2a_bn_b: (256,) INFO net.py: 91: res4_12_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_12_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_12_branch2b_bn_s loaded from weights file into gpu_0/res4_12_branch2b_bn_s: (256,) INFO net.py: 91: res4_12_branch2b_bn_b loaded from weights file into gpu_0/res4_12_branch2b_bn_b: (256,) INFO net.py: 91: res4_12_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_12_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_12_branch2c_bn_s loaded from weights file into gpu_0/res4_12_branch2c_bn_s: (1024,) INFO net.py: 91: res4_12_branch2c_bn_b loaded from weights file into gpu_0/res4_12_branch2c_bn_b: (1024,) INFO net.py: 91: res4_13_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_13_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_13_branch2a_bn_s loaded from weights file into gpu_0/res4_13_branch2a_bn_s: (256,) INFO net.py: 91: res4_13_branch2a_bn_b loaded from weights file into gpu_0/res4_13_branch2a_bn_b: (256,) INFO net.py: 91: res4_13_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_13_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_13_branch2b_bn_s loaded from weights file into gpu_0/res4_13_branch2b_bn_s: (256,) INFO net.py: 91: res4_13_branch2b_bn_b loaded from weights file into gpu_0/res4_13_branch2b_bn_b: (256,) INFO net.py: 91: res4_13_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_13_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_13_branch2c_bn_s loaded from weights file into gpu_0/res4_13_branch2c_bn_s: (1024,) INFO net.py: 91: res4_13_branch2c_bn_b loaded from weights file into gpu_0/res4_13_branch2c_bn_b: (1024,) INFO net.py: 91: res4_14_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_14_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_14_branch2a_bn_s loaded from weights file into gpu_0/res4_14_branch2a_bn_s: (256,) INFO net.py: 91: res4_14_branch2a_bn_b loaded from weights file into gpu_0/res4_14_branch2a_bn_b: (256,) INFO net.py: 91: res4_14_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_14_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_14_branch2b_bn_s loaded from weights file into gpu_0/res4_14_branch2b_bn_s: (256,) INFO net.py: 91: res4_14_branch2b_bn_b loaded from weights file into gpu_0/res4_14_branch2b_bn_b: (256,) INFO net.py: 91: res4_14_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_14_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_14_branch2c_bn_s loaded from weights file into gpu_0/res4_14_branch2c_bn_s: (1024,) INFO net.py: 91: res4_14_branch2c_bn_b loaded from weights file into gpu_0/res4_14_branch2c_bn_b: (1024,) INFO net.py: 91: res4_15_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_15_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_15_branch2a_bn_s loaded from weights file into gpu_0/res4_15_branch2a_bn_s: (256,) INFO net.py: 91: res4_15_branch2a_bn_b loaded from weights file into gpu_0/res4_15_branch2a_bn_b: (256,) INFO net.py: 91: res4_15_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_15_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_15_branch2b_bn_s loaded from weights file into gpu_0/res4_15_branch2b_bn_s: (256,) INFO net.py: 91: res4_15_branch2b_bn_b loaded from weights file into gpu_0/res4_15_branch2b_bn_b: (256,) INFO net.py: 91: res4_15_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_15_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_15_branch2c_bn_s loaded from weights file into gpu_0/res4_15_branch2c_bn_s: (1024,) INFO net.py: 91: res4_15_branch2c_bn_b loaded from weights file into gpu_0/res4_15_branch2c_bn_b: (1024,) INFO net.py: 91: res4_16_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_16_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_16_branch2a_bn_s loaded from weights file into gpu_0/res4_16_branch2a_bn_s: (256,) INFO net.py: 91: res4_16_branch2a_bn_b loaded from weights file into gpu_0/res4_16_branch2a_bn_b: (256,) INFO net.py: 91: res4_16_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_16_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_16_branch2b_bn_s loaded from weights file into gpu_0/res4_16_branch2b_bn_s: (256,) INFO net.py: 91: res4_16_branch2b_bn_b loaded from weights file into gpu_0/res4_16_branch2b_bn_b: (256,) INFO net.py: 91: res4_16_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_16_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_16_branch2c_bn_s loaded from weights file into gpu_0/res4_16_branch2c_bn_s: (1024,) INFO net.py: 91: res4_16_branch2c_bn_b loaded from weights file into gpu_0/res4_16_branch2c_bn_b: (1024,) INFO net.py: 91: res4_17_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_17_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_17_branch2a_bn_s loaded from weights file into gpu_0/res4_17_branch2a_bn_s: (256,) INFO net.py: 91: res4_17_branch2a_bn_b loaded from weights file into gpu_0/res4_17_branch2a_bn_b: (256,) INFO net.py: 91: res4_17_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_17_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_17_branch2b_bn_s loaded from weights file into gpu_0/res4_17_branch2b_bn_s: (256,) INFO net.py: 91: res4_17_branch2b_bn_b loaded from weights file into gpu_0/res4_17_branch2b_bn_b: (256,) INFO net.py: 91: res4_17_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_17_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_17_branch2c_bn_s loaded from weights file into gpu_0/res4_17_branch2c_bn_s: (1024,) INFO net.py: 91: res4_17_branch2c_bn_b loaded from weights file into gpu_0/res4_17_branch2c_bn_b: (1024,) INFO net.py: 91: res4_18_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_18_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_18_branch2a_bn_s loaded from weights file into gpu_0/res4_18_branch2a_bn_s: (256,) INFO net.py: 91: res4_18_branch2a_bn_b loaded from weights file into gpu_0/res4_18_branch2a_bn_b: (256,) INFO net.py: 91: res4_18_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_18_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_18_branch2b_bn_s loaded from weights file into gpu_0/res4_18_branch2b_bn_s: (256,) INFO net.py: 91: res4_18_branch2b_bn_b loaded from weights file into gpu_0/res4_18_branch2b_bn_b: (256,) INFO net.py: 91: res4_18_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_18_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_18_branch2c_bn_s loaded from weights file into gpu_0/res4_18_branch2c_bn_s: (1024,) INFO net.py: 91: res4_18_branch2c_bn_b loaded from weights file into gpu_0/res4_18_branch2c_bn_b: (1024,) INFO net.py: 91: res4_19_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_19_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_19_branch2a_bn_s loaded from weights file into gpu_0/res4_19_branch2a_bn_s: (256,) INFO net.py: 91: res4_19_branch2a_bn_b loaded from weights file into gpu_0/res4_19_branch2a_bn_b: (256,) INFO net.py: 91: res4_19_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_19_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_19_branch2b_bn_s loaded from weights file into gpu_0/res4_19_branch2b_bn_s: (256,) INFO net.py: 91: res4_19_branch2b_bn_b loaded from weights file into gpu_0/res4_19_branch2b_bn_b: (256,) INFO net.py: 91: res4_19_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_19_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_19_branch2c_bn_s loaded from weights file into gpu_0/res4_19_branch2c_bn_s: (1024,) INFO net.py: 91: res4_19_branch2c_bn_b loaded from weights file into gpu_0/res4_19_branch2c_bn_b: (1024,) INFO net.py: 91: res4_20_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_20_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_20_branch2a_bn_s loaded from weights file into gpu_0/res4_20_branch2a_bn_s: (256,) INFO net.py: 91: res4_20_branch2a_bn_b loaded from weights file into gpu_0/res4_20_branch2a_bn_b: (256,) INFO net.py: 91: res4_20_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_20_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_20_branch2b_bn_s loaded from weights file into gpu_0/res4_20_branch2b_bn_s: (256,) INFO net.py: 91: res4_20_branch2b_bn_b loaded from weights file into gpu_0/res4_20_branch2b_bn_b: (256,) INFO net.py: 91: res4_20_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_20_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_20_branch2c_bn_s loaded from weights file into gpu_0/res4_20_branch2c_bn_s: (1024,) INFO net.py: 91: res4_20_branch2c_bn_b loaded from weights file into gpu_0/res4_20_branch2c_bn_b: (1024,) INFO net.py: 91: res4_21_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_21_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_21_branch2a_bn_s loaded from weights file into gpu_0/res4_21_branch2a_bn_s: (256,) INFO net.py: 91: res4_21_branch2a_bn_b loaded from weights file into gpu_0/res4_21_branch2a_bn_b: (256,) INFO net.py: 91: res4_21_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_21_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_21_branch2b_bn_s loaded from weights file into gpu_0/res4_21_branch2b_bn_s: (256,) INFO net.py: 91: res4_21_branch2b_bn_b loaded from weights file into gpu_0/res4_21_branch2b_bn_b: (256,) INFO net.py: 91: res4_21_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_21_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_21_branch2c_bn_s loaded from weights file into gpu_0/res4_21_branch2c_bn_s: (1024,) INFO net.py: 91: res4_21_branch2c_bn_b loaded from weights file into gpu_0/res4_21_branch2c_bn_b: (1024,) INFO net.py: 91: res4_22_branch2a_w [+ momentum] loaded from weights file into gpu_0/res4_22_branch2a_w: (256, 1024, 1, 1) INFO net.py: 91: res4_22_branch2a_bn_s loaded from weights file into gpu_0/res4_22_branch2a_bn_s: (256,) INFO net.py: 91: res4_22_branch2a_bn_b loaded from weights file into gpu_0/res4_22_branch2a_bn_b: (256,) INFO net.py: 91: res4_22_branch2b_w [+ momentum] loaded from weights file into gpu_0/res4_22_branch2b_w: (256, 256, 3, 3) INFO net.py: 91: res4_22_branch2b_bn_s loaded from weights file into gpu_0/res4_22_branch2b_bn_s: (256,) INFO net.py: 91: res4_22_branch2b_bn_b loaded from weights file into gpu_0/res4_22_branch2b_bn_b: (256,) INFO net.py: 91: res4_22_branch2c_w [+ momentum] loaded from weights file into gpu_0/res4_22_branch2c_w: (1024, 256, 1, 1) INFO net.py: 91: res4_22_branch2c_bn_s loaded from weights file into gpu_0/res4_22_branch2c_bn_s: (1024,) INFO net.py: 91: res4_22_branch2c_bn_b loaded from weights file into gpu_0/res4_22_branch2c_bn_b: (1024,) INFO net.py: 91: res5_0_branch2a_w [+ momentum] loaded from weights file into gpu_0/res5_0_branch2a_w: (512, 1024, 1, 1) INFO net.py: 91: res5_0_branch2a_bn_s loaded from weights file into gpu_0/res5_0_branch2a_bn_s: (512,) INFO net.py: 91: res5_0_branch2a_bn_b loaded from weights file into gpu_0/res5_0_branch2a_bn_b: (512,) INFO net.py: 91: res5_0_branch2b_w [+ momentum] loaded from weights file into gpu_0/res5_0_branch2b_w: (512, 512, 3, 3) INFO net.py: 91: res5_0_branch2b_bn_s loaded from weights file into gpu_0/res5_0_branch2b_bn_s: (512,) INFO net.py: 91: res5_0_branch2b_bn_b loaded from weights file into gpu_0/res5_0_branch2b_bn_b: (512,) INFO net.py: 91: res5_0_branch2c_w [+ momentum] loaded from weights file into gpu_0/res5_0_branch2c_w: (2048, 512, 1, 1) INFO net.py: 91: res5_0_branch2c_bn_s loaded from weights file into gpu_0/res5_0_branch2c_bn_s: (2048,) INFO net.py: 91: res5_0_branch2c_bn_b loaded from weights file into gpu_0/res5_0_branch2c_bn_b: (2048,) INFO net.py: 91: res5_0_branch1_w [+ momentum] loaded from weights file into gpu_0/res5_0_branch1_w: (2048, 1024, 1, 1) INFO net.py: 91: res5_0_branch1_bn_s loaded from weights file into gpu_0/res5_0_branch1_bn_s: (2048,) INFO net.py: 91: res5_0_branch1_bn_b loaded from weights file into gpu_0/res5_0_branch1_bn_b: (2048,) INFO net.py: 91: res5_1_branch2a_w [+ momentum] loaded from weights file into gpu_0/res5_1_branch2a_w: (512, 2048, 1, 1) INFO net.py: 91: res5_1_branch2a_bn_s loaded from weights file into gpu_0/res5_1_branch2a_bn_s: (512,) INFO net.py: 91: res5_1_branch2a_bn_b loaded from weights file into gpu_0/res5_1_branch2a_bn_b: (512,) INFO net.py: 91: res5_1_branch2b_w [+ momentum] loaded from weights file into gpu_0/res5_1_branch2b_w: (512, 512, 3, 3) INFO net.py: 91: res5_1_branch2b_bn_s loaded from weights file into gpu_0/res5_1_branch2b_bn_s: (512,) INFO net.py: 91: res5_1_branch2b_bn_b loaded from weights file into gpu_0/res5_1_branch2b_bn_b: (512,) INFO net.py: 91: res5_1_branch2c_w [+ momentum] loaded from weights file into gpu_0/res5_1_branch2c_w: (2048, 512, 1, 1) INFO net.py: 91: res5_1_branch2c_bn_s loaded from weights file into gpu_0/res5_1_branch2c_bn_s: (2048,) INFO net.py: 91: res5_1_branch2c_bn_b loaded from weights file into gpu_0/res5_1_branch2c_bn_b: (2048,) INFO net.py: 91: res5_2_branch2a_w [+ momentum] loaded from weights file into gpu_0/res5_2_branch2a_w: (512, 2048, 1, 1) INFO net.py: 91: res5_2_branch2a_bn_s loaded from weights file into gpu_0/res5_2_branch2a_bn_s: (512,) INFO net.py: 91: res5_2_branch2a_bn_b loaded from weights file into gpu_0/res5_2_branch2a_bn_b: (512,) INFO net.py: 91: res5_2_branch2b_w [+ momentum] loaded from weights file into gpu_0/res5_2_branch2b_w: (512, 512, 3, 3) INFO net.py: 91: res5_2_branch2b_bn_s loaded from weights file into gpu_0/res5_2_branch2b_bn_s: (512,) INFO net.py: 91: res5_2_branch2b_bn_b loaded from weights file into gpu_0/res5_2_branch2b_bn_b: (512,) INFO net.py: 91: res5_2_branch2c_w [+ momentum] loaded from weights file into gpu_0/res5_2_branch2c_w: (2048, 512, 1, 1) INFO net.py: 91: res5_2_branch2c_bn_s loaded from weights file into gpu_0/res5_2_branch2c_bn_s: (2048,) INFO net.py: 91: res5_2_branch2c_bn_b loaded from weights file into gpu_0/res5_2_branch2c_bn_b: (2048,) INFO net.py: 91: fpn_inner_res5_2_sum_w [+ momentum] loaded from weights file into gpu_0/fpn_inner_res5_2_sum_w: (256, 2048, 1, 1) INFO net.py: 91: fpn_inner_res5_2_sum_b [+ momentum] loaded from weights file into gpu_0/fpn_inner_res5_2_sum_b: (256,) INFO net.py: 91: fpn_inner_res4_22_sum_lateral_w [+ momentum] loaded from weights file into gpu_0/fpn_inner_res4_22_sum_lateral_w: (256, 1024, 1, 1) INFO net.py: 91: fpn_inner_res4_22_sum_lateral_b [+ momentum] loaded from weights file into gpu_0/fpn_inner_res4_22_sum_lateral_b: (256,) INFO net.py: 91: fpn_inner_res3_3_sum_lateral_w [+ momentum] loaded from weights file into gpu_0/fpn_inner_res3_3_sum_lateral_w: (256, 512, 1, 1) INFO net.py: 91: fpn_inner_res3_3_sum_lateral_b [+ momentum] loaded from weights file into gpu_0/fpn_inner_res3_3_sum_lateral_b: (256,) INFO net.py: 91: fpn_inner_res2_2_sum_lateral_w [+ momentum] loaded from weights file into gpu_0/fpn_inner_res2_2_sum_lateral_w: (256, 256, 1, 1) INFO net.py: 91: fpn_inner_res2_2_sum_lateral_b [+ momentum] loaded from weights file into gpu_0/fpn_inner_res2_2_sum_lateral_b: (256,) INFO net.py: 91: fpn_res5_2_sum_w [+ momentum] loaded from weights file into gpu_0/fpn_res5_2_sum_w: (256, 256, 3, 3) INFO net.py: 91: fpn_res5_2_sum_b [+ momentum] loaded from weights file into gpu_0/fpn_res5_2_sum_b: (256,) INFO net.py: 91: fpn_res4_22_sum_w [+ momentum] loaded from weights file into gpu_0/fpn_res4_22_sum_w: (256, 256, 3, 3) INFO net.py: 91: fpn_res4_22_sum_b [+ momentum] loaded from weights file into gpu_0/fpn_res4_22_sum_b: (256,) INFO net.py: 91: fpn_res3_3_sum_w [+ momentum] loaded from weights file into gpu_0/fpn_res3_3_sum_w: (256, 256, 3, 3) INFO net.py: 91: fpn_res3_3_sum_b [+ momentum] loaded from weights file into gpu_0/fpn_res3_3_sum_b: (256,) INFO net.py: 91: fpn_res2_2_sum_w [+ momentum] loaded from weights file into gpu_0/fpn_res2_2_sum_w: (256, 256, 3, 3) INFO net.py: 91: fpn_res2_2_sum_b [+ momentum] loaded from weights file into gpu_0/fpn_res2_2_sum_b: (256,) INFO net.py: 91: conv_rpn_fpn2_w [+ momentum] loaded from weights file into gpu_0/conv_rpn_fpn2_w: (256, 256, 3, 3) INFO net.py: 91: conv_rpn_fpn2_b [+ momentum] loaded from weights file into gpu_0/conv_rpn_fpn2_b: (256,) INFO net.py: 91: rpn_cls_logits_fpn2_w [+ momentum] loaded from weights file into gpu_0/rpn_cls_logits_fpn2_w: (3, 256, 1, 1) INFO net.py: 91: rpn_cls_logits_fpn2_b [+ momentum] loaded from weights file into gpu_0/rpn_cls_logits_fpn2_b: (3,) INFO net.py: 91: rpn_bbox_pred_fpn2_w [+ momentum] loaded from weights file into gpu_0/rpn_bbox_pred_fpn2_w: (12, 256, 1, 1) INFO net.py: 91: rpn_bbox_pred_fpn2_b [+ momentum] loaded from weights file into gpu_0/rpn_bbox_pred_fpn2_b: (12,) INFO net.py: 91: fc6_w [+ momentum] loaded from weights file into gpu_0/fc6_w: (1024, 12544) INFO net.py: 91: fc6_b [+ momentum] loaded from weights file into gpu_0/fc6_b: (1024,) INFO net.py: 91: fc7_w [+ momentum] loaded from weights file into gpu_0/fc7_w: (1024, 1024) INFO net.py: 91: fc7_b [+ momentum] loaded from weights file into gpu_0/fc7_b: (1024,) INFO net.py: 91: cls_score_w [+ momentum] loaded from weights file into gpu_0/cls_score_w: (81, 1024) INFO net.py: 91: cls_score_b [+ momentum] loaded from weights file into gpu_0/cls_score_b: (81,) INFO net.py: 91: bbox_pred_w [+ momentum] loaded from weights file into gpu_0/bbox_pred_w: (324, 1024) INFO net.py: 91: bbox_pred_b [+ momentum] loaded from weights file into gpu_0/bbox_predb: (324,) INFO net.py: 91: [mask]_fcn1_w [+ momentum] loaded from weights file into gpu0/[mask]_fcn1w: (256, 256, 3, 3) INFO net.py: 91: [mask]_fcn1_b [+ momentum] loaded from weights file into gpu0/[mask]_fcn1b: (256,) INFO net.py: 91: [mask]_fcn2_w [+ momentum] loaded from weights file into gpu0/[mask]_fcn2w: (256, 256, 3, 3) INFO net.py: 91: [mask]_fcn2_b [+ momentum] loaded from weights file into gpu0/[mask]_fcn2b: (256,) INFO net.py: 91: [mask]_fcn3_w [+ momentum] loaded from weights file into gpu0/[mask]_fcn3w: (256, 256, 3, 3) INFO net.py: 91: [mask]_fcn3_b [+ momentum] loaded from weights file into gpu0/[mask]_fcn3b: (256,) INFO net.py: 91: [mask]_fcn4_w [+ momentum] loaded from weights file into gpu0/[mask]_fcn4w: (256, 256, 3, 3) INFO net.py: 91: [mask]_fcn4_b [+ momentum] loaded from weights file into gpu0/[mask]_fcn4_b: (256,) INFO net.py: 91: conv5_mask_w [+ momentum] loaded from weights file into gpu_0/conv5_mask_w: (256, 256, 2, 2) INFO net.py: 91: conv5_mask_b [+ momentum] loaded from weights file into gpu_0/conv5_mask_b: (256,) INFO net.py: 91: mask_fcn_logits_w [+ momentum] loaded from weights file into gpu_0/mask_fcn_logits_w: (81, 256, 1, 1) INFO net.py: 91: mask_fcn_logits_b [+ momentum] loaded from weights file into gpu_0/mask_fcn_logits_b: (81,) INFO net.py: 125: res4_16_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_1_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_16_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_4_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_12_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_12_branch2c_b preserved in workspace (unused) INFO net.py: 125: fc1000_b preserved in workspace (unused) INFO net.py: 125: fc1000_w preserved in workspace (unused) INFO net.py: 125: res3_2_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_5_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_21_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_0_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_21_branch2a_b preserved in workspace (unused) INFO net.py: 125: res3_0_branch1_b preserved in workspace (unused) INFO net.py: 125: res4_9_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_1_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_1_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_5_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_7_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_7_branch2c_b preserved in workspace (unused) INFO net.py: 125: res5_1_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_1_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_4_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_16_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_4_branch2c_b preserved in workspace (unused) INFO net.py: 125: res2_2_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_21_branch2b_b preserved in workspace (unused) INFO net.py: 125: res3_2_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_20_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_9_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_9_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_15_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_20_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_7_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_22_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_18_branch2c_b preserved in workspace (unused) INFO net.py: 125: res3_0_branch2a_b preserved in workspace (unused) INFO net.py: 125: res3_0_branch2b_b preserved in workspace (unused) INFO net.py: 125: res2_2_branch2b_b preserved in workspace (unused) INFO net.py: 125: res5_0_branch2c_b preserved in workspace (unused) INFO net.py: 125: res5_2_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_0_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_0_branch1_b preserved in workspace (unused) INFO net.py: 125: res4_20_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_14_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_15_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_2_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_11_branch2c_b preserved in workspace (unused) INFO net.py: 125: res2_1_branch2c_b preserved in workspace (unused) INFO net.py: 125: conv1_b preserved in workspace (unused) INFO net.py: 125: res4_19_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_15_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_14_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_19_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_18_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_22_branch2c_b preserved in workspace (unused) INFO net.py: 125: res2_2_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_13_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_22_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_18_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_10_branch2b_b preserved in workspace (unused) INFO net.py: 125: res2_0_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_11_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_8_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_13_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_2_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_14_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_6_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_2_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_11_branch2b_b preserved in workspace (unused) INFO net.py: 125: res2_0_branch2a_b preserved in workspace (unused) INFO net.py: 125: res5_2_branch2c_b preserved in workspace (unused) INFO net.py: 125: res3_0_branch2c_b preserved in workspace (unused) INFO net.py: 125: res3_1_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_2_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_19_branch2b_b preserved in workspace (unused) INFO net.py: 125: res3_3_branch2a_b preserved in workspace (unused) INFO net.py: 125: res3_3_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_3_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_13_branch2b_b preserved in workspace (unused) INFO net.py: 125: res2_0_branch1_b preserved in workspace (unused) INFO net.py: 125: res4_17_branch2c_b preserved in workspace (unused) INFO net.py: 125: res5_0_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_10_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_17_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_10_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_8_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_12_branch2b_b preserved in workspace (unused) INFO net.py: 125: res2_0_branch2c_b preserved in workspace (unused) INFO net.py: 125: res2_1_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_0_branch1_b preserved in workspace (unused) INFO net.py: 125: res3_2_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_6_branch2c_b preserved in workspace (unused) INFO net.py: 125: res4_5_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_6_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_0_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_0_branch2c_b preserved in workspace (unused) INFO net.py: 125: res2_1_branch2b_b preserved in workspace (unused) INFO net.py: 125: res3_1_branch2c_b preserved in workspace (unused) INFO net.py: 125: res3_1_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_8_branch2a_b preserved in workspace (unused) INFO net.py: 125: res3_3_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_1_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_3_branch2a_b preserved in workspace (unused) INFO net.py: 125: res4_17_branch2b_b preserved in workspace (unused) INFO net.py: 125: res4_3_branch2c_b preserved in workspace (unused) I0202 01:33:37.294729 30187 net_dag_utils.cc:118] Operator graph pruning prior to chain compute took: 0.000197691 secs I0202 01:33:37.295027 30187 net_dag.cc:61] Number of parallel execution chains 63 Number of operators = 402 I0202 01:33:37.322544 30187 net_dag_utils.cc:118] Operator graph pruning prior to chain compute took: 0.000169061 secs I0202 01:33:37.322793 30187 net_dag.cc:61] Number of parallel execution chains 30 Number of operators = 358 I0202 01:33:37.324757 30187 net_dag_utils.cc:118] Operator graph pruning prior to chain compute took: 1.265e-05 secs I0202 01:33:37.324801 30187 net_dag.cc:61] Number of parallel execution chains 5 Number of operators = 18 INFO infer_simple.py: 111: Processing demo/34501842524_3c858b3080_k.jpg -> /tmp/detectron-visualizations/34501842524_3c858b3080_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 1.075s INFO infer_simple.py: 121: | im_detect_bbox: 1.029s INFO infer_simple.py: 121: | misc_mask: 0.026s INFO infer_simple.py: 121: | im_detect_mask: 0.014s INFO infer_simple.py: 121: | misc_bbox: 0.006s INFO infer_simple.py: 124: \ Note: inference on the first image will be slower than the rest (caches and auto-tuning need to warm up) INFO infer_simple.py: 111: Processing demo/19064748793_bb942deea1_k.jpg -> /tmp/detectron-visualizations/19064748793_bb942deea1_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.231s INFO infer_simple.py: 121: | im_detect_bbox: 0.127s INFO infer_simple.py: 121: | misc_mask: 0.068s INFO infer_simple.py: 121: | im_detect_mask: 0.031s INFO infer_simple.py: 121: | misc_bbox: 0.004s INFO infer_simple.py: 111: Processing demo/24274813513_0cfd2ce6d0_k.jpg -> /tmp/detectron-visualizations/24274813513_0cfd2ce6d0_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.158s INFO infer_simple.py: 121: | im_detect_bbox: 0.122s INFO infer_simple.py: 121: | misc_mask: 0.023s INFO infer_simple.py: 121: | im_detect_mask: 0.008s INFO infer_simple.py: 121: | misc_bbox: 0.005s INFO infer_simple.py: 111: Processing demo/17790319373_bd19b24cfc_k.jpg -> /tmp/detectron-visualizations/17790319373_bd19b24cfc_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.309s INFO infer_simple.py: 121: | im_detect_bbox: 0.249s INFO infer_simple.py: 121: | misc_mask: 0.045s INFO infer_simple.py: 121: | im_detect_mask: 0.011s INFO infer_simple.py: 121: | misc_bbox: 0.004s INFO infer_simple.py: 111: Processing demo/16004479832_a748d55f21_k.jpg -> /tmp/detectron-visualizations/16004479832_a748d55f21_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.134s INFO infer_simple.py: 121: | im_detect_bbox: 0.109s INFO infer_simple.py: 121: | misc_mask: 0.016s INFO infer_simple.py: 121: | im_detect_mask: 0.005s INFO infer_simple.py: 121: | misc_bbox: 0.004s INFO infer_simple.py: 111: Processing demo/15673749081_767a7fa63a_k.jpg -> /tmp/detectron-visualizations/15673749081_767a7fa63a_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.198s INFO infer_simple.py: 121: | im_detect_bbox: 0.105s INFO infer_simple.py: 121: | misc_mask: 0.068s INFO infer_simple.py: 121: | im_detect_mask: 0.021s INFO infer_simple.py: 121: | misc_bbox: 0.004s INFO infer_simple.py: 111: Processing demo/33887522274_eebd074106_k.jpg -> /tmp/detectron-visualizations/33887522274_eebd074106_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.130s INFO infer_simple.py: 121: | im_detect_bbox: 0.108s INFO infer_simple.py: 121: | misc_mask: 0.013s INFO infer_simple.py: 121: | im_detect_mask: 0.004s INFO infer_simple.py: 121: | misc_bbox: 0.005s INFO infer_simple.py: 111: Processing demo/33823288584_1d21cf0a26_k.jpg -> /tmp/detectron-visualizations/33823288584_1d21cf0a26_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.341s INFO infer_simple.py: 121: | im_detect_bbox: 0.251s INFO infer_simple.py: 121: | misc_mask: 0.067s INFO infer_simple.py: 121: | im_detect_mask: 0.018s INFO infer_simple.py: 121: | misc_bbox: 0.004s INFO infer_simple.py: 111: Processing demo/18124840932_e42b3e377c_k.jpg -> /tmp/detectron-visualizations/18124840932_e42b3e377c_k.jpg.pdf INFO infer_simple.py: 119: Inference time: 0.149s INFO infer_simple.py: 121: | im_detect_bbox: 0.104s INFO infer_simple.py: 121: | misc_mask: 0.030s INFO infer_simple.py: 121: | im_detect_mask: 0.011s INFO infer_simple.py: 121: | misc_bbox: 0.004s

dailycafi commented 6 years ago

@ir413 and the output of tests/test_batch_permutation_op.py is similar as the test i posted, with same error message:

E0202 02:00:02.421813 31637 init_intrinsics_check.cc:54] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 02:00:02.421833 31637 init_intrinsics_check.cc:54] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 02:00:02.421838 31637 init_intrinsics_check.cc:54] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. .E

ERROR: test_size_exceptions (main.BatchPermutationOpTest)

Traceback (most recent call last): File "test_batch_permutation_op.py", line 98, in test_size_exceptions self._run_op_test(A, I) File "test_batch_permutation_op.py", line 39, in _run_op_test workspace.RunOperatorOnce(op) File "/home/mm/Library/caffe2/build/caffe2/python/workspace.py", line 176, in RunOperatorOnce return C.run_operator_once(StringifyProto(operator)) SystemError: error return without exception set

Ran 2 tests in 1.611s

dailycafi commented 6 years ago

@ir413 @rbgirshick and another thing I should mention is I am running caffe2 and these test in venv created by conda, @rbgirshick , I updated the unittest2, but still same output.

dailycafi commented 6 years ago

@rbgirshick I changed this function to:

def test_size_exceptions(self):
    A = np.random.randn(2, 256, 42, 86).astype(np.float32)
    B = np.random.randn(2, 256, 35, 87).astype(np.float32)
    self._run_test(A, B)

    A = np.random.randn(2, 255, 42, 88).astype(np.float32)
    B = np.random.randn(2, 256, 35, 87).astype(np.float32)
    self._run_test(A, B)

but the output is still:

E0202 02:29:03.006484 31842 init_intrinsics_check.cc:54] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 02:29:03.006507 31842 init_intrinsics_check.cc:54] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0202 02:29:03.006523 31842 init_intrinsics_check.cc:54] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. .E.

ERROR: test_size_exceptions (main.SpatialNarrowAsOpTest)

Traceback (most recent call last): File "/home/mm/Library/detectron/tests/test_spatial_narrow_as_op.py", line 77, in test_size_exceptions self._run_test(A, B) File "/home/mm/Library/detectron/tests/test_spatial_narrow_as_op.py", line 39, in _run_test workspace.RunOperatorOnce(op) File "/home/mm/Library/caffe2/build/caffe2/python/workspace.py", line 176, in RunOperatorOnce return C.run_operator_once(StringifyProto(operator)) SystemError: error return without exception set

Ran 3 tests in 1.494s

FAILED (errors=1)

ndcorc commented 6 years ago

Hello, I am also failing the tests/test_spatial_narrow_as_op.py and the tests/test_batch_permutation_op.py tests with the exact same error traceback log. I'm running CUDA 9.1 w/ cuDNN 7.0.5. Caffe2 is installed correctly (with PYTHONPATH updated accordingly) as I pass both the "Caffe2 build" and "Caffe2 GPU build" tests. Like @feistar I also can successfuly run infer_simple.py from the getting started page.

FunnyClown commented 6 years ago

I am failing exactly the same error @feistar @ndc466. And I use ubuntu14.04, cuda8.0, cudnn 7.0.5, python 2.7.6. I have past the tests on my server with ubuntu16.04, cuda9.0, cudnn7.0.5, python 2.7.12. It may get error by old version of python?