how to measure fps?

[foralliance]

There seem to be two ways of calculating FPS.

1.via the 'time' model of caffe with batch_size = 1：

build/tools/caffe time -model=models/VGGNet/VOC0712/refinedet_vgg16_320x320/deploy.prototxt -gpu=0

2.get the time interval and estimate the FPS. for example, got the following lines after I run examples/ssd/score_ssd_pascal.py:

I0713 20:50:25.756376 117599 net.cpp:684] Ignoring source layer mbox_loss
I0713 20:51:32.472930 117599 solver.cpp:531] Test net output #0: detection_eval = 0.723217
I0713 20:51:32.473057 117599 solver.cpp:325] Optimization Done.

The total time spent on evaluating 4952 test images is about 67 seconds, and thus FPS = 4952 / 67 = 74.

---

Which method should be used to calculate FPS? Is there any other way?

[lzx1413]

we use the first way to measure the speed.

[foralliance]

@lzx1413 HI when i run build/tools/caffe time -model=models/VGGNet/FSSD_300_VOC0712/deploy.prototxt -gpu=0

output:

I0502 19:51:08.577308  2624 net.cpp:283] Network initialization done.
I0502 19:51:08.577621  2624 caffe.cpp:355] Performing Forward
I0502 19:51:08.639611  2624 caffe.cpp:360] Initial loss: 0
I0502 19:51:08.639642  2624 caffe.cpp:361] Performing Backward
I0502 19:51:08.639647  2624 caffe.cpp:369] *** Benchmark begins ***
I0502 19:51:08.639649  2624 caffe.cpp:370] Testing for 50 iterations.
I0502 19:51:08.692332  2624 caffe.cpp:398] Iteration: 1 forward-backward time: 52.1267 ms.
I0502 19:51:08.734869  2624 caffe.cpp:398] Iteration: 2 forward-backward time: 42.4795 ms.
I0502 19:51:08.786021  2624 caffe.cpp:398] Iteration: 3 forward-backward time: 51.0701 ms.
I0502 19:51:08.827324  2624 caffe.cpp:398] Iteration: 4 forward-backward time: 41.2486 ms.
I0502 19:51:08.877668  2624 caffe.cpp:398] Iteration: 5 forward-backward time: 50.262 ms.
I0502 19:51:08.917121  2624 caffe.cpp:398] Iteration: 6 forward-backward time: 39.3882 ms.
I0502 19:51:08.966423  2624 caffe.cpp:398] Iteration: 7 forward-backward time: 49.2056 ms.
I0502 19:51:09.005632  2624 caffe.cpp:398] Iteration: 8 forward-backward time: 39.1504 ms.
I0502 19:51:09.053122  2624 caffe.cpp:398] Iteration: 9 forward-backward time: 47.4173 ms.
I0502 19:51:09.092219  2624 caffe.cpp:398] Iteration: 10 forward-backward time: 39.0339 ms.
I0502 19:51:09.140944  2624 caffe.cpp:398] Iteration: 11 forward-backward time: 48.6492 ms.
I0502 19:51:09.179489  2624 caffe.cpp:398] Iteration: 12 forward-backward time: 38.4819 ms.
I0502 19:51:09.226649  2624 caffe.cpp:398] Iteration: 13 forward-backward time: 47.0794 ms.
I0502 19:51:09.265509  2624 caffe.cpp:398] Iteration: 14 forward-backward time: 38.7953 ms.
I0502 19:51:09.313702  2624 caffe.cpp:398] Iteration: 15 forward-backward time: 48.1014 ms.
I0502 19:51:09.352421  2624 caffe.cpp:398] Iteration: 16 forward-backward time: 38.6499 ms.
I0502 19:51:09.399528  2624 caffe.cpp:398] Iteration: 17 forward-backward time: 47.0149 ms.
I0502 19:51:09.438472  2624 caffe.cpp:398] Iteration: 18 forward-backward time: 38.8782 ms.
I0502 19:51:09.486711  2624 caffe.cpp:398] Iteration: 19 forward-backward time: 48.1385 ms.
I0502 19:51:09.525598  2624 caffe.cpp:398] Iteration: 20 forward-backward time: 38.8209 ms.
I0502 19:51:09.572626  2624 caffe.cpp:398] Iteration: 21 forward-backward time: 46.9453 ms.
I0502 19:51:09.611421  2624 caffe.cpp:398] Iteration: 22 forward-backward time: 38.7328 ms.
I0502 19:51:09.660060  2624 caffe.cpp:398] Iteration: 23 forward-backward time: 48.5654 ms.
I0502 19:51:09.698884  2624 caffe.cpp:398] Iteration: 24 forward-backward time: 38.7643 ms.
I0502 19:51:09.745893  2624 caffe.cpp:398] Iteration: 25 forward-backward time: 46.9261 ms.
I0502 19:51:09.784636  2624 caffe.cpp:398] Iteration: 26 forward-backward time: 38.6805 ms.
I0502 19:51:09.833022  2624 caffe.cpp:398] Iteration: 27 forward-backward time: 48.3062 ms.
I0502 19:51:09.871919  2624 caffe.cpp:398] Iteration: 28 forward-backward time: 38.8332 ms.
I0502 19:51:09.919243  2624 caffe.cpp:398] Iteration: 29 forward-backward time: 47.2201 ms.
I0502 19:51:09.955760  2624 caffe.cpp:398] Iteration: 30 forward-backward time: 36.453 ms.
I0502 19:51:09.994518  2624 caffe.cpp:398] Iteration: 31 forward-backward time: 38.6948 ms.
I0502 19:51:10.041503  2624 caffe.cpp:398] Iteration: 32 forward-backward time: 46.9067 ms.
I0502 19:51:10.079931  2624 caffe.cpp:398] Iteration: 33 forward-backward time: 38.3631 ms.
I0502 19:51:10.127872  2624 caffe.cpp:398] Iteration: 34 forward-backward time: 47.8641 ms.
I0502 19:51:10.166751  2624 caffe.cpp:398] Iteration: 35 forward-backward time: 38.8198 ms.
I0502 19:51:10.215322  2624 caffe.cpp:398] Iteration: 36 forward-backward time: 48.4905 ms.
I0502 19:51:10.254369  2624 caffe.cpp:398] Iteration: 37 forward-backward time: 38.9816 ms.
I0502 19:51:10.300364  2624 caffe.cpp:398] Iteration: 38 forward-backward time: 45.9197 ms.
I0502 19:51:10.339735  2624 caffe.cpp:398] Iteration: 39 forward-backward time: 39.3112 ms.
I0502 19:51:10.388329  2624 caffe.cpp:398] Iteration: 40 forward-backward time: 48.5212 ms.
I0502 19:51:10.426968  2624 caffe.cpp:398] Iteration: 41 forward-backward time: 38.572 ms.
I0502 19:51:10.474114  2624 caffe.cpp:398] Iteration: 42 forward-backward time: 47.0642 ms.
I0502 19:51:10.513365  2624 caffe.cpp:398] Iteration: 43 forward-backward time: 39.1821 ms.
I0502 19:51:10.561833  2624 caffe.cpp:398] Iteration: 44 forward-backward time: 48.3954 ms.
I0502 19:51:10.602012  2624 caffe.cpp:398] Iteration: 45 forward-backward time: 40.1129 ms.
I0502 19:51:10.647636  2624 caffe.cpp:398] Iteration: 46 forward-backward time: 45.5475 ms.
I0502 19:51:10.686683  2624 caffe.cpp:398] Iteration: 47 forward-backward time: 38.9816 ms.
I0502 19:51:10.735180  2624 caffe.cpp:398] Iteration: 48 forward-backward time: 48.4157 ms.
I0502 19:51:10.775432  2624 caffe.cpp:398] Iteration: 49 forward-backward time: 40.1859 ms.
I0502 19:51:10.821224  2624 caffe.cpp:398] Iteration: 50 forward-backward time: 45.7155 ms.
I0502 19:51:10.821280  2624 caffe.cpp:401] Average time per layer: 
I0502 19:51:10.821283  2624 caffe.cpp:404]      input   forward: 0.0014656 ms.
I0502 19:51:10.821288  2624 caffe.cpp:407]      input   backward: 0.00107392 ms.
I0502 19:51:10.821295  2624 caffe.cpp:404] data_input_0_split   forward: 0.00231232 ms.
I0502 19:51:10.821298  2624 caffe.cpp:407] data_input_0_split   backward: 0.00158976 ms.
I0502 19:51:10.821301  2624 caffe.cpp:404]    conv1_1   forward: 0.309636 ms.
I0502 19:51:10.821305  2624 caffe.cpp:407]    conv1_1   backward: 0.436775 ms.
I0502 19:51:10.821306  2624 caffe.cpp:404]    relu1_1   forward: 0.127009 ms.
I0502 19:51:10.821310  2624 caffe.cpp:407]    relu1_1   backward: 0.0014304 ms.
I0502 19:51:10.821311  2624 caffe.cpp:404]    conv1_2   forward: 0.725702 ms.
I0502 19:51:10.821316  2624 caffe.cpp:407]    conv1_2   backward: 1.09133 ms.
I0502 19:51:10.821319  2624 caffe.cpp:404]    relu1_2   forward: 0.125579 ms.
I0502 19:51:10.821323  2624 caffe.cpp:407]    relu1_2   backward: 0.00097216 ms.
I0502 19:51:10.821326  2624 caffe.cpp:404]      pool1   forward: 0.101928 ms.
I0502 19:51:10.821329  2624 caffe.cpp:407]      pool1   backward: 0.00147136 ms.
I0502 19:51:10.821333  2624 caffe.cpp:404]    conv2_1   forward: 0.354468 ms.
I0502 19:51:10.821336  2624 caffe.cpp:407]    conv2_1   backward: 0.741215 ms.
I0502 19:51:10.821338  2624 caffe.cpp:404]    relu2_1   forward: 0.0649568 ms.
I0502 19:51:10.821341  2624 caffe.cpp:407]    relu2_1   backward: 0.00145088 ms.
I0502 19:51:10.821344  2624 caffe.cpp:404]    conv2_2   forward: 0.474093 ms.
I0502 19:51:10.821347  2624 caffe.cpp:407]    conv2_2   backward: 0.902104 ms.
I0502 19:51:10.821350  2624 caffe.cpp:404]    relu2_2   forward: 0.0648333 ms.
I0502 19:51:10.821353  2624 caffe.cpp:407]    relu2_2   backward: 0.00106944 ms.
I0502 19:51:10.821357  2624 caffe.cpp:404]      pool2   forward: 0.0530554 ms.
I0502 19:51:10.821360  2624 caffe.cpp:407]      pool2   backward: 0.0015168 ms.
I0502 19:51:10.821363  2624 caffe.cpp:404]    conv3_1   forward: 0.263485 ms.
I0502 19:51:10.821367  2624 caffe.cpp:407]    conv3_1   backward: 0.63339 ms.
I0502 19:51:10.821388  2624 caffe.cpp:404]    relu3_1   forward: 0.0331949 ms.
I0502 19:51:10.821393  2624 caffe.cpp:407]    relu3_1   backward: 0.00134464 ms.
I0502 19:51:10.821395  2624 caffe.cpp:404]    conv3_2   forward: 0.426387 ms.
I0502 19:51:10.821398  2624 caffe.cpp:407]    conv3_2   backward: 1.01792 ms.
I0502 19:51:10.821403  2624 caffe.cpp:404]    relu3_2   forward: 0.0333606 ms.
I0502 19:51:10.821404  2624 caffe.cpp:407]    relu3_2   backward: 0.00147008 ms.
I0502 19:51:10.821408  2624 caffe.cpp:404]    conv3_3   forward: 0.423694 ms.
I0502 19:51:10.821410  2624 caffe.cpp:407]    conv3_3   backward: 1.0199 ms.
I0502 19:51:10.821414  2624 caffe.cpp:404]    relu3_3   forward: 0.0335757 ms.
I0502 19:51:10.821418  2624 caffe.cpp:407]    relu3_3   backward: 0.0010464 ms.
I0502 19:51:10.821420  2624 caffe.cpp:404]      pool3   forward: 0.0315085 ms.
I0502 19:51:10.821424  2624 caffe.cpp:407]      pool3   backward: 0.00148352 ms.
I0502 19:51:10.821426  2624 caffe.cpp:404]    conv4_1   forward: 0.297759 ms.
I0502 19:51:10.821429  2624 caffe.cpp:407]    conv4_1   backward: 1.08838 ms.
I0502 19:51:10.821431  2624 caffe.cpp:404]    relu4_1   forward: 0.016903 ms.
I0502 19:51:10.821434  2624 caffe.cpp:407]    relu4_1   backward: 0.00151168 ms.
I0502 19:51:10.821439  2624 caffe.cpp:404]    conv4_2   forward: 0.72435 ms.
I0502 19:51:10.821440  2624 caffe.cpp:407]    conv4_2   backward: 2.33419 ms.
I0502 19:51:10.821444  2624 caffe.cpp:404]    relu4_2   forward: 0.0170246 ms.
I0502 19:51:10.821446  2624 caffe.cpp:407]    relu4_2   backward: 0.00162752 ms.
I0502 19:51:10.821449  2624 caffe.cpp:404]    conv4_3   forward: 0.722323 ms.
I0502 19:51:10.821452  2624 caffe.cpp:407]    conv4_3   backward: 2.32578 ms.
I0502 19:51:10.821455  2624 caffe.cpp:404]    relu4_3   forward: 0.0168762 ms.
I0502 19:51:10.821458  2624 caffe.cpp:407]    relu4_3   backward: 0.00145472 ms.
I0502 19:51:10.821461  2624 caffe.cpp:404] conv4_3_relu4_3_0_split  forward: 0.00155072 ms.
I0502 19:51:10.821465  2624 caffe.cpp:407] conv4_3_relu4_3_0_split  backward: 0.00095424 ms.
I0502 19:51:10.821467  2624 caffe.cpp:404]      pool4   forward: 0.0169626 ms.
I0502 19:51:10.821472  2624 caffe.cpp:407]      pool4   backward: 0.0016 ms.
I0502 19:51:10.821477  2624 caffe.cpp:404]    conv5_1   forward: 0.273748 ms.
I0502 19:51:10.821481  2624 caffe.cpp:407]    conv5_1   backward: 1.04996 ms.
I0502 19:51:10.821485  2624 caffe.cpp:404]    relu5_1   forward: 0.00587008 ms.
I0502 19:51:10.821487  2624 caffe.cpp:407]    relu5_1   backward: 0.0018848 ms.
I0502 19:51:10.821491  2624 caffe.cpp:404]    conv5_2   forward: 0.268223 ms.
I0502 19:51:10.821494  2624 caffe.cpp:407]    conv5_2   backward: 1.05002 ms.
I0502 19:51:10.821497  2624 caffe.cpp:404]    relu5_2   forward: 0.00572864 ms.
I0502 19:51:10.821501  2624 caffe.cpp:407]    relu5_2   backward: 0.0017344 ms.
I0502 19:51:10.821503  2624 caffe.cpp:404]    conv5_3   forward: 0.267434 ms.
I0502 19:51:10.821506  2624 caffe.cpp:407]    conv5_3   backward: 1.03887 ms.
I0502 19:51:10.821509  2624 caffe.cpp:404]    relu5_3   forward: 0.00573952 ms.
I0502 19:51:10.821511  2624 caffe.cpp:407]    relu5_3   backward: 0.00097728 ms.
I0502 19:51:10.821516  2624 caffe.cpp:404]      pool5   forward: 0.0152723 ms.
I0502 19:51:10.821517  2624 caffe.cpp:407]      pool5   backward: 0.00167616 ms.
I0502 19:51:10.821521  2624 caffe.cpp:404]        fc6   forward: 0.923499 ms.
I0502 19:51:10.821523  2624 caffe.cpp:407]        fc6   backward: 0.62456 ms.
I0502 19:51:10.821527  2624 caffe.cpp:404]      relu6   forward: 0.00705984 ms.
I0502 19:51:10.821530  2624 caffe.cpp:407]      relu6   backward: 0.00156608 ms.
I0502 19:51:10.821533  2624 caffe.cpp:404]        fc7   forward: 0.124287 ms.
I0502 19:51:10.821537  2624 caffe.cpp:407]        fc7   backward: 0.518377 ms.
I0502 19:51:10.821539  2624 caffe.cpp:404]      relu7   forward: 0.00675648 ms.
I0502 19:51:10.821542  2624 caffe.cpp:407]      relu7   backward: 0.00098304 ms.
I0502 19:51:10.821547  2624 caffe.cpp:404] fc7_relu7_0_split    forward: 0.00128128 ms.
I0502 19:51:10.821549  2624 caffe.cpp:407] fc7_relu7_0_split    backward: 0.00161088 ms.
I0502 19:51:10.821557  2624 caffe.cpp:404] conv4_3_reduce   forward: 0.0789242 ms.
I0502 19:51:10.821561  2624 caffe.cpp:407] conv4_3_reduce   backward: 0.180698 ms.
I0502 19:51:10.821564  2624 caffe.cpp:404] conv4_3_reduce_relu  forward: 0.0066784 ms.
I0502 19:51:10.821568  2624 caffe.cpp:407] conv4_3_reduce_relu  backward: 0.0015648 ms.
I0502 19:51:10.821570  2624 caffe.cpp:404]    conv6_1   forward: 0.120433 ms.
I0502 19:51:10.821573  2624 caffe.cpp:407]    conv6_1   backward: 0.117853 ms.
I0502 19:51:10.821576  2624 caffe.cpp:404] conv6_1_relu forward: 0.00492416 ms.
I0502 19:51:10.821579  2624 caffe.cpp:407] conv6_1_relu backward: 0.00154112 ms.
I0502 19:51:10.821583  2624 caffe.cpp:404]    conv6_2   forward: 0.158136 ms.
I0502 19:51:10.821585  2624 caffe.cpp:407]    conv6_2   backward: 0.532652 ms.
I0502 19:51:10.821588  2624 caffe.cpp:404] conv6_2_relu forward: 0.00612992 ms.
I0502 19:51:10.821591  2624 caffe.cpp:407] conv6_2_relu backward: 0.00153664 ms.
I0502 19:51:10.821594  2624 caffe.cpp:404]    conv7_1   forward: 0.0686496 ms.
I0502 19:51:10.821597  2624 caffe.cpp:407]    conv7_1   backward: 0.0820262 ms.
I0502 19:51:10.821600  2624 caffe.cpp:404] conv7_1_relu forward: 0.00454912 ms.
I0502 19:51:10.821604  2624 caffe.cpp:407] conv7_1_relu backward: 0.00148992 ms.
I0502 19:51:10.821607  2624 caffe.cpp:404]    conv7_2   forward: 0.0977248 ms.
I0502 19:51:10.821610  2624 caffe.cpp:407]    conv7_2   backward: 0.0771392 ms.
I0502 19:51:10.821614  2624 caffe.cpp:404] conv7_2_relu forward: 0.00407872 ms.
I0502 19:51:10.821616  2624 caffe.cpp:407] conv7_2_relu backward: 0.00155648 ms.
I0502 19:51:10.821619  2624 caffe.cpp:404] fc7_reduce   forward: 0.118392 ms.
I0502 19:51:10.821622  2624 caffe.cpp:407] fc7_reduce   backward: 0.126289 ms.
I0502 19:51:10.821625  2624 caffe.cpp:404] fc7_reduce_relu  forward: 0.00489856 ms.
I0502 19:51:10.821629  2624 caffe.cpp:407] fc7_reduce_relu  backward: 0.00102912 ms.
I0502 19:51:10.821631  2624 caffe.cpp:404]     fc7_us   forward: 0.0698682 ms.
I0502 19:51:10.821635  2624 caffe.cpp:407]     fc7_us   backward: 0.00142848 ms.
I0502 19:51:10.821637  2624 caffe.cpp:404] conv7_2_us   forward: 0.071161 ms.
I0502 19:51:10.821640  2624 caffe.cpp:407] conv7_2_us   backward: 0.00099264 ms.
I0502 19:51:10.821643  2624 caffe.cpp:404] fea_concat   forward: 0.0304224 ms.
I0502 19:51:10.821646  2624 caffe.cpp:407] fea_concat   backward: 0.002016 ms.
I0502 19:51:10.821650  2624 caffe.cpp:404] fea_concat_bn    forward: 0.208401 ms.
I0502 19:51:10.821652  2624 caffe.cpp:407] fea_concat_bn    backward: 0.323037 ms.
I0502 19:51:10.821656  2624 caffe.cpp:404] fea_concat_bn_ds_1   forward: 1.06733 ms.
I0502 19:51:10.821658  2624 caffe.cpp:407] fea_concat_bn_ds_1   backward: 3.21441 ms.
I0502 19:51:10.821661  2624 caffe.cpp:404] fea_concat_bn_ds_1_relu  forward: 0.0168749 ms.
I0502 19:51:10.821665  2624 caffe.cpp:407] fea_concat_bn_ds_1_relu  backward: 0.00090304 ms.
I0502 19:51:10.821668  2624 caffe.cpp:404] fea_concat_bn_ds_1_fea_concat_bn_ds_1_relu_0_split   forward: 0.00121536 ms.
I0502 19:51:10.821671  2624 caffe.cpp:407] fea_concat_bn_ds_1_fea_concat_bn_ds_1_relu_0_split   backward: 0.001488 ms.
I0502 19:51:10.821673  2624 caffe.cpp:404] fea_concat_bn_ds_2   forward: 0.276661 ms.
I0502 19:51:10.821676  2624 caffe.cpp:407] fea_concat_bn_ds_2   backward: 1.05909 ms.
I0502 19:51:10.821681  2624 caffe.cpp:404] fea_concat_bn_ds_2_relu  forward: 0.0056864 ms.
I0502 19:51:10.821682  2624 caffe.cpp:407] fea_concat_bn_ds_2_relu  backward: 0.00087872 ms.
I0502 19:51:10.821686  2624 caffe.cpp:404] fea_concat_bn_ds_2_fea_concat_bn_ds_2_relu_0_split   forward: 0.00103552 ms.
I0502 19:51:10.821689  2624 caffe.cpp:407] fea_concat_bn_ds_2_fea_concat_bn_ds_2_relu_0_split   backward: 0.00142592 ms.
I0502 19:51:10.821692  2624 caffe.cpp:404] fea_concat_bn_ds_4   forward: 0.162377 ms.
I0502 19:51:10.821696  2624 caffe.cpp:407] fea_concat_bn_ds_4   backward: 0.300367 ms.
I0502 19:51:10.821698  2624 caffe.cpp:404] fea_concat_bn_ds_4_relu  forward: 0.00455744 ms.
I0502 19:51:10.821702  2624 caffe.cpp:407] fea_concat_bn_ds_4_relu  backward: 0.00088768 ms.
I0502 19:51:10.821704  2624 caffe.cpp:404] fea_concat_bn_ds_4_fea_concat_bn_ds_4_relu_0_split   forward: 0.00119552 ms.
I0502 19:51:10.821710  2624 caffe.cpp:407] fea_concat_bn_ds_4_fea_concat_bn_ds_4_relu_0_split   backward: 0.00134336 ms.
I0502 19:51:10.821714  2624 caffe.cpp:404] fea_concat_bn_ds_8   forward: 0.106833 ms.
I0502 19:51:10.821717  2624 caffe.cpp:407] fea_concat_bn_ds_8   backward: 0.0663584 ms.
I0502 19:51:10.821720  2624 caffe.cpp:404] fea_concat_bn_ds_8_relu  forward: 0.00412736 ms.
I0502 19:51:10.821723  2624 caffe.cpp:407] fea_concat_bn_ds_8_relu  backward: 0.00084864 ms.
I0502 19:51:10.821727  2624 caffe.cpp:404] fea_concat_bn_ds_8_fea_concat_bn_ds_8_relu_0_split   forward: 0.00117056 ms.
I0502 19:51:10.821729  2624 caffe.cpp:407] fea_concat_bn_ds_8_fea_concat_bn_ds_8_relu_0_split   backward: 0.00139264 ms.
I0502 19:51:10.821732  2624 caffe.cpp:404] fea_concat_bn_ds_16  forward: 0.0703866 ms.
I0502 19:51:10.821735  2624 caffe.cpp:407] fea_concat_bn_ds_16  backward: 0.0508646 ms.
I0502 19:51:10.821738  2624 caffe.cpp:404] fea_concat_bn_ds_16_relu forward: 0.0042592 ms.
I0502 19:51:10.821741  2624 caffe.cpp:407] fea_concat_bn_ds_16_relu backward: 0.00088384 ms.
I0502 19:51:10.821745  2624 caffe.cpp:404] fea_concat_bn_ds_16_fea_concat_bn_ds_16_relu_0_split forward: 0.00115392 ms.
I0502 19:51:10.821748  2624 caffe.cpp:407] fea_concat_bn_ds_16_fea_concat_bn_ds_16_relu_0_split backward: 0.0013248 ms.
I0502 19:51:10.821750  2624 caffe.cpp:404] fea_concat_bn_ds_32  forward: 0.0691155 ms.
I0502 19:51:10.821753  2624 caffe.cpp:407] fea_concat_bn_ds_32  backward: 0.0438605 ms.
I0502 19:51:10.821758  2624 caffe.cpp:404] fea_concat_bn_ds_32_relu forward: 0.00456512 ms.
I0502 19:51:10.821760  2624 caffe.cpp:407] fea_concat_bn_ds_32_relu backward: 0.00093184 ms.
I0502 19:51:10.821763  2624 caffe.cpp:404] fea_concat_bn_ds_32_fea_concat_bn_ds_32_relu_0_split forward: 0.00105664 ms.
I0502 19:51:10.821766  2624 caffe.cpp:407] fea_concat_bn_ds_32_fea_concat_bn_ds_32_relu_0_split backward: 0.0012832 ms.
I0502 19:51:10.821769  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_loc  forward: 0.0814496 ms.
I0502 19:51:10.821772  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_loc  backward: 0.136619 ms.
I0502 19:51:10.821775  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_loc_perm forward: 0.0881453 ms.
I0502 19:51:10.821779  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_loc_perm backward: 0.0124192 ms.
I0502 19:51:10.821782  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_loc_flat forward: 0.00142784 ms.
I0502 19:51:10.821785  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_loc_flat backward: 0.001136 ms.
I0502 19:51:10.821789  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_conf forward: 0.17866 ms.
I0502 19:51:10.821791  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_conf backward: 0.395626 ms.
I0502 19:51:10.821794  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_conf_perm    forward: 0.114365 ms.
I0502 19:51:10.821797  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_conf_perm    backward: 0.0404019 ms.
I0502 19:51:10.821800  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_conf_flat    forward: 0.00106176 ms.
I0502 19:51:10.821804  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_conf_flat    backward: 0.00092864 ms.
I0502 19:51:10.821807  2624 caffe.cpp:404] fea_concat_bn_ds_1_mbox_priorbox forward: 0.0841402 ms.
I0502 19:51:10.821810  2624 caffe.cpp:407] fea_concat_bn_ds_1_mbox_priorbox backward: 0.0008416 ms.
I0502 19:51:10.821813  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_loc  forward: 0.0827091 ms.
I0502 19:51:10.821816  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_loc  backward: 0.0744416 ms.
I0502 19:51:10.821820  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_loc_perm forward: 0.0822931 ms.
I0502 19:51:10.821822  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_loc_perm backward: 0.00762816 ms.
I0502 19:51:10.821825  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_loc_flat forward: 0.00108288 ms.
I0502 19:51:10.821828  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_loc_flat backward: 0.00095744 ms.
I0502 19:51:10.821831  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_conf forward: 0.0977754 ms.
I0502 19:51:10.821835  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_conf backward: 0.176549 ms.
I0502 19:51:10.821841  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_conf_perm    forward: 0.0883904 ms.
I0502 19:51:10.821844  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_conf_perm    backward: 0.0143955 ms.
I0502 19:51:10.821847  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_conf_flat    forward: 0.00110656 ms.
I0502 19:51:10.821851  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_conf_flat    backward: 0.0009472 ms.
I0502 19:51:10.821854  2624 caffe.cpp:404] fea_concat_bn_ds_2_mbox_priorbox forward: 0.0145107 ms.
I0502 19:51:10.821857  2624 caffe.cpp:407] fea_concat_bn_ds_2_mbox_priorbox backward: 0.00091584 ms.
I0502 19:51:10.821861  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_loc  forward: 0.0507354 ms.
I0502 19:51:10.821863  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_loc  backward: 0.0405306 ms.
I0502 19:51:10.821866  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_loc_perm forward: 0.0814733 ms.
I0502 19:51:10.821869  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_loc_perm backward: 0.00642688 ms.
I0502 19:51:10.821872  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_loc_flat forward: 0.00114176 ms.
I0502 19:51:10.821876  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_loc_flat backward: 0.00100736 ms.
I0502 19:51:10.821878  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_conf forward: 0.0556595 ms.
I0502 19:51:10.821882  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_conf backward: 0.0709734 ms.
I0502 19:51:10.821885  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_conf_perm    forward: 0.084295 ms.
I0502 19:51:10.821888  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_conf_perm    backward: 0.00704704 ms.
I0502 19:51:10.821890  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_conf_flat    forward: 0.00099712 ms.
I0502 19:51:10.821893  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_conf_flat    backward: 0.00092096 ms.
I0502 19:51:10.821897  2624 caffe.cpp:404] fea_concat_bn_ds_4_mbox_priorbox forward: 0.0045856 ms.
I0502 19:51:10.821899  2624 caffe.cpp:407] fea_concat_bn_ds_4_mbox_priorbox backward: 0.00094848 ms.
I0502 19:51:10.821902  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_loc  forward: 0.046279 ms.
I0502 19:51:10.821904  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_loc  backward: 0.0286445 ms.
I0502 19:51:10.821907  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_loc_perm forward: 0.082023 ms.
I0502 19:51:10.821910  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_loc_perm backward: 0.00584192 ms.
I0502 19:51:10.821913  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_loc_flat forward: 0.00114752 ms.
I0502 19:51:10.821915  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_loc_flat backward: 0.00094016 ms.
I0502 19:51:10.821918  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_conf forward: 0.0526605 ms.
I0502 19:51:10.821921  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_conf backward: 0.0334675 ms.
I0502 19:51:10.821924  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_conf_perm    forward: 0.0822957 ms.
I0502 19:51:10.821928  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_conf_perm    backward: 0.00632768 ms.
I0502 19:51:10.821931  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_conf_flat    forward: 0.0011488 ms.
I0502 19:51:10.821934  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_conf_flat    backward: 0.00095168 ms.
I0502 19:51:10.821936  2624 caffe.cpp:404] fea_concat_bn_ds_8_mbox_priorbox forward: 0.0018784 ms.
I0502 19:51:10.821939  2624 caffe.cpp:407] fea_concat_bn_ds_8_mbox_priorbox backward: 0.00101504 ms.
I0502 19:51:10.821943  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_loc forward: 0.0449715 ms.
I0502 19:51:10.821946  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_loc backward: 0.0236102 ms.
I0502 19:51:10.821949  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_loc_perm    forward: 0.0820122 ms.
I0502 19:51:10.821951  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_loc_perm    backward: 0.00572672 ms.
I0502 19:51:10.821955  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_loc_flat    forward: 0.00102464 ms.
I0502 19:51:10.821957  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_loc_flat    backward: 0.0009344 ms.
I0502 19:51:10.821960  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_conf    forward: 0.0520294 ms.
I0502 19:51:10.821966  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_conf    backward: 0.0340992 ms.
I0502 19:51:10.821971  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_conf_perm   forward: 0.0821786 ms.
I0502 19:51:10.821974  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_conf_perm   backward: 0.005952 ms.
I0502 19:51:10.823305  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_conf_flat   forward: 0.0012096 ms.
I0502 19:51:10.823312  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_conf_flat   backward: 0.00093056 ms.
I0502 19:51:10.823315  2624 caffe.cpp:404] fea_concat_bn_ds_16_mbox_priorbox    forward: 0.0015136 ms.
I0502 19:51:10.823318  2624 caffe.cpp:407] fea_concat_bn_ds_16_mbox_priorbox    backward: 0.00099008 ms.
I0502 19:51:10.823321  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_loc forward: 0.0445146 ms.
I0502 19:51:10.823324  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_loc backward: 0.0296512 ms.
I0502 19:51:10.823328  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_loc_perm    forward: 0.0816032 ms.
I0502 19:51:10.823331  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_loc_perm    backward: 0.0058816 ms.
I0502 19:51:10.823334  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_loc_flat    forward: 0.00105408 ms.
I0502 19:51:10.823338  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_loc_flat    backward: 0.00099264 ms.
I0502 19:51:10.823340  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_conf    forward: 0.0519712 ms.
I0502 19:51:10.823343  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_conf    backward: 0.0377107 ms.
I0502 19:51:10.823348  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_conf_perm   forward: 0.0815686 ms.
I0502 19:51:10.823350  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_conf_perm   backward: 0.00659776 ms.
I0502 19:51:10.823354  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_conf_flat   forward: 0.00118144 ms.
I0502 19:51:10.823356  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_conf_flat   backward: 0.0009792 ms.
I0502 19:51:10.823359  2624 caffe.cpp:404] fea_concat_bn_ds_32_mbox_priorbox    forward: 0.00123584 ms.
I0502 19:51:10.823362  2624 caffe.cpp:407] fea_concat_bn_ds_32_mbox_priorbox    backward: 0.00097728 ms.
I0502 19:51:10.823366  2624 caffe.cpp:404]   mbox_loc   forward: 0.0140224 ms.
I0502 19:51:10.823369  2624 caffe.cpp:407]   mbox_loc   backward: 0.00140288 ms.
I0502 19:51:10.823372  2624 caffe.cpp:404]  mbox_conf   forward: 0.0158605 ms.
I0502 19:51:10.823375  2624 caffe.cpp:407]  mbox_conf   backward: 0.00127936 ms.
I0502 19:51:10.823379  2624 caffe.cpp:404] mbox_priorbox    forward: 0.264256 ms.
I0502 19:51:10.823381  2624 caffe.cpp:407] mbox_priorbox    backward: 0.00173888 ms.
I0502 19:51:10.823385  2624 caffe.cpp:404] mbox_conf_reshape    forward: 0.00151616 ms.
I0502 19:51:10.823387  2624 caffe.cpp:407] mbox_conf_reshape    backward: 0.00101376 ms.
I0502 19:51:10.823391  2624 caffe.cpp:404] mbox_conf_softmax    forward: 0.14782 ms.
I0502 19:51:10.823395  2624 caffe.cpp:407] mbox_conf_softmax    backward: 0.00098496 ms.
I0502 19:51:10.823397  2624 caffe.cpp:404] mbox_conf_flatten    forward: 0.00112576 ms.
I0502 19:51:10.823400  2624 caffe.cpp:407] mbox_conf_flatten    backward: 0.0016384 ms.
I0502 19:51:10.823411  2624 caffe.cpp:412] Average Forward pass: 17.7639 ms.
I0502 19:51:10.823415  2624 caffe.cpp:414] Average Backward pass: 25.6878 ms.
I0502 19:51:10.823447  2624 caffe.cpp:416] Average Forward-Backward: 43.6641 ms.
I0502 19:51:10.823452  2624 caffe.cpp:418] Total Time: 2183.21 ms.
I0502 19:51:10.823458  2624 caffe.cpp:419] *** Benchmark ends ***

why the FPS is only 56.3? My machine configuration is: 1080Ti + CUDA8.0 + cudnn5

[lzx1413]

I0503 10:43:49.640677 13951 caffe.cpp:412] Average Forward pass: 15.2892 ms.
I0503 10:43:49.640684 13951 caffe.cpp:414] Average Backward pass: 21.421 ms.
I0503 10:43:49.640691 13951 caffe.cpp:416] Average Forward-Backward: 36.7747 ms.
I0503 10:43:49.640698 13951 caffe.cpp:418] Total Time: 1838.73 ms.

Ubuntu16.04 cuda8 cudnn6