FeiYull / TensorRT-Alpha

🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
GNU General Public License v2.0
1.26k stars 196 forks source link

v8检测模型速度 #63

Open yohnyang opened 7 months ago

yohnyang commented 7 months ago

通过v8检测模型测试视频推理,在RTX2080super上的infer速度表现为开始为2-3ms,执行几十帧之后infer速度会跳跃到10~20ms之间并不会再下来,这个可以帮忙再看一下吗

FeiYull commented 7 months ago

@yohnyang 将bash窗口打印的log发出来看看

yohnyang commented 7 months ago

[12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] Init CUDA: CPU +442, GPU +0, now: CPU 14318, GPU 1252 (MiB) [12/25/2023-12:32:49] [I] [TRT] Loaded engine size: 7 MiB [12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +0, now: CPU 0, GPU 0 (MiB) [12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +0, now: CPU 0, GPU 0 (MiB) init: 1272.88 copy: 0.970 ms, - preprocess: 0.054 ms, - infer: 2.920 ms, - postprocess: 0.486 ms copy: 0.718 ms, - preprocess: 0.042 ms, - infer: 2.861 ms, - postprocess: 0.466 ms copy: 1.111 ms, - preprocess: 0.060 ms, - infer: 2.694 ms, - postprocess: 0.348 ms copy: 1.163 ms, - preprocess: 0.066 ms, - infer: 2.827 ms, - postprocess: 0.380 ms copy: 1.038 ms, - preprocess: 0.072 ms, - infer: 3.420 ms, - postprocess: 0.363 ms copy: 1.149 ms, - preprocess: 0.064 ms, - infer: 3.401 ms, - postprocess: 0.456 ms copy: 1.383 ms, - preprocess: 0.055 ms, - infer: 2.712 ms, - postprocess: 0.408 ms copy: 1.188 ms, - preprocess: 0.060 ms, - infer: 2.801 ms, - postprocess: 0.355 ms copy: 0.790 ms, - preprocess: 0.040 ms, - infer: 2.865 ms, - postprocess: 0.395 ms copy: 1.315 ms, - preprocess: 0.041 ms, - infer: 2.711 ms, - postprocess: 0.312 ms copy: 1.016 ms, - preprocess: 0.071 ms, - infer: 2.688 ms, - postprocess: 0.353 ms copy: 1.099 ms, - preprocess: 0.074 ms, - infer: 3.055 ms, - postprocess: 0.476 ms copy: 1.450 ms, - preprocess: 0.077 ms, - infer: 2.807 ms, - postprocess: 0.428 ms copy: 1.060 ms, - preprocess: 0.063 ms, - infer: 2.736 ms, - postprocess: 0.422 ms copy: 1.165 ms, - preprocess: 0.067 ms, - infer: 3.286 ms, - postprocess: 0.384 ms copy: 1.077 ms, - preprocess: 0.074 ms, - infer: 2.992 ms, - postprocess: 0.462 ms copy: 1.144 ms, - preprocess: 0.077 ms, - infer: 2.971 ms, - postprocess: 0.556 ms copy: 1.007 ms, - preprocess: 0.059 ms, - infer: 2.931 ms, - postprocess: 0.352 ms copy: 1.701 ms, - preprocess: 0.139 ms, - infer: 2.917 ms, - postprocess: 0.713 ms copy: 0.804 ms, - preprocess: 0.048 ms, - infer: 3.272 ms, - postprocess: 0.506 ms copy: 0.848 ms, - preprocess: 0.049 ms, - infer: 2.808 ms, - postprocess: 0.423 ms copy: 1.916 ms, - preprocess: 0.087 ms, - infer: 2.844 ms, - postprocess: 0.443 ms copy: 1.543 ms, - preprocess: 0.074 ms, - infer: 2.906 ms, - postprocess: 0.503 ms copy: 2.071 ms, - preprocess: 0.094 ms, - infer: 3.012 ms, - postprocess: 0.473 ms copy: 1.616 ms, - preprocess: 0.098 ms, - infer: 2.999 ms, - postprocess: 0.429 ms copy: 1.363 ms, - preprocess: 0.078 ms, - infer: 2.894 ms, - postprocess: 0.388 ms copy: 1.090 ms, - preprocess: 0.064 ms, - infer: 3.412 ms, - postprocess: 0.492 ms copy: 1.452 ms, - preprocess: 0.088 ms, - infer: 3.614 ms, - postprocess: 0.500 ms copy: 1.386 ms, - preprocess: 0.089 ms, - infer: 2.893 ms, - postprocess: 0.542 ms copy: 1.525 ms, - preprocess: 0.102 ms, - infer: 2.949 ms, - postprocess: 0.475 ms copy: 0.780 ms, - preprocess: 0.052 ms, - infer: 2.700 ms, - postprocess: 0.455 ms copy: 1.705 ms, - preprocess: 0.138 ms, - infer: 3.550 ms, - postprocess: 0.803 ms copy: 0.897 ms, - preprocess: 0.045 ms, - infer: 2.998 ms, - postprocess: 0.369 ms copy: 0.842 ms, - preprocess: 0.043 ms, - infer: 3.074 ms, - postprocess: 0.467 ms copy: 1.786 ms, - preprocess: 0.080 ms, - infer: 2.905 ms, - postprocess: 0.499 ms copy: 0.957 ms, - preprocess: 0.049 ms, - infer: 3.179 ms, - postprocess: 0.346 ms copy: 1.065 ms, - preprocess: 0.041 ms, - infer: 2.746 ms, - postprocess: 0.367 ms copy: 1.123 ms, - preprocess: 0.050 ms, - infer: 2.882 ms, - postprocess: 0.374 ms copy: 1.468 ms, - preprocess: 0.079 ms, - infer: 3.133 ms, - postprocess: 0.466 ms copy: 1.003 ms, - preprocess: 0.049 ms, - infer: 2.702 ms, - postprocess: 0.349 ms copy: 1.513 ms, - preprocess: 0.183 ms, - infer: 3.818 ms, - postprocess: 0.631 ms copy: 1.896 ms, - preprocess: 0.096 ms, - infer: 3.241 ms, - postprocess: 0.673 ms copy: 0.896 ms, - preprocess: 0.059 ms, - infer: 2.786 ms, - postprocess: 0.377 ms copy: 1.449 ms, - preprocess: 0.064 ms, - infer: 2.742 ms, - postprocess: 0.462 ms copy: 1.831 ms, - preprocess: 0.072 ms, - infer: 2.842 ms, - postprocess: 0.420 ms copy: 0.915 ms, - preprocess: 0.051 ms, - infer: 2.738 ms, - postprocess: 0.371 ms copy: 1.255 ms, - preprocess: 0.071 ms, - infer: 2.812 ms, - postprocess: 0.402 ms copy: 1.429 ms, - preprocess: 0.084 ms, - infer: 2.976 ms, - postprocess: 0.564 ms copy: 1.628 ms, - preprocess: 0.087 ms, - infer: 3.636 ms, - postprocess: 0.454 ms copy: 1.556 ms, - preprocess: 0.079 ms, - infer: 3.243 ms, - postprocess: 0.445 ms copy: 1.844 ms, - preprocess: 0.079 ms, - infer: 3.016 ms, - postprocess: 0.567 ms copy: 1.447 ms, - preprocess: 0.079 ms, - infer: 3.287 ms, - postprocess: 0.469 ms copy: 1.891 ms, - preprocess: 0.091 ms, - infer: 2.946 ms, - postprocess: 0.501 ms copy: 1.507 ms, - preprocess: 0.080 ms, - infer: 2.867 ms, - postprocess: 0.480 ms copy: 1.604 ms, - preprocess: 0.089 ms, - infer: 2.898 ms, - postprocess: 0.560 ms copy: 1.547 ms, - preprocess: 0.077 ms, - infer: 3.247 ms, - postprocess: 0.411 ms copy: 1.445 ms, - preprocess: 0.083 ms, - infer: 2.890 ms, - postprocess: 0.431 ms copy: 1.415 ms, - preprocess: 0.081 ms, - infer: 2.831 ms, - postprocess: 0.402 ms copy: 0.936 ms, - preprocess: 0.049 ms, - infer: 2.855 ms, - postprocess: 0.371 ms copy: 1.068 ms, - preprocess: 0.066 ms, - infer: 2.879 ms, - postprocess: 0.426 ms copy: 0.963 ms, - preprocess: 0.051 ms, - infer: 2.705 ms, - postprocess: 0.431 ms copy: 1.907 ms, - preprocess: 0.079 ms, - infer: 3.298 ms, - postprocess: 0.536 ms copy: 0.880 ms, - preprocess: 0.045 ms, - infer: 2.776 ms, - postprocess: 0.418 ms copy: 1.525 ms, - preprocess: 0.056 ms, - infer: 2.780 ms, - postprocess: 0.482 ms copy: 1.562 ms, - preprocess: 0.085 ms, - infer: 2.987 ms, - postprocess: 0.478 ms copy: 1.656 ms, - preprocess: 0.090 ms, - infer: 4.395 ms, - postprocess: 0.617 ms copy: 1.571 ms, - preprocess: 0.091 ms, - infer: 2.904 ms, - postprocess: 0.470 ms copy: 1.423 ms, - preprocess: 0.080 ms, - infer: 2.879 ms, - postprocess: 0.398 ms copy: 1.577 ms, - preprocess: 0.080 ms, - infer: 3.234 ms, - postprocess: 0.501 ms copy: 0.991 ms, - preprocess: 0.056 ms, - infer: 2.764 ms, - postprocess: 0.368 ms copy: 1.493 ms, - preprocess: 0.071 ms, - infer: 3.190 ms, - postprocess: 0.525 ms copy: 1.524 ms, - preprocess: 0.086 ms, - infer: 3.204 ms, - postprocess: 0.543 ms copy: 1.492 ms, - preprocess: 0.089 ms, - infer: 3.259 ms, - postprocess: 0.543 ms copy: 1.554 ms, - preprocess: 0.089 ms, - infer: 4.515 ms, - postprocess: 0.820 ms copy: 1.750 ms, - preprocess: 0.086 ms, - infer: 3.465 ms, - postprocess: 0.458 ms copy: 0.850 ms, - preprocess: 0.050 ms, - infer: 2.714 ms, - postprocess: 0.362 ms copy: 1.398 ms, - preprocess: 0.074 ms, - infer: 2.808 ms, - postprocess: 0.482 ms copy: 1.702 ms, - preprocess: 0.079 ms, - infer: 2.805 ms, - postprocess: 0.445 ms copy: 1.639 ms, - preprocess: 0.079 ms, - infer: 2.903 ms, - postprocess: 0.454 ms copy: 1.605 ms, - preprocess: 0.096 ms, - infer: 3.177 ms, - postprocess: 0.434 ms copy: 1.448 ms, - preprocess: 0.080 ms, - infer: 2.891 ms, - postprocess: 0.405 ms copy: 1.726 ms, - preprocess: 0.089 ms, - infer: 2.929 ms, - postprocess: 0.428 ms copy: 1.513 ms, - preprocess: 0.090 ms, - infer: 2.898 ms, - postprocess: 0.529 ms copy: 1.637 ms, - preprocess: 0.096 ms, - infer: 3.125 ms, - postprocess: 0.477 ms copy: 1.705 ms, - preprocess: 0.104 ms, - infer: 3.307 ms, - postprocess: 0.568 ms copy: 1.520 ms, - preprocess: 0.075 ms, - infer: 2.822 ms, - postprocess: 0.470 ms copy: 1.891 ms, - preprocess: 0.075 ms, - infer: 7.916 ms, - postprocess: 0.712 ms copy: 1.552 ms, - preprocess: 0.075 ms, - infer: 10.377 ms, - postprocess: 0.597 ms copy: 1.450 ms, - preprocess: 0.073 ms, - infer: 9.113 ms, - postprocess: 0.632 ms copy: 1.661 ms, - preprocess: 0.102 ms, - infer: 8.525 ms, - postprocess: 0.762 ms copy: 1.923 ms, - preprocess: 0.097 ms, - infer: 8.240 ms, - postprocess: 0.617 ms copy: 1.540 ms, - preprocess: 0.087 ms, - infer: 8.731 ms, - postprocess: 0.637 ms copy: 1.619 ms, - preprocess: 0.072 ms, - infer: 11.964 ms, - postprocess: 0.687 ms copy: 1.545 ms, - preprocess: 0.072 ms, - infer: 11.431 ms, - postprocess: 0.615 ms copy: 1.445 ms, - preprocess: 0.081 ms, - infer: 8.924 ms, - postprocess: 0.623 ms copy: 1.633 ms, - preprocess: 0.086 ms, - infer: 8.990 ms, - postprocess: 0.691 ms copy: 1.298 ms, - preprocess: 0.067 ms, - infer: 8.209 ms, - postprocess: 0.743 ms copy: 1.560 ms, - preprocess: 0.086 ms, - infer: 10.029 ms, - postprocess: 0.623 ms copy: 1.823 ms, - preprocess: 0.075 ms, - infer: 8.460 ms, - postprocess: 0.602 ms copy: 2.344 ms, - preprocess: 0.068 ms, - infer: 13.186 ms, - postprocess: 0.665 ms copy: 1.852 ms, - preprocess: 0.080 ms, - infer: 13.792 ms, - postprocess: 0.686 ms copy: 1.753 ms, - preprocess: 0.069 ms, - infer: 19.976 ms, - postprocess: 0.653 ms copy: 2.096 ms, - preprocess: 0.091 ms, - infer: 13.315 ms, - postprocess: 0.877 ms copy: 2.704 ms, - preprocess: 0.069 ms, - infer: 13.448 ms, - postprocess: 0.683 ms copy: 1.786 ms, - preprocess: 0.077 ms, - infer: 15.824 ms, - postprocess: 0.785 ms copy: 1.747 ms, - preprocess: 0.068 ms, - infer: 13.364 ms, - postprocess: 0.697 ms copy: 2.313 ms, - preprocess: 0.083 ms, - infer: 13.895 ms, - postprocess: 1.702 ms copy: 1.225 ms, - preprocess: 0.049 ms, - infer: 19.847 ms, - postprocess: 0.613 ms copy: 1.794 ms, - preprocess: 0.081 ms, - infer: 13.535 ms, - postprocess: 0.734 ms copy: 2.554 ms, - preprocess: 0.073 ms, - infer: 13.545 ms, - postprocess: 0.820 ms copy: 1.945 ms, - preprocess: 0.076 ms, - infer: 14.034 ms, - postprocess: 0.823 ms copy: 1.467 ms, - preprocess: 0.062 ms, - infer: 13.837 ms, - postprocess: 0.769 ms copy: 1.892 ms, - preprocess: 0.084 ms, - infer: 13.878 ms, - postprocess: 0.712 ms copy: 1.836 ms, - preprocess: 0.067 ms, - infer: 24.783 ms, - postprocess: 0.668 ms copy: 1.769 ms, - preprocess: 0.067 ms, - infer: 14.089 ms, - postprocess: 0.717 ms copy: 1.858 ms, - preprocess: 0.068 ms, - infer: 14.298 ms, - postprocess: 0.873 ms copy: 1.974 ms, - preprocess: 0.075 ms, - infer: 17.546 ms, - postprocess: 0.702 ms copy: 2.365 ms, - preprocess: 0.082 ms, - infer: 25.993 ms, - postprocess: 3.339 ms copy: 2.342 ms, - preprocess: 0.070 ms, - infer: 21.202 ms, - postprocess: 1.125 ms copy: 2.279 ms, - preprocess: 0.075 ms, - infer: 25.741 ms, - postprocess: 1.193 ms copy: 2.060 ms, - preprocess: 0.072 ms, - infer: 30.792 ms, - postprocess: 1.174 ms copy: 2.326 ms, - preprocess: 0.069 ms, - infer: 25.668 ms, - postprocess: 1.194 ms copy: 2.208 ms, - preprocess: 0.077 ms, - infer: 32.283 ms, - postprocess: 1.335 ms copy: 2.141 ms, - preprocess: 0.071 ms, - infer: 20.916 ms, - postprocess: 1.117 ms copy: 1.656 ms, - preprocess: 0.072 ms, - infer: 35.625 ms, - postprocess: 1.103 ms copy: 2.251 ms, - preprocess: 0.074 ms, - infer: 21.370 ms, - postprocess: 1.266 ms copy: 1.425 ms, - preprocess: 0.047 ms, - infer: 25.668 ms, - postprocess: 1.061 ms copy: 1.959 ms, - preprocess: 0.061 ms, - infer: 27.841 ms, - postprocess: 1.092 ms copy: 1.622 ms, - preprocess: 0.060 ms, - infer: 23.172 ms, - postprocess: 1.341 ms copy: 1.893 ms, - preprocess: 0.062 ms, - infer: 21.296 ms, - postprocess: 1.148 ms copy: 2.114 ms, - preprocess: 0.092 ms, - infer: 21.356 ms, - postprocess: 1.175 ms copy: 1.958 ms, - preprocess: 0.067 ms, - infer: 24.029 ms, - postprocess: 1.160 ms copy: 2.224 ms, - preprocess: 0.065 ms, - infer: 29.107 ms, - postprocess: 1.364 ms copy: 2.005 ms, - preprocess: 0.094 ms, - infer: 32.317 ms, - postprocess: 1.167 ms copy: 2.680 ms, - preprocess: 0.084 ms, - infer: 25.248 ms, - postprocess: 1.168 ms copy: 2.186 ms, - preprocess: 0.088 ms, - infer: 23.497 ms, - postprocess: 1.228 ms copy: 2.362 ms, - preprocess: 0.082 ms, - infer: 25.735 ms, - postprocess: 1.191 ms copy: 1.386 ms, - preprocess: 0.046 ms, - infer: 21.097 ms, - postprocess: 1.318 ms copy: 1.917 ms, - preprocess: 0.059 ms, - infer: 21.212 ms, - postprocess: 1.144 ms copy: 1.856 ms, - preprocess: 0.065 ms, - infer: 22.861 ms, - postprocess: 1.233 ms copy: 1.955 ms, - preprocess: 0.077 ms, - infer: 34.530 ms, - postprocess: 1.138 ms copy: 2.265 ms, - preprocess: 0.062 ms, - infer: 21.288 ms, - postprocess: 1.083 ms copy: 1.933 ms, - preprocess: 0.063 ms, - infer: 26.214 ms, - postprocess: 1.216 ms copy: 1.932 ms, - preprocess: 0.078 ms, - infer: 33.267 ms, - postprocess: 3.214 ms copy: 1.879 ms, - preprocess: 0.065 ms, - infer: 21.437 ms, - postprocess: 1.125 ms copy: 1.780 ms, - preprocess: 0.062 ms, - infer: 20.888 ms, - postprocess: 1.058 ms copy: 1.782 ms, - preprocess: 0.084 ms, - infer: 21.362 ms, - postprocess: 1.130 ms copy: 1.878 ms, - preprocess: 0.065 ms, - infer: 25.753 ms, - postprocess: 1.149 ms copy: 1.359 ms, - preprocess: 0.045 ms, - infer: 21.491 ms, - postprocess: 1.074 ms copy: 1.715 ms, - preprocess: 0.059 ms, - infer: 20.997 ms, - postprocess: 1.084 ms copy: 1.890 ms, - preprocess: 0.073 ms, - infer: 21.102 ms, - postprocess: 1.133 ms copy: 1.826 ms, - preprocess: 0.073 ms, - infer: 21.265 ms, - postprocess: 1.153 ms copy: 2.214 ms, - preprocess: 0.058 ms, - infer: 21.274 ms, - postprocess: 1.129 ms copy: 1.758 ms, - preprocess: 0.062 ms, - infer: 25.212 ms, - postprocess: 1.086 ms copy: 2.050 ms, - preprocess: 0.073 ms, - infer: 24.712 ms, - postprocess: 1.199 ms copy: 2.013 ms, - preprocess: 0.062 ms, - infer: 21.500 ms, - postprocess: 1.176 ms copy: 2.470 ms, - preprocess: 0.082 ms, - infer: 29.893 ms, - postprocess: 1.264 ms copy: 2.408 ms, - preprocess: 0.081 ms, - infer: 21.338 ms, - postprocess: 1.172 ms copy: 2.215 ms, - preprocess: 0.068 ms, - infer: 21.240 ms, - postprocess: 1.287 ms copy: 1.937 ms, - preprocess: 0.066 ms, - infer: 20.920 ms, - postprocess: 1.115 ms copy: 2.063 ms, - preprocess: 0.087 ms, - infer: 27.792 ms, - postprocess: 1.561 ms copy: 3.063 ms, - preprocess: 0.074 ms, - infer: 21.141 ms, - postprocess: 1.515 ms copy: 2.699 ms, - preprocess: 0.069 ms, - infer: 21.937 ms, - postprocess: 1.156 ms copy: 1.362 ms, - preprocess: 0.044 ms, - infer: 31.353 ms, - postprocess: 1.038 ms copy: 1.844 ms, - preprocess: 0.126 ms, - infer: 21.361 ms, - postprocess: 1.215 ms copy: 1.948 ms, - preprocess: 0.079 ms, - infer: 25.203 ms, - postprocess: 0.828 ms copy: 2.253 ms, - preprocess: 0.071 ms, - infer: 17.444 ms, - postprocess: 0.656 ms copy: 2.674 ms, - preprocess: 0.066 ms, - infer: 18.893 ms, - postprocess: 0.690 ms copy: 1.704 ms, - preprocess: 0.101 ms, - infer: 15.877 ms, - postprocess: 0.832 ms copy: 1.996 ms, - preprocess: 0.077 ms, - infer: 14.686 ms, - postprocess: 0.718 ms copy: 1.844 ms, - preprocess: 0.066 ms, - infer: 14.252 ms, - postprocess: 0.700 ms copy: 1.433 ms, - preprocess: 0.062 ms, - infer: 17.132 ms, - postprocess: 0.702 ms copy: 1.737 ms, - preprocess: 0.061 ms, - infer: 14.598 ms, - postprocess: 0.735 ms copy: 2.251 ms, - preprocess: 0.076 ms, - infer: 14.396 ms, - postprocess: 0.851 ms copy: 2.067 ms, - preprocess: 0.087 ms, - infer: 22.577 ms, - postprocess: 0.945 ms copy: 1.945 ms, - preprocess: 0.079 ms, - infer: 17.284 ms, - postprocess: 0.716 ms copy: 1.800 ms, - preprocess: 0.064 ms, - infer: 14.718 ms, - postprocess: 0.930 ms copy: 1.651 ms, - preprocess: 0.063 ms, - infer: 14.670 ms, - postprocess: 0.701 ms copy: 1.675 ms, - preprocess: 0.063 ms, - infer: 14.627 ms, - postprocess: 0.758 ms copy: 1.562 ms, - preprocess: 0.059 ms, - infer: 14.343 ms, - postprocess: 0.707 ms copy: 1.634 ms, - preprocess: 0.062 ms, - infer: 15.184 ms, - postprocess: 0.703 ms copy: 1.619 ms, - preprocess: 0.058 ms, - infer: 18.662 ms, - postprocess: 0.678 ms copy: 2.020 ms, - preprocess: 0.066 ms, - infer: 14.676 ms, - postprocess: 1.132 ms copy: 2.026 ms, - preprocess: 0.045 ms, - infer: 14.556 ms, - postprocess: 0.690 ms copy: 1.818 ms, - preprocess: 0.055 ms, - infer: 15.023 ms, - postprocess: 0.750 ms copy: 2.478 ms, - preprocess: 0.057 ms, - infer: 14.253 ms, - postprocess: 1.229 ms copy: 2.132 ms, - preprocess: 0.077 ms, - infer: 14.556 ms, - postprocess: 0.738 ms copy: 1.908 ms, - preprocess: 0.072 ms, - infer: 19.609 ms, - postprocess: 0.687 ms copy: 1.885 ms, - preprocess: 0.068 ms, - infer: 14.528 ms, - postprocess: 0.837 ms copy: 1.959 ms, - preprocess: 0.071 ms, - infer: 14.680 ms, - postprocess: 0.725 ms copy: 1.874 ms, - preprocess: 0.079 ms, - infer: 14.682 ms, - postprocess: 0.731 ms copy: 2.228 ms, - preprocess: 0.075 ms, - infer: 17.218 ms, - postprocess: 0.804 ms copy: 1.835 ms, - preprocess: 0.068 ms, - infer: 17.184 ms, - postprocess: 0.748 ms copy: 2.153 ms, - preprocess: 0.085 ms, - infer: 14.861 ms, - postprocess: 0.727 ms copy: 1.276 ms, - preprocess: 0.049 ms, - infer: 14.601 ms, - postprocess: 0.695 ms copy: 1.254 ms, - preprocess: 0.051 ms, - infer: 18.069 ms, - postprocess: 0.710 ms copy: 1.837 ms, - preprocess: 0.074 ms, - infer: 27.491 ms, - postprocess: 0.900 ms copy: 2.051 ms, - preprocess: 0.071 ms, - infer: 30.904 ms, - postprocess: 1.202 ms copy: 2.093 ms, - preprocess: 0.095 ms, - infer: 21.451 ms, - postprocess: 1.278 ms copy: 2.301 ms, - preprocess: 0.077 ms, - infer: 28.468 ms, - postprocess: 1.423 ms copy: 1.448 ms, - preprocess: 0.048 ms, - infer: 24.795 ms, - postprocess: 1.205 ms copy: 2.005 ms, - preprocess: 0.063 ms, - infer: 22.759 ms, - postprocess: 1.130 ms copy: 1.970 ms, - preprocess: 0.062 ms, - infer: 50.494 ms, - postprocess: 1.211 ms copy: 1.421 ms, - preprocess: 0.060 ms, - infer: 19.760 ms, - postprocess: 0.735 ms copy: 1.782 ms, - preprocess: 0.060 ms, - infer: 17.340 ms, - postprocess: 0.706 ms copy: 1.250 ms, - preprocess: 0.054 ms, - infer: 17.619 ms, - postprocess: 0.856 ms copy: 2.430 ms, - preprocess: 0.066 ms, - infer: 20.279 ms, - postprocess: 0.740 ms copy: 1.895 ms, - preprocess: 0.072 ms, - infer: 25.548 ms, - postprocess: 0.720 ms copy: 1.702 ms, - preprocess: 0.114 ms, - infer: 20.860 ms, - postprocess: 1.409 ms copy: 2.266 ms, - preprocess: 0.074 ms, - infer: 17.437 ms, - postprocess: 0.729 ms copy: 2.010 ms, - preprocess: 0.078 ms, - infer: 34.700 ms, - postprocess: 1.007 ms copy: 1.855 ms, - preprocess: 0.106 ms, - infer: 21.767 ms, - postprocess: 0.896 ms copy: 1.417 ms, - preprocess: 0.062 ms, - infer: 16.798 ms, - postprocess: 0.721 ms copy: 1.564 ms, - preprocess: 0.049 ms, - infer: 14.625 ms, - postprocess: 1.081 ms copy: 2.237 ms, - preprocess: 0.093 ms, - infer: 20.694 ms, - postprocess: 0.957 ms copy: 1.726 ms, - preprocess: 0.062 ms, - infer: 32.925 ms, - postprocess: 0.803 ms copy: 1.957 ms, - preprocess: 0.059 ms, - infer: 20.203 ms, - postprocess: 0.762 ms copy: 1.664 ms, - preprocess: 0.062 ms, - infer: 18.425 ms, - postprocess: 0.695 ms copy: 1.737 ms, - preprocess: 0.073 ms, - infer: 14.559 ms, - postprocess: 0.827 ms copy: 1.663 ms, - preprocess: 0.066 ms, - infer: 15.439 ms, - postprocess: 0.780 ms copy: 1.243 ms, - preprocess: 0.055 ms, - infer: 13.475 ms, - postprocess: 0.680 ms copy: 1.978 ms, - preprocess: 0.074 ms, - infer: 13.730 ms, - postprocess: 0.676 ms copy: 1.931 ms, - preprocess: 0.067 ms, - infer: 13.835 ms, - postprocess: 0.703 ms copy: 1.511 ms, - preprocess: 0.062 ms, - infer: 15.961 ms, - postprocess: 0.718 ms copy: 3.626 ms, - preprocess: 0.075 ms, - infer: 19.501 ms, - postprocess: 0.964 ms copy: 1.751 ms, - preprocess: 0.068 ms, - infer: 15.198 ms, - postprocess: 0.696 ms copy: 1.791 ms, - preprocess: 0.074 ms, - infer: 13.962 ms, - postprocess: 0.714 ms copy: 1.904 ms, - preprocess: 0.084 ms, - infer: 19.808 ms, - postprocess: 0.735 ms copy: 2.128 ms, - preprocess: 0.074 ms, - infer: 22.877 ms, - postprocess: 3.279 ms copy: 1.941 ms, - preprocess: 0.069 ms, - infer: 21.859 ms, - postprocess: 0.762 ms copy: 2.250 ms, - preprocess: 0.072 ms, - infer: 16.579 ms, - postprocess: 0.698 ms copy: 1.838 ms, - preprocess: 0.067 ms, - infer: 30.826 ms, - postprocess: 0.709 ms copy: 1.586 ms, - preprocess: 0.062 ms, - infer: 29.099 ms, - postprocess: 0.705 ms copy: 1.914 ms, - preprocess: 0.078 ms, - infer: 20.668 ms, - postprocess: 0.666 ms copy: 2.193 ms, - preprocess: 0.069 ms, - infer: 14.113 ms, - postprocess: 0.986 ms copy: 1.662 ms, - preprocess: 0.060 ms, - infer: 18.840 ms, - postprocess: 0.707 ms copy: 1.669 ms, - preprocess: 0.076 ms, - infer: 23.782 ms, - postprocess: 0.677 ms copy: 2.090 ms, - preprocess: 0.082 ms, - infer: 17.516 ms, - postprocess: 0.694 ms copy: 1.703 ms, - preprocess: 0.066 ms, - infer: 15.466 ms, - postprocess: 0.621 ms copy: 1.663 ms, - preprocess: 0.072 ms, - infer: 14.389 ms, - postprocess: 0.737 ms copy: 1.831 ms, - preprocess: 0.056 ms, - infer: 17.134 ms, - postprocess: 0.642 ms copy: 1.298 ms, - preprocess: 0.062 ms, - infer: 16.373 ms, - postprocess: 0.686 ms copy: 1.551 ms, - preprocess: 0.065 ms, - infer: 21.248 ms, - postprocess: 4.269 ms copy: 1.697 ms, - preprocess: 0.059 ms, - infer: 18.801 ms, - postprocess: 1.098 ms copy: 1.248 ms, - preprocess: 0.062 ms, - infer: 7.251 ms, - postprocess: 0.626 ms copy: 1.193 ms, - preprocess: 0.069 ms, - infer: 8.871 ms, - postprocess: 0.671 ms copy: 0.840 ms, - preprocess: 0.041 ms, - infer: 7.125 ms, - postprocess: 0.521 ms copy: 1.293 ms, - preprocess: 0.060 ms, - infer: 9.325 ms, - postprocess: 0.591 ms copy: 1.271 ms, - preprocess: 0.066 ms, - infer: 7.199 ms, - postprocess: 0.524 ms copy: 1.393 ms, - preprocess: 0.088 ms, - infer: 7.218 ms, - postprocess: 0.559 ms copy: 1.392 ms, - preprocess: 0.067 ms, - infer: 8.192 ms, - postprocess: 0.751 ms copy: 1.363 ms, - preprocess: 0.078 ms, - infer: 8.907 ms, - postprocess: 0.589 ms copy: 1.363 ms, - preprocess: 0.056 ms, - infer: 7.602 ms, - postprocess: 0.573 ms copy: 0.912 ms, - preprocess: 0.064 ms, - infer: 10.278 ms, - postprocess: 0.543 ms copy: 1.519 ms, - preprocess: 0.062 ms, - infer: 7.166 ms, - postprocess: 0.567 ms copy: 1.420 ms, - preprocess: 0.076 ms, - infer: 14.824 ms, - postprocess: 0.579 ms copy: 1.265 ms, - preprocess: 0.062 ms, - infer: 8.595 ms, - postprocess: 0.543 ms copy: 0.825 ms, - preprocess: 0.038 ms, - infer: 7.093 ms, - postprocess: 0.460 ms copy: 0.852 ms, - preprocess: 0.038 ms, - infer: 7.070 ms, - postprocess: 0.522 ms copy: 1.332 ms, - preprocess: 0.064 ms, - infer: 7.200 ms, - postprocess: 0.517 ms copy: 1.201 ms, - preprocess: 0.062 ms, - infer: 7.194 ms, - postprocess: 1.673 ms copy: 1.503 ms, - preprocess: 0.086 ms, - infer: 7.189 ms, - postprocess: 0.563 ms copy: 1.276 ms, - preprocess: 0.066 ms, - infer: 7.291 ms, - postprocess: 0.544 ms copy: 1.345 ms, - preprocess: 0.066 ms, - infer: 7.264 ms, - postprocess: 0.586 ms copy: 1.314 ms, - preprocess: 0.078 ms, - infer: 7.241 ms, - postprocess: 0.534 ms copy: 1.268 ms, - preprocess: 0.057 ms, - infer: 7.177 ms, - postprocess: 0.582 ms copy: 1.083 ms, - preprocess: 0.052 ms, - infer: 7.691 ms, - postprocess: 0.595 ms copy: 1.310 ms, - preprocess: 0.069 ms, - infer: 12.187 ms, - postprocess: 0.590 ms copy: 1.521 ms, - preprocess: 0.065 ms, - infer: 7.185 ms, - postprocess: 0.544 ms copy: 1.527 ms, - preprocess: 0.079 ms, - infer: 7.358 ms, - postprocess: 0.721 ms copy: 0.995 ms, - preprocess: 0.049 ms, - infer: 9.110 ms, - postprocess: 0.549 ms copy: 1.743 ms, - preprocess: 0.072 ms, - infer: 12.078 ms, - postprocess: 0.568 ms copy: 0.903 ms, - preprocess: 0.043 ms, - infer: 10.742 ms, - postprocess: 0.501 ms copy: 1.444 ms, - preprocess: 0.069 ms, - infer: 8.765 ms, - postprocess: 0.566 ms copy: 1.850 ms, - preprocess: 0.074 ms, - infer: 23.044 ms, - postprocess: 0.689 ms copy: 1.527 ms, - preprocess: 0.063 ms, - infer: 17.135 ms, - postprocess: 0.676 ms copy: 1.222 ms, - preprocess: 0.048 ms, - infer: 17.052 ms, - postprocess: 0.659 ms copy: 1.735 ms, - preprocess: 0.064 ms, - infer: 108.521 ms, - postprocess: 0.413 ms copy: 0.723 ms, - preprocess: 0.045 ms, - infer: 2.687 ms, - postprocess: 0.352 ms copy: 1.602 ms, - preprocess: 0.076 ms, - infer: 3.324 ms, - postprocess: 0.440 ms copy: 1.189 ms, - preprocess: 0.071 ms, - infer: 3.633 ms, - postprocess: 0.383 ms copy: 1.243 ms, - preprocess: 0.071 ms, - infer: 2.809 ms, - postprocess: 0.357 ms copy: 0.747 ms, - preprocess: 0.043 ms, - infer: 2.807 ms, - postprocess: 0.661 ms copy: 0.830 ms, - preprocess: 0.044 ms, - infer: 3.465 ms, - postprocess: 0.369 ms copy: 1.957 ms, - preprocess: 0.062 ms, - infer: 3.682 ms, - postprocess: 0.642 ms copy: 1.519 ms, - preprocess: 0.063 ms, - infer: 3.478 ms, - postprocess: 0.532 ms copy: 1.383 ms, - preprocess: 0.079 ms, - infer: 3.049 ms, - postprocess: 0.824 ms copy: 1.187 ms, - preprocess: 0.081 ms, - infer: 3.091 ms, - postprocess: 0.552 ms copy: 1.094 ms, - preprocess: 0.068 ms, - infer: 2.750 ms, - postprocess: 0.469 ms copy: 0.690 ms, - preprocess: 0.041 ms, - infer: 3.891 ms, - postprocess: 0.375 ms copy: 1.700 ms, - preprocess: 0.061 ms, - infer: 2.927 ms, - postprocess: 0.433 ms copy: 1.199 ms, - preprocess: 0.069 ms, - infer: 2.682 ms, - postprocess: 0.411 ms copy: 1.002 ms, - preprocess: 0.062 ms, - infer: 2.635 ms, - postprocess: 0.381 ms copy: 1.137 ms, - preprocess: 0.064 ms, - infer: 2.852 ms, - postprocess: 0.579 ms copy: 1.174 ms, - preprocess: 0.065 ms, - infer: 2.809 ms, - postprocess: 0.396 ms copy: 1.089 ms, - preprocess: 0.064 ms, - infer: 3.054 ms, - postprocess: 0.421 ms copy: 1.164 ms, - preprocess: 0.066 ms, - infer: 3.411 ms, - postprocess: 0.456 ms copy: 1.237 ms, - preprocess: 0.068 ms, - infer: 3.031 ms, - postprocess: 0.391 ms copy: 1.289 ms, - preprocess: 0.064 ms, - infer: 2.974 ms, - postprocess: 0.357 ms copy: 0.991 ms, - preprocess: 0.057 ms, - infer: 2.751 ms, - postprocess: 0.459 ms copy: 1.340 ms, - preprocess: 0.073 ms, - infer: 3.349 ms, - postprocess: 0.536 ms copy: 0.906 ms, - preprocess: 0.052 ms, - infer: 2.714 ms, - postprocess: 0.395 ms copy: 1.230 ms, - preprocess: 0.073 ms, - infer: 3.317 ms, - postprocess: 0.445 ms copy: 1.384 ms, - preprocess: 0.058 ms, - infer: 2.952 ms, - postprocess: 0.612 ms copy: 1.151 ms, - preprocess: 0.070 ms, - infer: 2.744 ms, - postprocess: 0.369 ms copy: 1.181 ms, - preprocess: 0.070 ms, - infer: 3.544 ms, - postprocess: 0.388 ms copy: 1.230 ms, - preprocess: 0.068 ms, - infer: 2.775 ms, - postprocess: 0.400 ms copy: 0.812 ms, - preprocess: 0.047 ms, - infer: 2.659 ms, - postprocess: 0.417 ms copy: 1.353 ms, - preprocess: 0.072 ms, - infer: 2.759 ms, - postprocess: 0.364 ms copy: 1.308 ms, - preprocess: 0.079 ms, - infer: 2.792 ms, - postprocess: 0.466 ms copy: 1.476 ms, - preprocess: 0.096 ms, - infer: 3.295 ms, - postprocess: 0.513 ms copy: 1.391 ms, - preprocess: 0.078 ms, - infer: 2.902 ms, - postprocess: 0.445 ms copy: 1.552 ms, - preprocess: 0.074 ms, - infer: 3.258 ms, - postprocess: 0.403 ms copy: 1.015 ms, - preprocess: 0.046 ms, - infer: 2.911 ms, - postprocess: 0.380 ms copy: 1.168 ms, - preprocess: 0.064 ms, - infer: 3.479 ms, - postprocess: 0.465 ms copy: 1.748 ms, - preprocess: 0.063 ms, - infer: 14.500 ms, - postprocess: 0.736 ms copy: 1.151 ms, - preprocess: 0.043 ms, - infer: 20.359 ms, - postprocess: 0.719 ms copy: 1.697 ms, - preprocess: 0.070 ms, - infer: 14.435 ms, - postprocess: 0.761 ms copy: 2.075 ms, - preprocess: 0.060 ms, - infer: 15.849 ms, - postprocess: 0.946 ms copy: 1.732 ms, - preprocess: 0.064 ms, - infer: 14.388 ms, - postprocess: 0.727 ms copy: 2.109 ms, - preprocess: 0.079 ms, - infer: 18.983 ms, - postprocess: 0.823 ms copy: 2.533 ms, - preprocess: 0.063 ms, - infer: 24.606 ms, - postprocess: 0.681 ms copy: 2.247 ms, - preprocess: 0.071 ms, - infer: 18.034 ms, - postprocess: 1.020 ms copy: 1.247 ms, - preprocess: 0.048 ms, - infer: 14.429 ms, - postprocess: 0.726 ms copy: 1.792 ms, - preprocess: 0.060 ms, - infer: 14.530 ms, - postprocess: 0.931 ms copy: 2.366 ms, - preprocess: 0.083 ms, - infer: 14.545 ms, - postprocess: 0.729 ms copy: 1.677 ms, - preprocess: 0.057 ms, - infer: 17.083 ms, - postprocess: 0.999 ms copy: 1.653 ms, - preprocess: 0.063 ms, - infer: 22.552 ms, - postprocess: 0.691 ms copy: 1.566 ms, - preprocess: 0.079 ms, - infer: 18.022 ms, - postprocess: 0.720 ms copy: 1.158 ms, - preprocess: 0.043 ms, - infer: 21.065 ms, - postprocess: 0.748 ms copy: 1.592 ms, - preprocess: 0.077 ms, - infer: 16.409 ms, - postprocess: 0.811 ms copy: 1.178 ms, - preprocess: 0.043 ms, - infer: 15.816 ms, - postprocess: 1.949 ms copy: 1.450 ms, - preprocess: 0.042 ms, - infer: 17.133 ms, - postprocess: 0.704 ms copy: 1.559 ms, - preprocess: 0.057 ms, - infer: 16.503 ms, - postprocess: 0.723 ms copy: 1.361 ms, - preprocess: 0.057 ms, - infer: 20.441 ms, - postprocess: 1.137 ms copy: 2.026 ms, - preprocess: 0.057 ms, - infer: 19.511 ms, - postprocess: 0.699 ms copy: 1.673 ms, - preprocess: 0.065 ms, - infer: 14.661 ms, - postprocess: 0.773 ms copy: 1.644 ms, - preprocess: 0.060 ms, - infer: 17.406 ms, - postprocess: 0.781 ms copy: 1.180 ms, - preprocess: 0.044 ms, - infer: 14.395 ms, - postprocess: 0.658 ms copy: 1.507 ms, - preprocess: 0.066 ms, - infer: 14.432 ms, - postprocess: 0.817 ms copy: 2.010 ms, - preprocess: 0.058 ms, - infer: 14.434 ms, - postprocess: 0.704 ms copy: 1.478 ms, - preprocess: 0.062 ms, - infer: 14.608 ms, - postprocess: 0.811 ms copy: 1.919 ms, - preprocess: 0.073 ms, - infer: 21.559 ms, - postprocess: 1.001 ms copy: 1.220 ms, - preprocess: 0.052 ms, - infer: 28.607 ms, - postprocess: 0.738 ms copy: 1.700 ms, - preprocess: 0.045 ms, - infer: 14.358 ms, - postprocess: 0.989 ms copy: 1.202 ms, - preprocess: 0.043 ms, - infer: 14.549 ms, - postprocess: 0.676 ms copy: 2.253 ms, - preprocess: 0.076 ms, - infer: 14.572 ms, - postprocess: 1.263 ms copy: 1.638 ms, - preprocess: 0.063 ms, - infer: 14.961 ms, - postprocess: 0.772 ms copy: 1.262 ms, - preprocess: 0.056 ms, - infer: 14.446 ms, - postprocess: 0.694 ms copy: 1.644 ms, - preprocess: 0.055 ms, - infer: 18.422 ms, - postprocess: 0.716 ms copy: 1.848 ms, - preprocess: 0.078 ms, - infer: 15.361 ms, - postprocess: 2.198 ms copy: 1.263 ms, - preprocess: 0.050 ms, - infer: 21.399 ms, - postprocess: 0.734 ms copy: 2.351 ms, - preprocess: 0.084 ms, - infer: 14.489 ms, - postprocess: 0.868 ms copy: 1.761 ms, - preprocess: 0.068 ms, - infer: 16.719 ms, - postprocess: 0.695 ms copy: 2.026 ms, - preprocess: 0.058 ms, - infer: 24.740 ms, - postprocess: 0.663 ms copy: 2.039 ms, - preprocess: 0.059 ms, - infer: 14.421 ms, - postprocess: 0.917 ms copy: 1.865 ms, - preprocess: 0.078 ms, - infer: 14.502 ms, - postprocess: 0.972 ms copy: 1.654 ms, - preprocess: 0.071 ms, - infer: 14.443 ms, - postprocess: 0.805 ms copy: 1.855 ms, - preprocess: 0.055 ms, - infer: 14.608 ms, - postprocess: 1.102 ms copy: 2.648 ms, - preprocess: 0.120 ms, - infer: 17.511 ms, - postprocess: 0.730 ms copy: 1.757 ms, - preprocess: 0.074 ms, - infer: 16.602 ms, - postprocess: 0.854 ms copy: 2.241 ms, - preprocess: 0.087 ms, - infer: 15.174 ms, - postprocess: 1.370 ms copy: 1.837 ms, - preprocess: 0.078 ms, - infer: 14.608 ms, - postprocess: 0.767 ms copy: 1.760 ms, - preprocess: 0.073 ms, - infer: 14.533 ms, - postprocess: 0.753 ms copy: 1.811 ms, - preprocess: 0.065 ms, - infer: 15.627 ms, - postprocess: 0.804 ms copy: 1.872 ms, - preprocess: 0.091 ms, - infer: 14.649 ms, - postprocess: 0.797 ms copy: 2.139 ms, - preprocess: 0.066 ms, - infer: 14.706 ms, - postprocess: 0.711 ms copy: 1.885 ms, - preprocess: 0.070 ms, - infer: 14.601 ms, - postprocess: 0.720 ms copy: 1.565 ms, - preprocess: 0.065 ms, - infer: 23.535 ms, - postprocess: 0.800 ms copy: 1.901 ms, - preprocess: 0.069 ms, - infer: 15.601 ms, - postprocess: 0.797 ms copy: 1.719 ms, - preprocess: 0.076 ms, - infer: 14.386 ms, - postprocess: 0.711 ms copy: 2.181 ms, - preprocess: 0.072 ms, - infer: 14.547 ms, - postprocess: 0.776 ms copy: 1.573 ms, - preprocess: 0.062 ms, - infer: 14.431 ms, - postprocess: 0.825 ms copy: 1.702 ms, - preprocess: 0.066 ms, - infer: 19.902 ms, - postprocess: 0.876 ms copy: 1.929 ms, - preprocess: 0.073 ms, - infer: 17.590 ms, - postprocess: 0.751 ms copy: 1.283 ms, - preprocess: 0.061 ms, - infer: 19.243 ms, - postprocess: 0.750 ms copy: 1.669 ms, - preprocess: 0.073 ms, - infer: 24.934 ms, - postprocess: 0.751 ms copy: 1.573 ms, - preprocess: 0.059 ms, - infer: 17.829 ms, - postprocess: 0.711 ms copy: 1.917 ms, - preprocess: 0.059 ms, - infer: 20.903 ms, - postprocess: 0.700 ms copy: 1.734 ms, - preprocess: 0.065 ms, - infer: 14.198 ms, - postprocess: 0.749 ms copy: 1.825 ms, - preprocess: 0.066 ms, - infer: 14.135 ms, - postprocess: 0.676 ms copy: 2.041 ms, - preprocess: 0.081 ms, - infer: 18.345 ms, - postprocess: 0.761 ms copy: 1.347 ms, - preprocess: 0.088 ms, - infer: 16.948 ms, - postprocess: 0.777 ms copy: 1.613 ms, - preprocess: 0.065 ms, - infer: 16.224 ms, - postprocess: 0.770 ms copy: 2.191 ms, - preprocess: 0.101 ms, - infer: 14.283 ms, - postprocess: 0.695 ms copy: 1.993 ms, - preprocess: 0.101 ms, - infer: 14.265 ms, - postprocess: 0.692 ms copy: 2.102 ms, - preprocess: 0.066 ms, - infer: 14.342 ms, - postprocess: 1.030 ms copy: 1.604 ms, - preprocess: 0.063 ms, - infer: 14.189 ms, - postprocess: 0.721 ms copy: 1.545 ms, - preprocess: 0.059 ms, - infer: 16.670 ms, - postprocess: 0.781 ms copy: 1.555 ms, - preprocess: 0.058 ms, - infer: 14.439 ms, - postprocess: 0.737 ms copy: 1.414 ms, - preprocess: 0.059 ms, - infer: 14.421 ms, - postprocess: 0.726 ms copy: 1.205 ms, - preprocess: 0.046 ms, - infer: 14.048 ms, - postprocess: 0.668 ms copy: 1.943 ms, - preprocess: 0.076 ms, - infer: 17.082 ms, - postprocess: 2.973 ms copy: 1.849 ms, - preprocess: 0.069 ms, - infer: 24.450 ms, - postprocess: 0.703 ms copy: 2.186 ms, - preprocess: 0.079 ms, - infer: 16.782 ms, - postprocess: 0.767 ms copy: 1.218 ms, - preprocess: 0.048 ms, - infer: 17.725 ms, - postprocess: 0.706 ms copy: 2.148 ms, - preprocess: 0.062 ms, - infer: 17.132 ms, - postprocess: 0.772 ms copy: 1.711 ms, - preprocess: 0.067 ms, - infer: 47.123 ms, - postprocess: 0.723 ms copy: 2.326 ms, - preprocess: 0.043 ms, - infer: 28.176 ms, - postprocess: 0.739 ms copy: 1.653 ms, - preprocess: 0.060 ms, - infer: 25.590 ms, - postprocess: 0.688 ms copy: 1.532 ms, - preprocess: 0.058 ms, - infer: 13.285 ms, - postprocess: 1.275 ms copy: 1.557 ms, - preprocess: 0.060 ms, - infer: 17.017 ms, - postprocess: 0.714 ms copy: 1.420 ms, - preprocess: 0.062 ms, - infer: 12.917 ms, - postprocess: 0.621 ms copy: 1.410 ms, - preprocess: 0.043 ms, - infer: 18.640 ms, - postprocess: 0.599 ms copy: 1.709 ms, - preprocess: 0.069 ms, - infer: 13.564 ms, - postprocess: 0.863 ms copy: 1.770 ms, - preprocess: 0.071 ms, - infer: 13.243 ms, - postprocess: 0.678 ms copy: 1.723 ms, - preprocess: 0.068 ms, - infer: 13.077 ms, - postprocess: 0.737 ms copy: 1.863 ms, - preprocess: 0.110 ms, - infer: 13.213 ms, - postprocess: 0.667 ms copy: 1.862 ms, - preprocess: 0.075 ms, - infer: 15.182 ms, - postprocess: 0.726 ms copy: 1.957 ms, - preprocess: 0.121 ms, - infer: 13.020 ms, - postprocess: 0.727 ms copy: 1.835 ms, - preprocess: 0.070 ms, - infer: 13.185 ms, - postprocess: 0.674 ms copy: 1.429 ms, - preprocess: 0.062 ms, - infer: 13.067 ms, - postprocess: 0.733 ms copy: 1.284 ms, - preprocess: 0.046 ms, - infer: 12.901 ms, - postprocess: 0.695 ms copy: 1.138 ms, - preprocess: 0.046 ms, - infer: 12.768 ms, - postprocess: 0.598 ms copy: 1.849 ms, - preprocess: 0.063 ms, - infer: 13.321 ms, - postprocess: 0.639 ms copy: 1.833 ms, - preprocess: 0.079 ms, - infer: 13.007 ms, - postprocess: 1.698 ms copy: 1.209 ms, - preprocess: 0.050 ms, - infer: 15.543 ms, - postprocess: 0.674 ms copy: 1.884 ms, - preprocess: 0.080 ms, - infer: 13.076 ms, - postprocess: 0.624 ms copy: 1.969 ms, - preprocess: 0.085 ms, - infer: 12.853 ms, - postprocess: 0.710 ms copy: 1.829 ms, - preprocess: 0.066 ms, - infer: 19.148 ms, - postprocess: 0.783 ms copy: 1.473 ms, - preprocess: 0.062 ms, - infer: 20.258 ms, - postprocess: 0.621 ms copy: 2.236 ms, - preprocess: 0.085 ms, - infer: 13.471 ms, - postprocess: 0.666 ms copy: 1.468 ms, - preprocess: 0.062 ms, - infer: 16.532 ms, - postprocess: 0.665 ms copy: 1.929 ms, - preprocess: 0.085 ms, - infer: 17.169 ms, - postprocess: 0.701 ms copy: 1.759 ms, - preprocess: 0.067 ms, - infer: 16.528 ms, - postprocess: 0.677 ms copy: 1.808 ms, - preprocess: 0.073 ms, - infer: 18.539 ms, - postprocess: 0.718 ms copy: 1.819 ms, - preprocess: 0.081 ms, - infer: 17.782 ms, - postprocess: 0.754 ms copy: 1.990 ms, - preprocess: 0.085 ms, - infer: 14.064 ms, - postprocess: 0.781 ms copy: 2.091 ms, - preprocess: 0.077 ms, - infer: 14.203 ms, - postprocess: 0.787 ms copy: 1.115 ms, - preprocess: 0.048 ms, - infer: 13.604 ms, - postprocess: 0.623 ms copy: 1.370 ms, - preprocess: 0.050 ms, - infer: 14.174 ms, - postprocess: 0.669 ms copy: 2.657 ms, - preprocess: 0.064 ms, - infer: 13.832 ms, - postprocess: 1.067 ms copy: 1.842 ms, - preprocess: 0.072 ms, - infer: 19.508 ms, - postprocess: 0.727 ms copy: 2.230 ms, - preprocess: 0.066 ms, - infer: 16.888 ms, - postprocess: 0.675 ms copy: 1.597 ms, - preprocess: 0.064 ms, - infer: 17.800 ms, - postprocess: 0.661 ms copy: 1.734 ms, - preprocess: 0.076 ms, - infer: 14.034 ms, - postprocess: 0.678 ms copy: 2.007 ms, - preprocess: 0.081 ms, - infer: 14.194 ms, - postprocess: 0.779 ms copy: 2.028 ms, - preprocess: 0.065 ms, - infer: 14.237 ms, - postprocess: 0.739 ms copy: 1.927 ms, - preprocess: 0.070 ms, - infer: 17.039 ms, - postprocess: 0.699 ms copy: 1.785 ms, - preprocess: 0.066 ms, - infer: 17.290 ms, - postprocess: 0.732 ms copy: 2.367 ms, - preprocess: 0.077 ms, - infer: 18.768 ms, - postprocess: 1.937 ms copy: 1.641 ms, - preprocess: 0.063 ms, - infer: 17.120 ms, - postprocess: 0.777 ms copy: 1.814 ms, - preprocess: 0.057 ms, - infer: 22.101 ms, - postprocess: 0.707 ms copy: 2.573 ms, - preprocess: 0.043 ms, - infer: 33.762 ms, - postprocess: 0.716 ms copy: 1.534 ms, - preprocess: 0.044 ms, - infer: 19.761 ms, - postprocess: 0.790 ms copy: 3.212 ms, - preprocess: 0.061 ms, - infer: 22.938 ms, - postprocess: 0.703 ms copy: 1.606 ms, - preprocess: 0.062 ms, - infer: 36.869 ms, - postprocess: 0.747 ms copy: 1.627 ms, - preprocess: 0.064 ms, - infer: 15.999 ms, - postprocess: 0.667 ms copy: 1.579 ms, - preprocess: 0.061 ms, - infer: 21.645 ms, - postprocess: 1.121 ms copy: 1.125 ms, - preprocess: 0.043 ms, - infer: 13.384 ms, - postprocess: 0.618 ms copy: 1.139 ms, - preprocess: 0.042 ms, - infer: 18.515 ms, - postprocess: 0.605 ms copy: 1.853 ms, - preprocess: 0.071 ms, - infer: 15.012 ms, - postprocess: 0.669 ms copy: 1.954 ms, - preprocess: 0.066 ms, - infer: 13.084 ms, - postprocess: 1.937 ms copy: 1.340 ms, - preprocess: 0.067 ms, - infer: 15.988 ms, - postprocess: 0.747 ms copy: 1.190 ms, - preprocess: 0.042 ms, - infer: 24.327 ms, - postprocess: 0.634 ms copy: 1.113 ms, - preprocess: 0.042 ms, - infer: 14.692 ms, - postprocess: 1.546 ms copy: 1.540 ms, - preprocess: 0.054 ms, - infer: 15.881 ms, - postprocess: 0.610 ms copy: 1.566 ms, - preprocess: 0.063 ms, - infer: 20.903 ms, - postprocess: 0.651 ms copy: 1.756 ms, - preprocess: 0.074 ms, - infer: 16.380 ms, - postprocess: 0.808 ms copy: 1.371 ms, - preprocess: 0.060 ms, - infer: 13.342 ms, - postprocess: 0.683 ms copy: 1.697 ms, - preprocess: 0.062 ms, - infer: 13.301 ms, - postprocess: 0.618 ms copy: 1.851 ms, - preprocess: 0.079 ms, - infer: 13.322 ms, - postprocess: 0.637 ms copy: 1.970 ms, - preprocess: 0.064 ms, - infer: 13.164 ms, - postprocess: 0.671 ms copy: 1.384 ms, - preprocess: 0.062 ms, - infer: 13.421 ms, - postprocess: 0.611 ms copy: 1.806 ms, - preprocess: 0.070 ms, - infer: 13.172 ms, - postprocess: 0.704 ms copy: 2.859 ms, - preprocess: 0.136 ms, - infer: 19.081 ms, - postprocess: 0.867 ms copy: 1.632 ms, - preprocess: 0.065 ms, - infer: 13.077 ms, - postprocess: 0.676 ms copy: 2.133 ms, - preprocess: 0.100 ms, - infer: 13.279 ms, - postprocess: 0.683 ms copy: 2.020 ms, - preprocess: 0.080 ms, - infer: 13.300 ms, - postprocess: 0.738 ms copy: 1.474 ms, - preprocess: 0.071 ms, - infer: 16.909 ms, - postprocess: 1.408 ms copy: 2.032 ms, - preprocess: 0.070 ms, - infer: 19.585 ms, - postprocess: 0.724 ms copy: 1.964 ms, - preprocess: 0.078 ms, - infer: 15.640 ms, - postprocess: 0.714 ms copy: 1.459 ms, - preprocess: 0.049 ms, - infer: 14.117 ms, - postprocess: 0.665 ms copy: 2.192 ms, - preprocess: 0.080 ms, - infer: 14.686 ms, - postprocess: 0.833 ms copy: 1.227 ms, - preprocess: 0.053 ms, - infer: 16.887 ms, - postprocess: 1.976 ms copy: 2.031 ms, - preprocess: 0.063 ms, - infer: 19.794 ms, - postprocess: 0.941 ms copy: 1.637 ms, - preprocess: 0.065 ms, - infer: 15.525 ms, - postprocess: 0.758 ms copy: 1.686 ms, - preprocess: 0.064 ms, - infer: 14.120 ms, - postprocess: 0.674 ms copy: 1.851 ms, - preprocess: 0.067 ms, - infer: 14.327 ms, - postprocess: 0.689 ms copy: 1.921 ms, - preprocess: 0.080 ms, - infer: 38.119 ms, - postprocess: 1.039 ms copy: 2.811 ms, - preprocess: 0.064 ms, - infer: 15.085 ms, - postprocess: 0.943 ms copy: 1.369 ms, - preprocess: 0.062 ms, - infer: 19.262 ms, - postprocess: 0.728 ms copy: 1.879 ms, - preprocess: 0.061 ms, - infer: 17.559 ms, - postprocess: 0.740 ms copy: 1.644 ms, - preprocess: 0.065 ms, - infer: 19.897 ms, - postprocess: 1.762 ms copy: 1.738 ms, - preprocess: 0.067 ms, - infer: 17.059 ms, - postprocess: 0.729 ms copy: 1.695 ms, - preprocess: 0.063 ms, - infer: 14.152 ms, - postprocess: 0.804 ms copy: 1.735 ms, - preprocess: 0.063 ms, - infer: 15.104 ms, - postprocess: 1.261 ms copy: 1.718 ms, - preprocess: 0.074 ms, - infer: 14.650 ms, - postprocess: 0.802 ms copy: 2.268 ms, - preprocess: 0.079 ms, - infer: 18.683 ms, - postprocess: 0.914 ms copy: 1.910 ms, - preprocess: 0.067 ms, - infer: 25.717 ms, - postprocess: 0.984 ms copy: 1.877 ms, - preprocess: 0.069 ms, - infer: 40.010 ms, - postprocess: 0.742 ms copy: 1.746 ms, - preprocess: 0.074 ms, - infer: 14.074 ms, - postprocess: 0.652 ms copy: 1.848 ms, - preprocess: 0.067 ms, - infer: 14.108 ms, - postprocess: 1.046 ms copy: 1.900 ms, - preprocess: 0.063 ms, - infer: 19.507 ms, - postprocess: 0.738 ms copy: 1.995 ms, - preprocess: 0.075 ms, - infer: 28.842 ms, - postprocess: 0.687 ms copy: 1.954 ms, - preprocess: 0.081 ms, - infer: 14.232 ms, - postprocess: 0.743 ms copy: 1.883 ms, - preprocess: 0.080 ms, - infer: 23.139 ms, - postprocess: 0.771 ms copy: 2.039 ms, - preprocess: 0.139 ms, - infer: 14.697 ms, - postprocess: 0.943 ms copy: 1.999 ms, - preprocess: 0.086 ms, - infer: 14.271 ms, - postprocess: 0.747 ms copy: 2.350 ms, - preprocess: 0.073 ms, - infer: 14.167 ms, - postprocess: 0.800 ms copy: 2.016 ms, - preprocess: 0.092 ms, - infer: 27.721 ms, - postprocess: 0.849 ms copy: 2.536 ms, - preprocess: 0.076 ms, - infer: 14.275 ms, - postprocess: 0.973 ms copy: 1.225 ms, - preprocess: 0.052 ms, - infer: 20.683 ms, - postprocess: 0.701 ms copy: 1.800 ms, - preprocess: 0.059 ms, - infer: 15.740 ms, - postprocess: 0.717 ms copy: 1.857 ms, - preprocess: 0.065 ms, - infer: 35.393 ms, - postprocess: 0.705 ms copy: 1.349 ms, - preprocess: 0.061 ms, - infer: 20.716 ms, - postprocess: 0.686 ms copy: 1.326 ms, - preprocess: 0.055 ms, - infer: 20.517 ms, - postprocess: 0.673 ms copy: 1.315 ms, - preprocess: 0.057 ms, - infer: 19.412 ms, - postprocess: 0.717 ms copy: 1.625 ms, - preprocess: 0.071 ms, - infer: 22.023 ms, - postprocess: 0.833 ms copy: 1.932 ms, - preprocess: 0.063 ms, - infer: 13.913 ms, - postprocess: 0.958 ms copy: 1.118 ms, - preprocess: 0.041 ms, - infer: 20.092 ms, - postprocess: 0.725 ms copy: 1.778 ms, - preprocess: 0.049 ms, - infer: 20.764 ms, - postprocess: 0.714 ms copy: 1.410 ms, - preprocess: 0.079 ms, - infer: 2.890 ms, - postprocess: 0.528 ms copy: 0.960 ms, - preprocess: 0.061 ms, - infer: 3.080 ms, - postprocess: 0.490 ms copy: 1.496 ms, - preprocess: 0.083 ms, - infer: 2.905 ms, - postprocess: 0.598 ms copy: 1.052 ms, - preprocess: 0.062 ms, - infer: 2.879 ms, - postprocess: 0.483 ms copy: 1.882 ms, - preprocess: 0.079 ms, - infer: 3.111 ms, - postprocess: 0.422 ms copy: 1.660 ms, - preprocess: 0.065 ms, - infer: 3.075 ms, - postprocess: 0.387 ms copy: 0.876 ms, - preprocess: 0.048 ms, - infer: 2.890 ms, - postprocess: 0.395 ms copy: 0.743 ms, - preprocess: 0.042 ms, - infer: 3.318 ms, - postprocess: 0.383 ms copy: 1.431 ms, - preprocess: 0.072 ms, - infer: 3.116 ms, - postprocess: 0.544 ms copy: 1.409 ms, - preprocess: 0.085 ms, - infer: 2.840 ms, - postprocess: 0.424 ms copy: 1.492 ms, - preprocess: 0.112 ms, - infer: 2.856 ms, - postprocess: 0.376 ms copy: 1.341 ms, - preprocess: 0.094 ms, - infer: 2.786 ms, - postprocess: 0.420 ms copy: 1.386 ms, - preprocess: 0.071 ms, - infer: 2.733 ms, - postprocess: 0.408 ms copy: 1.087 ms, - preprocess: 0.069 ms, - infer: 2.823 ms, - postprocess: 0.347 ms copy: 1.180 ms, - preprocess: 0.083 ms, - infer: 2.936 ms, - postprocess: 0.433 ms copy: 1.115 ms, - preprocess: 0.067 ms, - infer: 2.777 ms, - postprocess: 0.347 ms copy: 1.571 ms, - preprocess: 0.080 ms, - infer: 2.853 ms, - postprocess: 0.389 ms copy: 1.351 ms, - preprocess: 0.069 ms, - infer: 2.871 ms, - postprocess: 0.360 ms copy: 0.983 ms, - preprocess: 0.069 ms, - infer: 2.827 ms, - postprocess: 0.460 ms copy: 1.494 ms, - preprocess: 0.096 ms, - infer: 3.314 ms, - postprocess: 0.490 ms copy: 1.435 ms, - preprocess: 0.093 ms, - infer: 3.542 ms, - postprocess: 0.573 ms copy: 0.836 ms, - preprocess: 0.053 ms, - infer: 3.015 ms, - postprocess: 0.384 ms copy: 1.353 ms, - preprocess: 0.066 ms, - infer: 2.765 ms, - postprocess: 0.447 ms copy: 1.424 ms, - preprocess: 0.082 ms, - infer: 3.189 ms, - postprocess: 0.488 ms copy: 1.367 ms, - preprocess: 0.107 ms, - infer: 3.072 ms, - postprocess: 0.442 ms copy: 1.139 ms, - preprocess: 0.070 ms, - infer: 3.074 ms, - postprocess: 0.481 ms copy: 1.124 ms, - preprocess: 0.067 ms, - infer: 2.745 ms, - postprocess: 0.402 ms copy: 1.585 ms, - preprocess: 0.073 ms, - infer: 2.837 ms, - postprocess: 0.497 ms copy: 1.550 ms, - preprocess: 0.089 ms, - infer: 3.383 ms, - postprocess: 0.424 ms copy: 1.577 ms, - preprocess: 0.082 ms, - infer: 3.128 ms, - postprocess: 0.812 ms copy: 1.074 ms, - preprocess: 0.062 ms, - infer: 2.884 ms, - postprocess: 0.542 ms copy: 1.404 ms, - preprocess: 0.084 ms, - infer: 3.379 ms, - postprocess: 0.484 ms copy: 1.323 ms, - preprocess: 0.074 ms, - infer: 2.984 ms, - postprocess: 0.551 ms copy: 1.262 ms, - preprocess: 0.074 ms, - infer: 2.810 ms, - postprocess: 0.373 ms copy: 0.964 ms, - preprocess: 0.057 ms, - infer: 2.758 ms, - postprocess: 0.429 ms copy: 1.245 ms, - preprocess: 0.074 ms, - infer: 2.801 ms, - postprocess: 0.465 ms copy: 1.094 ms, - preprocess: 0.068 ms, - infer: 2.741 ms, - postprocess: 0.452 ms copy: 1.176 ms, - preprocess: 0.067 ms, - infer: 2.725 ms, - postprocess: 0.414 ms copy: 1.319 ms, - preprocess: 0.175 ms, - infer: 4.246 ms, - postprocess: 0.899 ms copy: 1.188 ms, - preprocess: 0.067 ms, - infer: 2.932 ms, - postprocess: 0.413 ms copy: 0.797 ms, - preprocess: 0.045 ms, - infer: 2.643 ms, - postprocess: 0.746 ms copy: 1.406 ms, - preprocess: 0.078 ms, - infer: 2.934 ms, - postprocess: 0.374 ms copy: 1.391 ms, - preprocess: 0.077 ms, - infer: 3.087 ms, - postprocess: 0.418 ms copy: 1.354 ms, - preprocess: 0.085 ms, - infer: 3.319 ms, - postprocess: 0.467 ms copy: 1.547 ms, - preprocess: 0.090 ms, - infer: 3.852 ms, - postprocess: 0.618 ms copy: 1.766 ms, - preprocess: 0.082 ms, - infer: 3.045 ms, - postprocess: 0.535 ms copy: 2.007 ms, - preprocess: 0.089 ms, - infer: 2.980 ms, - postprocess: 0.508 ms copy: 1.482 ms, - preprocess: 0.088 ms, - infer: 2.904 ms, - postprocess: 0.418 ms copy: 1.558 ms, - preprocess: 0.069 ms, - infer: 2.890 ms, - postprocess: 0.511 ms copy: 1.426 ms, - preprocess: 0.071 ms, - infer: 2.815 ms, - postprocess: 0.395 ms copy: 1.414 ms, - preprocess: 0.078 ms, - infer: 2.927 ms, - postprocess: 0.453 ms copy: 1.027 ms, - preprocess: 0.054 ms, - infer: 2.837 ms, - postprocess: 0.394 ms copy: 1.428 ms, - preprocess: 0.092 ms, - infer: 3.091 ms, - postprocess: 0.380 ms copy: 1.385 ms, - preprocess: 0.080 ms, - infer: 3.339 ms, - postprocess: 0.514 ms copy: 1.242 ms, - preprocess: 0.085 ms, - infer: 2.829 ms, - postprocess: 0.468 ms copy: 1.278 ms, - preprocess: 0.082 ms, - infer: 2.845 ms, - postprocess: 0.473 ms copy: 1.023 ms, - preprocess: 0.063 ms, - infer: 2.812 ms, - postprocess: 0.378 ms copy: 1.770 ms, - preprocess: 0.064 ms, - infer: 2.854 ms, - postprocess: 0.455 ms copy: 1.549 ms, - preprocess: 0.076 ms, - infer: 2.780 ms, - postprocess: 0.382 ms copy: 1.365 ms, - preprocess: 0.088 ms, - infer: 2.801 ms, - postprocess: 0.386 ms copy: 0.893 ms, - preprocess: 0.054 ms, - infer: 2.808 ms, - postprocess: 0.403 ms copy: 1.419 ms, - preprocess: 0.071 ms, - infer: 3.605 ms, - postprocess: 0.631 ms copy: 1.424 ms, - preprocess: 0.169 ms, - infer: 3.023 ms, - postprocess: 0.566 ms copy: 0.948 ms, - preprocess: 0.059 ms, - infer: 2.721 ms, - postprocess: 0.389 ms copy: 2.137 ms, - preprocess: 0.141 ms, - infer: 9.524 ms, - postprocess: 0.863 ms copy: 1.957 ms, - preprocess: 0.063 ms, - infer: 8.742 ms, - postprocess: 0.593 ms copy: 1.803 ms, - preprocess: 0.076 ms, - infer: 10.490 ms, - postprocess: 0.728 ms copy: 1.738 ms, - preprocess: 0.083 ms, - infer: 8.234 ms, - postprocess: 0.661 ms copy: 1.614 ms, - preprocess: 0.084 ms, - infer: 10.138 ms, - postprocess: 0.724 ms copy: 1.633 ms, - preprocess: 0.081 ms, - infer: 8.260 ms, - postprocess: 0.790 ms copy: 1.592 ms, - preprocess: 0.080 ms, - infer: 8.386 ms, - postprocess: 0.666 ms copy: 2.167 ms, - preprocess: 0.064 ms, - infer: 8.342 ms, - postprocess: 0.732 ms copy: 1.025 ms, - preprocess: 0.046 ms, - infer: 9.664 ms, - postprocess: 1.356 ms copy: 1.609 ms, - preprocess: 0.056 ms, - infer: 11.125 ms, - postprocess: 0.637 ms copy: 0.976 ms, - preprocess: 0.046 ms, - infer: 9.952 ms, - postprocess: 0.612 ms copy: 0.896 ms, - preprocess: 0.038 ms, - infer: 11.882 ms, - postprocess: 0.584 ms copy: 0.964 ms, - preprocess: 0.049 ms, - infer: 8.874 ms, - postprocess: 0.613 ms copy: 1.784 ms, - preprocess: 0.058 ms, - infer: 9.072 ms, - postprocess: 0.643 ms copy: 1.393 ms, - preprocess: 0.068 ms, - infer: 12.454 ms, - postprocess: 0.907 ms copy: 1.422 ms, - preprocess: 0.069 ms, - infer: 9.026 ms, - postprocess: 1.015 ms copy: 1.553 ms, - preprocess: 0.082 ms, - infer: 10.422 ms, - postprocess: 0.720 ms copy: 1.507 ms, - preprocess: 0.069 ms, - infer: 10.647 ms, - postprocess: 0.708 ms copy: 1.357 ms, - preprocess: 0.064 ms, - infer: 9.772 ms, - postprocess: 0.661 ms copy: 1.895 ms, - preprocess: 0.068 ms, - infer: 13.577 ms, - postprocess: 0.678 ms copy: 2.225 ms, - preprocess: 0.059 ms, - infer: 13.583 ms, - postprocess: 0.746 ms copy: 1.334 ms, - preprocess: 0.072 ms, - infer: 16.075 ms, - postprocess: 1.941 ms copy: 1.716 ms, - preprocess: 0.060 ms, - infer: 19.254 ms, - postprocess: 0.781 ms copy: 1.557 ms, - preprocess: 0.060 ms, - infer: 23.375 ms, - postprocess: 0.770 ms copy: 2.203 ms, - preprocess: 0.069 ms, - infer: 14.643 ms, - postprocess: 1.019 ms copy: 1.249 ms, - preprocess: 0.047 ms, - infer: 15.139 ms, - postprocess: 0.669 ms copy: 1.555 ms, - preprocess: 0.050 ms, - infer: 15.508 ms, - postprocess: 0.732 ms copy: 1.674 ms, - preprocess: 0.074 ms, - infer: 16.735 ms, - postprocess: 0.838 ms copy: 2.688 ms, - preprocess: 0.077 ms, - infer: 18.485 ms, - postprocess: 1.727 ms copy: 2.068 ms, - preprocess: 0.074 ms, - infer: 31.418 ms, - postprocess: 0.791 ms copy: 1.555 ms, - preprocess: 0.065 ms, - infer: 14.944 ms, - postprocess: 0.752 ms copy: 1.692 ms, - preprocess: 0.072 ms, - infer: 14.869 ms, - postprocess: 0.885 ms copy: 1.939 ms, - preprocess: 0.041 ms, - infer: 14.227 ms, - postprocess: 0.886 ms copy: 1.818 ms, - preprocess: 0.058 ms, - infer: 14.089 ms, - postprocess: 0.788 ms copy: 1.879 ms, - preprocess: 0.069 ms, - infer: 19.157 ms, - postprocess: 0.719 ms copy: 1.317 ms, - preprocess: 0.051 ms, - infer: 27.866 ms, - postprocess: 0.651 ms copy: 1.130 ms, - preprocess: 0.034 ms, - infer: 19.841 ms, - postprocess: 0.674 ms copy: 1.470 ms, - preprocess: 0.054 ms, - infer: 14.931 ms, - postprocess: 0.860 ms copy: 2.923 ms, - preprocess: 0.050 ms, - infer: 19.032 ms, - postprocess: 0.716 ms copy: 1.731 ms, - preprocess: 0.075 ms, - infer: 17.162 ms, - postprocess: 0.846 ms copy: 1.835 ms, - preprocess: 0.069 ms, - infer: 14.960 ms, - postprocess: 0.691 ms copy: 1.946 ms, - preprocess: 0.065 ms, - infer: 14.402 ms, - postprocess: 0.757 ms copy: 2.081 ms, - preprocess: 0.079 ms, - infer: 17.795 ms, - postprocess: 0.774 ms copy: 1.906 ms, - preprocess: 0.101 ms, - infer: 15.003 ms, - postprocess: 0.965 ms copy: 2.093 ms, - preprocess: 0.066 ms, - infer: 48.237 ms, - postprocess: 0.851 ms copy: 2.134 ms, - preprocess: 0.064 ms, - infer: 16.053 ms, - postprocess: 0.732 ms copy: 2.178 ms, - preprocess: 0.071 ms, - infer: 21.680 ms, - postprocess: 0.748 ms copy: 1.257 ms, - preprocess: 0.050 ms, - infer: 17.525 ms, - postprocess: 0.761 ms copy: 1.830 ms, - preprocess: 0.074 ms, - infer: 16.902 ms, - postprocess: 0.738 ms copy: 1.743 ms, - preprocess: 0.066 ms, - infer: 17.443 ms, - postprocess: 0.955 ms copy: 1.963 ms, - preprocess: 0.082 ms, - infer: 14.764 ms, - postprocess: 0.781 ms copy: 1.777 ms, - preprocess: 0.066 ms, - infer: 20.278 ms, - postprocess: 0.753 ms copy: 1.193 ms, - preprocess: 0.045 ms, - infer: 17.348 ms, - postprocess: 0.723 ms copy: 1.679 ms, - preprocess: 0.058 ms, - infer: 17.181 ms, - postprocess: 0.991 ms copy: 1.164 ms, - preprocess: 0.044 ms, - infer: 34.137 ms, - postprocess: 4.280 ms copy: 1.671 ms, - preprocess: 0.055 ms, - infer: 36.070 ms, - postprocess: 0.815 ms copy: 1.195 ms, - preprocess: 0.042 ms, - infer: 38.511 ms, - postprocess: 0.690 ms copy: 1.633 ms, - preprocess: 0.068 ms, - infer: 18.951 ms, - postprocess: 1.166 ms copy: 1.903 ms, - preprocess: 0.062 ms, - infer: 16.313 ms, - postprocess: 0.760 ms copy: 1.865 ms, - preprocess: 0.075 ms, - infer: 37.591 ms, - postprocess: 1.563 ms copy: 1.828 ms, - preprocess: 0.060 ms, - infer: 20.682 ms, - postprocess: 0.688 ms copy: 1.580 ms, - preprocess: 0.061 ms, - infer: 16.881 ms, - postprocess: 0.674 ms copy: 2.172 ms, - preprocess: 0.070 ms, - infer: 13.768 ms, - postprocess: 0.997 ms copy: 1.565 ms, - preprocess: 0.060 ms, - infer: 14.944 ms, - postprocess: 0.641 ms copy: 1.855 ms, - preprocess: 0.063 ms, - infer: 13.166 ms, - postprocess: 0.652 ms copy: 2.058 ms, - preprocess: 0.077 ms, - infer: 20.005 ms, - postprocess: 0.866 ms copy: 1.692 ms, - preprocess: 0.076 ms, - infer: 33.023 ms, - postprocess: 0.722 ms copy: 1.544 ms, - preprocess: 0.046 ms, - infer: 18.274 ms, - postprocess: 0.611 ms copy: 1.961 ms, - preprocess: 0.084 ms, - infer: 16.914 ms, - postprocess: 0.878 ms copy: 1.187 ms, - preprocess: 0.050 ms, - infer: 17.484 ms, - postprocess: 0.764 ms copy: 1.816 ms, - preprocess: 0.061 ms, - infer: 23.719 ms, - postprocess: 0.717 ms copy: 1.676 ms, - preprocess: 0.069 ms, - infer: 14.898 ms, - postprocess: 0.701 ms copy: 2.432 ms, - preprocess: 0.068 ms, - infer: 13.506 ms, - postprocess: 0.840 ms copy: 1.704 ms, - preprocess: 0.066 ms, - infer: 13.217 ms, - postprocess: 0.742 ms copy: 1.514 ms, - preprocess: 0.057 ms, - infer: 15.883 ms, - postprocess: 0.621 ms copy: 1.596 ms, - preprocess: 0.061 ms, - infer: 13.570 ms, - postprocess: 0.588 ms copy: 1.378 ms, - preprocess: 0.059 ms, - infer: 20.181 ms, - postprocess: 0.647 ms copy: 1.621 ms, - preprocess: 0.059 ms, - infer: 14.665 ms, - postprocess: 0.673 ms copy: 1.221 ms, - preprocess: 0.043 ms, - infer: 28.360 ms, - postprocess: 0.630 ms copy: 1.793 ms, - preprocess: 0.064 ms, - infer: 17.880 ms, - postprocess: 0.651 ms copy: 1.939 ms, - preprocess: 0.063 ms, - infer: 26.679 ms, - postprocess: 1.045 ms copy: 1.710 ms, - preprocess: 0.067 ms, - infer: 24.410 ms, - postprocess: 0.929 ms copy: 2.060 ms, - preprocess: 0.064 ms, - infer: 13.642 ms, - postprocess: 1.773 ms copy: 1.491 ms, - preprocess: 0.046 ms, - infer: 15.232 ms, - postprocess: 0.586 ms copy: 1.647 ms, - preprocess: 0.056 ms, - infer: 13.409 ms, - postprocess: 0.687 ms copy: 1.848 ms, - preprocess: 0.077 ms, - infer: 14.210 ms, - postprocess: 0.972 ms copy: 1.443 ms, - preprocess: 0.062 ms, - infer: 13.712 ms, - postprocess: 0.632 ms copy: 1.190 ms, - preprocess: 0.046 ms, - infer: 13.779 ms, - postprocess: 0.634 ms copy: 1.866 ms, - preprocess: 0.069 ms, - infer: 13.916 ms, - postprocess: 0.784 ms copy: 1.721 ms, - preprocess: 0.067 ms, - infer: 19.619 ms, - postprocess: 0.721 ms copy: 1.201 ms, - preprocess: 0.045 ms, - infer: 17.793 ms, - postprocess: 1.000 ms copy: 1.738 ms, - preprocess: 0.059 ms, - infer: 18.485 ms, - postprocess: 0.735 ms copy: 1.714 ms, - preprocess: 0.134 ms, - infer: 18.691 ms, - postprocess: 0.731 ms copy: 1.236 ms, - preprocess: 0.045 ms, - infer: 14.295 ms, - postprocess: 0.648 ms copy: 1.864 ms, - preprocess: 0.056 ms, - infer: 13.889 ms, - postprocess: 0.655 ms copy: 1.646 ms, - preprocess: 0.064 ms, - infer: 32.013 ms, - postprocess: 0.834 ms copy: 1.940 ms, - preprocess: 0.078 ms, - infer: 22.168 ms, - postprocess: 0.721 ms copy: 3.116 ms, - preprocess: 0.396 ms, - infer: 20.216 ms, - postprocess: 0.713 ms copy: 1.454 ms, - preprocess: 0.062 ms, - infer: 40.811 ms, - postprocess: 0.680 ms copy: 1.633 ms, - preprocess: 0.073 ms, - infer: 22.675 ms, - postprocess: 0.645 ms copy: 1.300 ms, - preprocess: 0.045 ms, - infer: 22.784 ms, - postprocess: 2.279 ms copy: 1.528 ms, - preprocess: 0.052 ms, - infer: 13.063 ms, - postprocess: 0.701 ms copy: 1.747 ms, - preprocess: 0.065 ms, - infer: 12.840 ms, - postprocess: 0.729 ms copy: 1.846 ms, - preprocess: 0.095 ms, - infer: 13.203 ms, - postprocess: 0.707 ms copy: 1.714 ms, - preprocess: 0.071 ms, - infer: 19.180 ms, - postprocess: 0.665 ms copy: 1.844 ms, - preprocess: 0.082 ms, - infer: 15.445 ms, - postprocess: 0.634 ms copy: 1.628 ms, - preprocess: 0.048 ms, - infer: 25.569 ms, - postprocess: 0.682 ms copy: 1.767 ms, - preprocess: 0.071 ms, - infer: 22.458 ms, - postprocess: 0.615 ms copy: 1.395 ms, - preprocess: 0.072 ms, - infer: 7.362 ms, - postprocess: 0.573 ms copy: 1.419 ms, - preprocess: 0.083 ms, - infer: 10.849 ms, - postprocess: 0.887 ms copy: 0.897 ms, - preprocess: 0.043 ms, - infer: 7.266 ms, - postprocess: 0.578 ms copy: 1.159 ms, - preprocess: 0.046 ms, - infer: 8.899 ms, - postprocess: 0.572 ms copy: 1.344 ms, - preprocess: 0.079 ms, - infer: 7.342 ms, - postprocess: 0.593 ms copy: 1.599 ms, - preprocess: 0.075 ms, - infer: 7.304 ms, - postprocess: 0.548 ms copy: 1.364 ms, - preprocess: 0.064 ms, - infer: 7.529 ms, - postprocess: 0.624 ms copy: 1.409 ms, - preprocess: 0.059 ms, - infer: 12.011 ms, - postprocess: 0.541 ms copy: 0.885 ms, - preprocess: 0.045 ms, - infer: 8.612 ms, - postprocess: 0.571 ms copy: 0.918 ms, - preprocess: 0.044 ms, - infer: 7.304 ms, - postprocess: 0.621 ms copy: 1.564 ms, - preprocess: 0.076 ms, - infer: 7.359 ms, - postprocess: 0.570 ms copy: 1.714 ms, - preprocess: 0.079 ms, - infer: 7.354 ms, - postprocess: 0.592 ms copy: 1.358 ms, - preprocess: 0.079 ms, - infer: 7.415 ms, - postprocess: 0.692 ms copy: 1.440 ms, - preprocess: 0.074 ms, - infer: 7.704 ms, - postprocess: 0.601 ms copy: 1.208 ms, - preprocess: 0.061 ms, - infer: 7.344 ms, - postprocess: 1.057 ms copy: 1.737 ms, - preprocess: 0.127 ms, - infer: 7.684 ms, - postprocess: 0.676 ms copy: 1.531 ms, - preprocess: 0.083 ms, - infer: 7.588 ms, - postprocess: 0.708 ms copy: 1.577 ms, - preprocess: 0.084 ms, - infer: 7.445 ms, - postprocess: 0.608 ms copy: 2.069 ms, - preprocess: 0.136 ms, - infer: 7.449 ms, - postprocess: 0.757 ms copy: 1.852 ms, - preprocess: 0.212 ms, - infer: 7.662 ms, - postprocess: 0.774 ms copy: 1.216 ms, - preprocess: 0.062 ms, - infer: 7.568 ms, - postprocess: 0.578 ms copy: 1.678 ms, - preprocess: 0.077 ms, - infer: 7.350 ms, - postprocess: 0.571 ms copy: 1.524 ms, - preprocess: 0.076 ms, - infer: 7.395 ms, - postprocess: 0.621 ms copy: 1.608 ms, - preprocess: 0.082 ms, - infer: 7.410 ms, - postprocess: 0.580 ms copy: 1.514 ms, - preprocess: 0.063 ms, - infer: 9.706 ms, - postprocess: 0.693 ms copy: 1.023 ms, - preprocess: 0.052 ms, - infer: 8.063 ms, - postprocess: 0.549 ms copy: 1.695 ms, - preprocess: 0.067 ms, - infer: 8.645 ms, - postprocess: 0.566 ms copy: 1.944 ms, - preprocess: 0.074 ms, - infer: 8.179 ms, - postprocess: 0.566 ms copy: 1.568 ms, - preprocess: 0.071 ms, - infer: 7.431 ms, - postprocess: 1.462 ms copy: 2.117 ms, - preprocess: 0.058 ms, - infer: 15.641 ms, - postprocess: 0.676 ms copy: 2.071 ms, - preprocess: 0.056 ms, - infer: 13.994 ms, - postprocess: 0.689 ms copy: 1.737 ms, - preprocess: 0.077 ms, - infer: 14.506 ms, - postprocess: 0.721 ms copy: 1.877 ms, - preprocess: 0.077 ms, - infer: 14.293 ms, - postprocess: 0.738 ms copy: 1.493 ms, - preprocess: 0.062 ms, - infer: 14.853 ms, - postprocess: 0.690 ms copy: 2.053 ms, - preprocess: 0.070 ms, - infer: 20.497 ms, - postprocess: 0.823 ms copy: 2.351 ms, - preprocess: 0.069 ms, - infer: 14.246 ms, - postprocess: 1.056 ms copy: 1.484 ms, - preprocess: 0.063 ms, - infer: 14.636 ms, - postprocess: 0.835 ms copy: 1.947 ms, - preprocess: 0.116 ms, - infer: 14.508 ms, - postprocess: 0.824 ms copy: 2.004 ms, - preprocess: 0.072 ms, - infer: 21.350 ms, - postprocess: 0.830 ms copy: 1.590 ms, - preprocess: 0.068 ms, - infer: 17.187 ms, - postprocess: 0.840 ms copy: 1.188 ms, - preprocess: 0.042 ms, - infer: 14.728 ms, - postprocess: 0.729 ms copy: 1.757 ms, - preprocess: 0.060 ms, - infer: 14.213 ms, - postprocess: 0.914 ms copy: 1.959 ms, - preprocess: 0.112 ms, - infer: 14.619 ms, - postprocess: 0.767 ms copy: 2.075 ms, - preprocess: 0.064 ms, - infer: 21.402 ms, - postprocess: 0.788 ms copy: 1.942 ms, - preprocess: 0.063 ms, - infer: 17.206 ms, - postprocess: 0.767 ms copy: 1.635 ms, - preprocess: 0.061 ms, - infer: 15.562 ms, - postprocess: 0.716 ms copy: 1.798 ms, - preprocess: 0.066 ms, - infer: 17.133 ms, - postprocess: 0.725 ms copy: 1.189 ms, - preprocess: 0.045 ms, - infer: 14.570 ms, - postprocess: 0.700 ms copy: 1.151 ms, - preprocess: 0.038 ms, - infer: 19.992 ms, - postprocess: 0.719 ms copy: 1.773 ms, - preprocess: 0.065 ms, - infer: 14.221 ms, - postprocess: 0.800 ms copy: 2.142 ms, - preprocess: 0.072 ms, - infer: 15.464 ms, - postprocess: 1.185 ms copy: 1.407 ms, - preprocess: 0.063 ms, - infer: 14.451 ms, - postprocess: 0.772 ms copy: 1.960 ms, - preprocess: 0.129 ms, - infer: 19.660 ms, - postprocess: 0.911 ms copy: 1.954 ms, - preprocess: 0.060 ms, - infer: 19.535 ms, - postprocess: 0.739 ms copy: 1.653 ms, - preprocess: 0.063 ms, - infer: 22.125 ms, - postprocess: 0.731 ms copy: 1.586 ms, - preprocess: 0.053 ms, - infer: 16.842 ms, - postprocess: 0.724 ms copy: 1.829 ms, - preprocess: 0.103 ms, - infer: 16.598 ms, - postprocess: 0.763 ms copy: 1.697 ms, - preprocess: 0.062 ms, - infer: 14.663 ms, - postprocess: 0.729 ms copy: 1.707 ms, - preprocess: 0.063 ms, - infer: 14.653 ms, - postprocess: 0.847 ms copy: 1.541 ms, - preprocess: 0.056 ms, - infer: 14.463 ms, - postprocess: 0.796 ms copy: 1.710 ms, - preprocess: 0.057 ms, - infer: 14.107 ms, - postprocess: 0.847 ms copy: 1.637 ms, - preprocess: 0.074 ms, - infer: 14.636 ms, - postprocess: 0.862 ms copy: 1.845 ms, - preprocess: 0.093 ms, - infer: 14.604 ms, - postprocess: 0.940 ms copy: 2.108 ms, - preprocess: 0.089 ms, - infer: 22.316 ms, - postprocess: 0.972 ms copy: 1.157 ms, - preprocess: 0.048 ms, - infer: 17.214 ms, - postprocess: 0.743 ms copy: 1.611 ms, - preprocess: 0.051 ms, - infer: 18.038 ms, - postprocess: 0.971 ms copy: 1.422 ms, - preprocess: 0.061 ms, - infer: 14.540 ms, - postprocess: 0.869 ms copy: 1.689 ms, - preprocess: 0.059 ms, - infer: 16.148 ms, - postprocess: 0.757 ms copy: 1.559 ms, - preprocess: 0.058 ms, - infer: 14.561 ms, - postprocess: 0.836 ms copy: 1.954 ms, - preprocess: 0.057 ms, - infer: 14.130 ms, - postprocess: 0.707 ms copy: 1.604 ms, - preprocess: 0.062 ms, - infer: 14.310 ms, - postprocess: 0.782 ms copy: 1.245 ms, - preprocess: 0.043 ms, - infer: 14.552 ms, - postprocess: 0.764 ms copy: 1.870 ms, - preprocess: 0.077 ms, - infer: 21.404 ms, - postprocess: 0.782 ms copy: 1.417 ms, - preprocess: 0.057 ms, - infer: 17.198 ms, - postprocess: 0.721 ms copy: 1.648 ms, - preprocess: 0.053 ms, - infer: 14.535 ms, - postprocess: 0.764 ms copy: 1.639 ms, - preprocess: 0.060 ms, - infer: 17.572 ms, - postprocess: 0.725 ms copy: 1.647 ms, - preprocess: 0.062 ms, - infer: 14.504 ms, - postprocess: 0.711 ms copy: 1.607 ms, - preprocess: 0.059 ms, - infer: 19.638 ms, - postprocess: 2.174 ms copy: 2.377 ms, - preprocess: 0.072 ms, - infer: 18.498 ms, - postprocess: 0.820 ms copy: 1.871 ms, - preprocess: 0.087 ms, - infer: 21.242 ms, - postprocess: 0.905 ms copy: 1.679 ms, - preprocess: 0.074 ms, - infer: 24.609 ms, - postprocess: 0.783 ms copy: 1.543 ms, - preprocess: 0.058 ms, - infer: 14.587 ms, - postprocess: 0.695 ms copy: 1.773 ms, - preprocess: 0.066 ms, - infer: 14.644 ms, - postprocess: 0.737 ms copy: 1.920 ms, - preprocess: 0.080 ms, - infer: 14.741 ms, - postprocess: 0.844 ms copy: 1.770 ms, - preprocess: 0.077 ms, - infer: 21.676 ms, - postprocess: 0.959 ms copy: 2.288 ms, - preprocess: 0.076 ms, - infer: 23.434 ms, - postprocess: 0.814 ms copy: 1.788 ms, - preprocess: 0.063 ms, - infer: 16.917 ms, - postprocess: 0.793 ms copy: 1.684 ms, - preprocess: 0.065 ms, - infer: 14.233 ms, - postprocess: 0.640 ms copy: 2.021 ms, - preprocess: 0.083 ms, - infer: 14.724 ms, - postprocess: 0.861 ms copy: 2.041 ms, - preprocess: 0.077 ms, - infer: 20.032 ms, - postprocess: 1.358 ms copy: 2.081 ms, - preprocess: 0.068 ms, - infer: 14.375 ms, - postprocess: 1.927 ms copy: 1.197 ms, - preprocess: 0.045 ms, - infer: 14.252 ms, - postprocess: 0.832 ms copy: 1.739 ms, - preprocess: 0.059 ms, - infer: 14.444 ms, - postprocess: 0.694 ms copy: 1.643 ms, - preprocess: 0.065 ms, - infer: 14.538 ms, - postprocess: 0.763 ms copy: 1.951 ms, - preprocess: 0.094 ms, - infer: 14.578 ms, - postprocess: 0.968 ms copy: 3.045 ms, - preprocess: 0.083 ms, - infer: 16.521 ms, - postprocess: 2.371 ms copy: 1.821 ms, - preprocess: 0.076 ms, - infer: 20.228 ms, - postprocess: 1.130 ms copy: 1.388 ms, - preprocess: 0.071 ms, - infer: 21.514 ms, - postprocess: 0.835 ms copy: 1.721 ms, - preprocess: 0.060 ms, - infer: 14.362 ms, - postprocess: 0.685 ms copy: 1.909 ms, - preprocess: 0.078 ms, - infer: 14.831 ms, - postprocess: 0.876 ms copy: 1.956 ms, - preprocess: 0.068 ms, - infer: 14.669 ms, - postprocess: 0.739 ms copy: 1.945 ms, - preprocess: 0.070 ms, - infer: 14.779 ms, - postprocess: 0.746 ms copy: 2.065 ms, - preprocess: 0.077 ms, - infer: 22.062 ms, - postprocess: 2.100 ms copy: 1.907 ms, - preprocess: 0.083 ms, - infer: 14.844 ms, - postprocess: 0.785 ms copy: 2.122 ms, - preprocess: 0.063 ms, - infer: 14.543 ms, - postprocess: 0.762 ms copy: 1.713 ms, - preprocess: 0.065 ms, - infer: 14.352 ms, - postprocess: 0.685 ms copy: 1.971 ms, - preprocess: 0.062 ms, - infer: 14.635 ms, - postprocess: 1.079 ms copy: 2.085 ms, - preprocess: 0.074 ms, - infer: 14.461 ms, - postprocess: 0.832 ms copy: 1.896 ms, - preprocess: 0.082 ms, - infer: 23.218 ms, - postprocess: 0.714 ms copy: 1.739 ms, - preprocess: 0.069 ms, - infer: 17.149 ms, - postprocess: 0.704 ms copy: 1.999 ms, - preprocess: 0.080 ms, - infer: 14.493 ms, - postprocess: 0.880 ms copy: 1.312 ms, - preprocess: 0.049 ms, - infer: 14.473 ms, - postprocess: 0.719 ms copy: 1.226 ms, - preprocess: 0.052 ms, - infer: 14.712 ms, - postprocess: 0.751 ms copy: 2.327 ms, - preprocess: 0.088 ms, - infer: 25.170 ms, - postprocess: 0.758 ms copy: 1.581 ms, - preprocess: 0.085 ms, - infer: 18.251 ms, - postprocess: 0.761 ms copy: 1.871 ms, - preprocess: 0.068 ms, - infer: 17.155 ms, - postprocess: 0.731 ms copy: 1.911 ms, - preprocess: 0.086 ms, - infer: 18.235 ms, - postprocess: 0.957 ms copy: 1.972 ms, - preprocess: 0.070 ms, - infer: 14.185 ms, - postprocess: 0.759 ms copy: 1.283 ms, - preprocess: 0.053 ms, - infer: 21.630 ms, - postprocess: 0.693 ms copy: 1.721 ms, - preprocess: 0.062 ms, - infer: 24.445 ms, - postprocess: 0.809 ms copy: 1.136 ms, - preprocess: 0.043 ms, - infer: 19.875 ms, - postprocess: 0.718 ms copy: 1.170 ms, - preprocess: 0.041 ms, - infer: 18.853 ms, - postprocess: 0.691 ms copy: 1.529 ms, - preprocess: 0.038 ms, - infer: 19.598 ms, - postprocess: 0.678 ms copy: 1.865 ms, - preprocess: 0.049 ms, - infer: 17.217 ms, - postprocess: 0.682 ms copy: 1.728 ms, - preprocess: 0.075 ms, - infer: 20.377 ms, - postprocess: 0.735 ms copy: 1.383 ms, - preprocess: 0.058 ms, - infer: 18.153 ms, - postprocess: 0.706 ms copy: 1.461 ms, - preprocess: 0.056 ms, - infer: 17.296 ms, - postprocess: 0.849 ms copy: 2.367 ms, - preprocess: 0.083 ms, - infer: 31.302 ms, - postprocess: 0.744 ms copy: 2.145 ms, - preprocess: 0.072 ms, - infer: 17.488 ms, - postprocess: 0.750 ms copy: 2.656 ms, - preprocess: 0.074 ms, - infer: 22.430 ms, - postprocess: 0.971 ms copy: 1.681 ms, - preprocess: 0.076 ms, - infer: 17.402 ms, - postprocess: 1.792 ms copy: 2.204 ms, - preprocess: 0.088 ms, - infer: 93.785 ms, - postprocess: 0.784 ms copy: 1.244 ms, - preprocess: 0.042 ms, - infer: 14.127 ms, - postprocess: 0.797 ms copy: 1.926 ms, - preprocess: 0.048 ms, - infer: 16.180 ms, - postprocess: 0.686 ms copy: 2.426 ms, - preprocess: 0.050 ms, - infer: 19.963 ms, - postprocess: 0.695 ms copy: 1.628 ms, - preprocess: 0.070 ms, - infer: 15.149 ms, - postprocess: 0.678 ms copy: 1.443 ms, - preprocess: 0.055 ms, - infer: 67.973 ms, - postprocess: 0.794 ms copy: 1.531 ms, - preprocess: 0.071 ms, - infer: 29.039 ms, - postprocess: 0.662 ms copy: 1.014 ms, - preprocess: 0.038 ms, - infer: 15.536 ms, - postprocess: 0.482 ms copy: 0.948 ms, - preprocess: 0.034 ms, - infer: 10.575 ms, - postprocess: 0.498 ms copy: 1.698 ms, - preprocess: 0.088 ms, - infer: 9.857 ms, - postprocess: 0.672 ms copy: 1.403 ms, - preprocess: 0.072 ms, - infer: 7.008 ms, - postprocess: 0.549 ms copy: 1.395 ms, - preprocess: 0.070 ms, - infer: 7.067 ms, - postprocess: 0.571 ms copy: 1.257 ms, - preprocess: 0.071 ms, - infer: 7.178 ms, - postprocess: 0.647 ms copy: 1.125 ms, - preprocess: 0.059 ms, - infer: 7.010 ms, - postprocess: 0.572 ms copy: 1.361 ms, - preprocess: 0.063 ms, - infer: 9.812 ms, - postprocess: 1.111 ms copy: 0.877 ms, - preprocess: 0.045 ms, - infer: 6.957 ms, - postprocess: 0.602 ms copy: 0.866 ms, - preprocess: 0.045 ms, - infer: 6.925 ms, - postprocess: 0.582 ms copy: 1.710 ms, - preprocess: 0.079 ms, - infer: 11.056 ms, - postprocess: 0.671 ms copy: 1.069 ms, - preprocess: 0.059 ms, - infer: 7.127 ms, - postprocess: 0.915 ms copy: 1.349 ms, - preprocess: 0.073 ms, - infer: 8.764 ms, - postprocess: 0.552 ms copy: 1.364 ms, - preprocess: 0.080 ms, - infer: 9.551 ms, - postprocess: 0.638 ms copy: 1.358 ms, - preprocess: 0.064 ms, - infer: 9.065 ms, - postprocess: 0.583 ms copy: 1.449 ms, - preprocess: 0.072 ms, - infer: 7.015 ms, - postprocess: 0.535 ms copy: 0.900 ms, - preprocess: 0.053 ms, - infer: 7.027 ms, - postprocess: 0.534 ms copy: 1.502 ms, - preprocess: 0.086 ms, - infer: 7.272 ms, - postprocess: 0.649 ms copy: 1.537 ms, - preprocess: 0.077 ms, - infer: 8.267 ms, - postprocess: 0.569 ms copy: 1.508 ms, - preprocess: 0.072 ms, - infer: 7.061 ms, - postprocess: 0.554 ms copy: 1.242 ms, - preprocess: 0.063 ms, - infer: 8.358 ms, - postprocess: 0.562 ms copy: 1.631 ms, - preprocess: 0.064 ms, - infer: 8.161 ms, - postprocess: 0.598 ms copy: 0.890 ms, - preprocess: 0.050 ms, - infer: 10.948 ms, - postprocess: 0.632 ms copy: 1.681 ms, - preprocess: 0.077 ms, - infer: 6.999 ms, - postprocess: 0.505 ms copy: 1.320 ms, - preprocess: 0.064 ms, - infer: 7.187 ms, - postprocess: 0.546 ms copy: 1.427 ms, - preprocess: 0.083 ms, - infer: 7.091 ms, - postprocess: 0.562 ms copy: 1.392 ms, - preprocess: 0.070 ms, - infer: 7.049 ms, - postprocess: 0.544 ms copy: 2.084 ms, - preprocess: 0.073 ms, - infer: 7.232 ms, - postprocess: 0.540 ms copy: 1.483 ms, - preprocess: 0.059 ms, - infer: 7.082 ms, - postprocess: 0.510 ms copy: 1.521 ms, - preprocess: 0.058 ms, - infer: 7.019 ms, - postprocess: 0.525 ms copy: 1.770 ms, - preprocess: 0.064 ms, - infer: 14.282 ms, - postprocess: 0.704 ms copy: 1.908 ms, - preprocess: 0.079 ms, - infer: 31.317 ms, - postprocess: 3.023 ms copy: 1.724 ms, - preprocess: 0.066 ms, - infer: 21.672 ms, - postprocess: 0.841 ms copy: 1.112 ms, - preprocess: 0.042 ms, - infer: 20.095 ms, - postprocess: 0.849 ms copy: 1.578 ms, - preprocess: 0.064 ms, - infer: 17.518 ms, - postprocess: 0.723 ms copy: 1.772 ms, - preprocess: 0.053 ms, - infer: 14.575 ms, - postprocess: 1.036 ms copy: 1.651 ms, - preprocess: 0.061 ms, - infer: 14.654 ms, - postprocess: 0.769 ms copy: 1.565 ms, - preprocess: 0.059 ms, - infer: 14.614 ms, - postprocess: 0.716 ms copy: 1.639 ms, - preprocess: 0.062 ms, - infer: 14.554 ms, - postprocess: 0.725 ms copy: 2.509 ms, - preprocess: 0.311 ms, - infer: 15.879 ms, - postprocess: 0.798 ms copy: 2.110 ms, - preprocess: 0.070 ms, - infer: 17.229 ms, - postprocess: 0.713 ms copy: 2.116 ms, - preprocess: 0.096 ms, - infer: 14.844 ms, - postprocess: 0.800 ms copy: 1.465 ms, - preprocess: 0.060 ms, - infer: 14.508 ms, - postprocess: 0.728 ms copy: 1.948 ms, - preprocess: 0.057 ms, - infer: 17.588 ms, - postprocess: 0.721 ms copy: 1.926 ms, - preprocess: 0.073 ms, - infer: 15.123 ms, - postprocess: 0.832 ms copy: 1.739 ms, - preprocess: 0.067 ms, - infer: 14.583 ms, - postprocess: 0.695 ms copy: 1.694 ms, - preprocess: 0.068 ms, - infer: 14.685 ms, - postprocess: 0.788 ms copy: 2.090 ms, - preprocess: 0.076 ms, - infer: 14.624 ms, - postprocess: 0.765 ms copy: 1.758 ms, - preprocess: 0.063 ms, - infer: 17.532 ms, - postprocess: 0.804 ms copy: 1.919 ms, - preprocess: 0.058 ms, - infer: 17.511 ms, - postprocess: 1.706 ms copy: 1.687 ms, - preprocess: 0.078 ms, - infer: 20.054 ms, - postprocess: 0.976 ms copy: 2.021 ms, - preprocess: 0.075 ms, - infer: 15.985 ms, - postprocess: 0.688 ms copy: 0.992 ms, - preprocess: 0.050 ms, - infer: 19.381 ms, - postprocess: 0.699 ms copy: 1.777 ms, - preprocess: 0.068 ms, - infer: 15.760 ms, - postprocess: 0.783 ms copy: 1.901 ms, - preprocess: 0.087 ms, - infer: 14.400 ms, - postprocess: 0.794 ms copy: 1.290 ms, - preprocess: 0.053 ms, - infer: 14.415 ms, - postprocess: 0.772 ms copy: 1.422 ms, - preprocess: 0.051 ms, - infer: 14.507 ms, - postprocess: 0.810 ms copy: 1.897 ms, - preprocess: 0.073 ms, - infer: 17.366 ms, - postprocess: 0.772 ms copy: 1.883 ms, - preprocess: 0.090 ms, - infer: 22.260 ms, - postprocess: 0.776 ms copy: 1.800 ms, - preprocess: 0.078 ms, - infer: 14.376 ms, - postprocess: 0.841 ms copy: 1.928 ms, - preprocess: 0.079 ms, - infer: 14.403 ms, - postprocess: 0.783 ms copy: 1.851 ms, - preprocess: 0.067 ms, - infer: 14.596 ms, - postprocess: 1.885 ms copy: 1.649 ms, - preprocess: 0.065 ms, - infer: 17.383 ms, - postprocess: 0.777 ms copy: 1.611 ms, - preprocess: 0.061 ms, - infer: 25.325 ms, - postprocess: 0.707 ms copy: 1.400 ms, - preprocess: 0.057 ms, - infer: 16.265 ms, - postprocess: 0.723 ms copy: 2.127 ms, - preprocess: 0.074 ms, - infer: 14.254 ms, - postprocess: 0.712 ms copy: 1.730 ms, - preprocess: 0.074 ms, - infer: 14.290 ms, - postprocess: 0.762 ms copy: 1.769 ms, - preprocess: 0.078 ms, - infer: 14.754 ms, - postprocess: 0.708 ms copy: 1.579 ms, - preprocess: 0.062 ms, - infer: 14.229 ms, - postprocess: 0.788 ms copy: 1.523 ms, - preprocess: 0.058 ms, - infer: 27.441 ms, - postprocess: 0.749 ms copy: 1.645 ms, - preprocess: 0.062 ms, - infer: 16.280 ms, - postprocess: 0.800 ms copy: 1.533 ms, - preprocess: 0.061 ms, - infer: 19.995 ms, - postprocess: 0.753 ms copy: 1.753 ms, - preprocess: 0.066 ms, - infer: 26.195 ms, - postprocess: 0.796 ms copy: 1.731 ms, - preprocess: 0.076 ms, - infer: 17.612 ms, - postprocess: 0.722 ms copy: 1.245 ms, - preprocess: 0.049 ms, - infer: 25.912 ms, - postprocess: 0.739 ms copy: 1.733 ms, - preprocess: 0.061 ms, - infer: 28.212 ms, - postprocess: 0.804 ms copy: 1.736 ms, - preprocess: 0.063 ms, - infer: 17.783 ms, - postprocess: 0.755 ms copy: 1.947 ms, - preprocess: 0.063 ms, - infer: 18.309 ms, - postprocess: 0.721 ms copy: 1.164 ms, - preprocess: 0.044 ms, - infer: 134.892 ms, - postprocess: 0.689 ms copy: 1.136 ms, - preprocess: 0.043 ms, - infer: 13.463 ms, - postprocess: 0.625 ms copy: 1.701 ms, - preprocess: 0.062 ms, - infer: 19.532 ms, - postprocess: 1.768 ms copy: 1.469 ms, - preprocess: 0.060 ms, - infer: 20.675 ms, - postprocess: 0.693 ms copy: 2.423 ms, - preprocess: 0.062 ms, - infer: 20.624 ms, - postprocess: 0.822 ms copy: 1.699 ms, - preprocess: 0.069 ms, - infer: 21.190 ms, - postprocess: 2.250 ms copy: 1.597 ms, - preprocess: 0.060 ms, - infer: 12.986 ms, - postprocess: 0.690 ms copy: 1.095 ms, - preprocess: 0.042 ms, - infer: 13.028 ms, - postprocess: 0.542 ms copy: 1.502 ms, - preprocess: 0.051 ms, - infer: 12.785 ms, - postprocess: 0.663 ms copy: 1.535 ms, - preprocess: 0.062 ms, - infer: 12.702 ms, - postprocess: 0.624 ms copy: 1.708 ms, - preprocess: 0.074 ms, - infer: 12.556 ms, - postprocess: 0.755 ms copy: 1.298 ms, - preprocess: 0.060 ms, - infer: 24.676 ms, - postprocess: 0.549 ms copy: 1.582 ms, - preprocess: 0.047 ms, - infer: 21.308 ms, - postprocess: 0.646 ms copy: 1.938 ms, - preprocess: 0.043 ms, - infer: 43.301 ms, - postprocess: 0.600 ms copy: 0.856 ms, - preprocess: 0.035 ms, - infer: 6.498 ms, - postprocess: 0.466 ms copy: 1.211 ms, - preprocess: 0.051 ms, - infer: 6.591 ms, - postprocess: 1.397 ms copy: 1.375 ms, - preprocess: 0.080 ms, - infer: 6.839 ms, - postprocess: 0.555 ms copy: 1.348 ms, - preprocess: 0.061 ms, - infer: 6.593 ms, - postprocess: 0.569 ms copy: 1.252 ms, - preprocess: 0.065 ms, - infer: 6.607 ms, - postprocess: 0.508 ms copy: 1.440 ms, - preprocess: 0.083 ms, - infer: 6.862 ms, - postprocess: 0.601 ms copy: 1.613 ms, - preprocess: 0.085 ms, - infer: 6.908 ms, - postprocess: 0.642 ms copy: 1.218 ms, - preprocess: 0.065 ms, - infer: 6.657 ms, - postprocess: 0.569 ms copy: 1.562 ms, - preprocess: 0.105 ms, - infer: 6.731 ms, - postprocess: 0.534 ms copy: 1.648 ms, - preprocess: 0.101 ms, - infer: 11.611 ms, - postprocess: 1.446 ms copy: 1.411 ms, - preprocess: 0.076 ms, - infer: 7.009 ms, - postprocess: 0.547 ms copy: 1.305 ms, - preprocess: 0.063 ms, - infer: 6.598 ms, - postprocess: 0.526 ms copy: 1.388 ms, - preprocess: 0.084 ms, - infer: 8.324 ms, - postprocess: 0.940 ms copy: 1.246 ms, - preprocess: 0.063 ms, - infer: 6.712 ms, - postprocess: 0.594 ms copy: 1.301 ms, - preprocess: 0.064 ms, - infer: 8.835 ms, - postprocess: 0.556 ms copy: 0.802 ms, - preprocess: 0.043 ms, - infer: 6.554 ms, - postprocess: 0.462 ms copy: 1.180 ms, - preprocess: 0.042 ms, - infer: 10.428 ms, - postprocess: 0.513 ms copy: 1.375 ms, - preprocess: 0.052 ms, - infer: 8.857 ms, - postprocess: 0.529 ms copy: 0.856 ms, - preprocess: 0.042 ms, - infer: 7.399 ms, - postprocess: 0.492 ms copy: 1.375 ms, - preprocess: 0.057 ms, - infer: 6.615 ms, - postprocess: 0.466 ms copy: 1.584 ms, - preprocess: 0.056 ms, - infer: 6.637 ms, - postprocess: 0.453 ms copy: 1.339 ms, - preprocess: 0.067 ms, - infer: 6.721 ms, - postprocess: 1.014 ms copy: 1.059 ms, - preprocess: 0.046 ms, - infer: 6.590 ms, - postprocess: 0.510 ms copy: 1.768 ms, - preprocess: 0.075 ms, - infer: 6.787 ms, - postprocess: 0.554 ms copy: 1.444 ms, - preprocess: 0.076 ms, - infer: 6.651 ms, - postprocess: 0.494 ms copy: 0.885 ms, - preprocess: 0.045 ms, - infer: 7.439 ms, - postprocess: 0.532 ms copy: 1.354 ms, - preprocess: 0.061 ms, - infer: 7.315 ms, - postprocess: 0.518 ms copy: 1.555 ms, - preprocess: 0.067 ms, - infer: 6.543 ms, - postprocess: 0.646 ms copy: 1.446 ms, - preprocess: 0.055 ms, - infer: 8.662 ms, - postprocess: 0.554 ms copy: 1.196 ms, - preprocess: 0.044 ms, - infer: 17.758 ms, - postprocess: 0.604 ms copy: 1.743 ms, - preprocess: 0.061 ms, - infer: 139.371 ms, - postprocess: 0.927 ms copy: 1.154 ms, - preprocess: 0.080 ms, - infer: 9.705 ms, - postprocess: 0.584 ms copy: 1.599 ms, - preprocess: 0.068 ms, - infer: 7.579 ms, - postprocess: 0.959 ms copy: 1.375 ms, - preprocess: 0.068 ms, - infer: 9.018 ms, - postprocess: 1.603 ms copy: 0.857 ms, - preprocess: 0.043 ms, - infer: 7.433 ms, - postprocess: 0.522 ms copy: 0.933 ms, - preprocess: 0.034 ms, - infer: 8.715 ms, - postprocess: 0.968 ms copy: 1.318 ms, - preprocess: 0.061 ms, - infer: 7.290 ms, - postprocess: 0.556 ms copy: 1.726 ms, - preprocess: 0.113 ms, - infer: 17.918 ms, - postprocess: 0.671 ms copy: 0.870 ms, - preprocess: 0.040 ms, - infer: 7.811 ms, - postprocess: 0.540 ms copy: 1.517 ms, - preprocess: 0.054 ms, - infer: 8.306 ms, - postprocess: 0.558 ms copy: 1.940 ms, - preprocess: 0.081 ms, - infer: 9.513 ms, - postprocess: 0.883 ms copy: 1.313 ms, - preprocess: 0.076 ms, - infer: 10.124 ms, - postprocess: 0.607 ms copy: 1.316 ms, - preprocess: 0.100 ms, - infer: 8.351 ms, - postprocess: 0.789 ms copy: 1.229 ms, - preprocess: 0.071 ms, - infer: 8.711 ms, - postprocess: 0.610 ms copy: 1.837 ms, - preprocess: 0.067 ms, - infer: 7.502 ms, - postprocess: 0.884 ms copy: 1.347 ms, - preprocess: 0.076 ms, - infer: 7.420 ms, - postprocess: 0.725 ms copy: 1.453 ms, - preprocess: 0.072 ms, - infer: 7.408 ms, - postprocess: 0.571 ms copy: 2.514 ms, - preprocess: 0.114 ms, - infer: 7.848 ms, - postprocess: 0.627 ms copy: 0.917 ms, - preprocess: 0.041 ms, - infer: 8.524 ms, - postprocess: 0.533 ms copy: 1.227 ms, - preprocess: 0.060 ms, - infer: 8.601 ms, - postprocess: 0.643 ms copy: 1.202 ms, - preprocess: 0.060 ms, - infer: 9.549 ms, - postprocess: 0.614 ms copy: 1.333 ms, - preprocess: 0.075 ms, - infer: 7.327 ms, - postprocess: 0.685 ms copy: 1.262 ms, - preprocess: 0.063 ms, - infer: 7.375 ms, - postprocess: 0.523 ms copy: 1.299 ms, - preprocess: 0.065 ms, - infer: 7.729 ms, - postprocess: 0.508 ms copy: 1.322 ms, - preprocess: 0.067 ms, - infer: 7.458 ms, - postprocess: 0.548 ms copy: 0.985 ms, - preprocess: 0.045 ms, - infer: 7.293 ms, - postprocess: 0.560 ms copy: 1.447 ms, - preprocess: 0.056 ms, - infer: 7.273 ms, - postprocess: 0.498 ms copy: 1.264 ms, - preprocess: 0.055 ms, - infer: 7.289 ms, - postprocess: 0.500 ms copy: 1.461 ms, - preprocess: 0.070 ms, - infer: 7.370 ms, - postprocess: 0.641 ms copy: 0.960 ms, - preprocess: 0.048 ms, - infer: 7.562 ms, - postprocess: 0.512 ms copy: 1.736 ms, - preprocess: 0.058 ms, - infer: 16.097 ms, - postprocess: 0.687 ms copy: 1.665 ms, - preprocess: 0.080 ms, - infer: 14.566 ms, - postprocess: 0.768 ms copy: 2.205 ms, - preprocess: 0.071 ms, - infer: 16.115 ms, - postprocess: 0.760 ms copy: 1.858 ms, - preprocess: 0.079 ms, - infer: 14.713 ms, - postprocess: 0.698 ms copy: 2.113 ms, - preprocess: 0.068 ms, - infer: 17.645 ms, - postprocess: 0.845 ms copy: 1.730 ms, - preprocess: 0.068 ms, - infer: 24.852 ms, - postprocess: 0.786 ms copy: 1.373 ms, - preprocess: 0.062 ms, - infer: 15.922 ms, - postprocess: 0.686 ms copy: 1.721 ms, - preprocess: 0.053 ms, - infer: 14.287 ms, - postprocess: 0.719 ms copy: 1.137 ms, - preprocess: 0.052 ms, - infer: 14.519 ms, - postprocess: 0.665 ms copy: 1.623 ms, - preprocess: 0.058 ms, - infer: 14.520 ms, - postprocess: 0.942 ms copy: 1.658 ms, - preprocess: 0.072 ms, - infer: 22.255 ms, - postprocess: 0.774 ms copy: 1.581 ms, - preprocess: 0.060 ms, - infer: 45.066 ms, - postprocess: 0.793 ms copy: 2.236 ms, - preprocess: 0.081 ms, - infer: 14.811 ms, - postprocess: 0.801 ms copy: 1.979 ms, - preprocess: 0.078 ms, - infer: 39.535 ms, - postprocess: 0.765 ms copy: 2.004 ms, - preprocess: 0.079 ms, - infer: 15.254 ms, - postprocess: 2.053 ms copy: 1.668 ms, - preprocess: 0.065 ms, - infer: 18.036 ms, - postprocess: 0.783 ms copy: 1.870 ms, - preprocess: 0.062 ms, - infer: 15.180 ms, - postprocess: 2.088 ms copy: 1.143 ms, - preprocess: 0.049 ms, - infer: 16.720 ms, - postprocess: 0.648 ms copy: 1.688 ms, - preprocess: 0.066 ms, - infer: 21.303 ms, - postprocess: 0.764 ms copy: 1.742 ms, - preprocess: 0.068 ms, - infer: 32.629 ms, - postprocess: 0.726 ms copy: 1.838 ms, - preprocess: 0.074 ms, - infer: 16.034 ms, - postprocess: 1.839 ms copy: 1.722 ms, - preprocess: 0.063 ms, - infer: 16.631 ms, - postprocess: 0.778 ms copy: 1.720 ms, - preprocess: 0.058 ms, - infer: 13.694 ms, - postprocess: 0.745 ms copy: 1.666 ms, - preprocess: 0.060 ms, - infer: 14.317 ms, - postprocess: 0.919 ms copy: 1.593 ms, - preprocess: 0.057 ms, - infer: 14.144 ms, - postprocess: 0.674 ms copy: 1.410 ms, - preprocess: 0.057 ms, - infer: 16.520 ms, - postprocess: 0.694 ms copy: 1.599 ms, - preprocess: 0.064 ms, - infer: 16.348 ms, - postprocess: 0.691 ms copy: 1.881 ms, - preprocess: 0.058 ms, - infer: 15.135 ms, - postprocess: 0.727 ms copy: 1.419 ms, - preprocess: 0.045 ms, - infer: 15.419 ms, - postprocess: 0.724 ms copy: 2.594 ms, - preprocess: 0.054 ms, - infer: 25.066 ms, - postprocess: 0.695 ms copy: 1.662 ms, - preprocess: 0.061 ms, - infer: 17.370 ms, - postprocess: 0.917 ms copy: 1.168 ms, - preprocess: 0.052 ms, - infer: 22.601 ms, - postprocess: 0.669 ms copy: 1.191 ms, - preprocess: 0.042 ms, - infer: 30.324 ms, - postprocess: 0.629 ms copy: 1.364 ms, - preprocess: 0.059 ms, - infer: 19.843 ms, - postprocess: 0.794 ms copy: 1.838 ms, - preprocess: 0.057 ms, - infer: 16.383 ms, - postprocess: 0.636 ms copy: 1.759 ms, - preprocess: 0.076 ms, - infer: 17.095 ms, - postprocess: 0.652 ms copy: 1.714 ms, - preprocess: 0.061 ms, - infer: 23.501 ms, - postprocess: 0.847 ms copy: 1.700 ms, - preprocess: 0.074 ms, - infer: 13.744 ms, - postprocess: 0.751 ms copy: 1.667 ms, - preprocess: 0.074 ms, - infer: 13.827 ms, - postprocess: 0.729 ms copy: 2.059 ms, - preprocess: 0.079 ms, - infer: 18.826 ms, - postprocess: 0.657 ms copy: 1.463 ms, - preprocess: 0.063 ms, - infer: 13.410 ms, - postprocess: 0.676 ms copy: 1.151 ms, - preprocess: 0.049 ms, - infer: 13.418 ms, - postprocess: 0.609 ms copy: 1.825 ms, - preprocess: 0.074 ms, - infer: 13.365 ms, - postprocess: 0.818 ms copy: 1.255 ms, - preprocess: 0.051 ms, - infer: 13.487 ms, - postprocess: 0.662 ms copy: 1.772 ms, - preprocess: 0.078 ms, - infer: 14.684 ms, - postprocess: 0.707 ms copy: 1.918 ms, - preprocess: 0.073 ms, - infer: 18.836 ms, - postprocess: 0.734 ms copy: 1.742 ms, - preprocess: 0.066 ms, - infer: 30.251 ms, - postprocess: 0.727 ms copy: 1.762 ms, - preprocess: 0.065 ms, - infer: 24.542 ms, - postprocess: 2.703 ms copy: 1.714 ms, - preprocess: 0.061 ms, - infer: 39.451 ms, - postprocess: 0.827 ms copy: 1.595 ms, - preprocess: 0.060 ms, - infer: 24.619 ms, - postprocess: 3.116 ms copy: 1.442 ms, - preprocess: 0.086 ms, - infer: 7.240 ms, - postprocess: 0.793 ms copy: 1.583 ms, - preprocess: 0.088 ms, - infer: 7.376 ms, - postprocess: 0.727 ms copy: 1.855 ms, - preprocess: 0.080 ms, - infer: 7.385 ms, - postprocess: 0.599 ms copy: 1.635 ms, - preprocess: 0.086 ms, - infer: 7.272 ms, - postprocess: 0.581 ms copy: 1.825 ms, - preprocess: 0.082 ms, - infer: 7.266 ms, - postprocess: 0.599 ms copy: 1.562 ms, - preprocess: 0.077 ms, - infer: 7.140 ms, - postprocess: 0.666 ms copy: 1.524 ms, - preprocess: 0.078 ms, - infer: 7.161 ms, - postprocess: 0.951 ms copy: 1.691 ms, - preprocess: 0.082 ms, - infer: 7.672 ms, - postprocess: 0.615 ms copy: 1.435 ms, - preprocess: 0.070 ms, - infer: 7.337 ms, - postprocess: 0.637 ms copy: 1.514 ms, - preprocess: 0.071 ms, - infer: 7.106 ms, - postprocess: 0.571 ms copy: 1.287 ms, - preprocess: 0.067 ms, - infer: 8.351 ms, - postprocess: 0.582 ms copy: 0.911 ms, - preprocess: 0.043 ms, - infer: 7.073 ms, - postprocess: 0.541 ms copy: 0.907 ms, - preprocess: 0.043 ms, - infer: 7.119 ms, - postprocess: 0.569 ms copy: 1.774 ms, - preprocess: 0.135 ms, - infer: 8.424 ms, - postprocess: 0.758 ms copy: 0.942 ms, - preprocess: 0.049 ms, - infer: 8.260 ms, - postprocess: 0.585 ms copy: 0.941 ms, - preprocess: 0.044 ms, - infer: 7.114 ms, - postprocess: 0.521 ms copy: 1.186 ms, - preprocess: 0.064 ms, - infer: 8.462 ms, - postprocess: 0.561 ms copy: 0.885 ms, - preprocess: 0.047 ms, - infer: 8.117 ms, - postprocess: 0.536 ms copy: 1.673 ms, - preprocess: 0.059 ms, - infer: 7.473 ms, - postprocess: 0.629 ms copy: 1.450 ms, - preprocess: 0.078 ms, - infer: 7.156 ms, - postprocess: 0.587 ms copy: 1.926 ms, - preprocess: 0.079 ms, - infer: 8.377 ms, - postprocess: 0.586 ms copy: 1.433 ms, - preprocess: 0.084 ms, - infer: 7.226 ms, - postprocess: 1.191 ms copy: 1.687 ms, - preprocess: 0.088 ms, - infer: 7.619 ms, - postprocess: 0.958 ms copy: 1.599 ms, - preprocess: 0.079 ms, - infer: 7.133 ms, - postprocess: 0.563 ms copy: 0.918 ms, - preprocess: 0.051 ms, - infer: 8.010 ms, - postprocess: 0.568 ms copy: 1.577 ms, - preprocess: 0.074 ms, - infer: 7.377 ms, - postprocess: 0.568 ms copy: 1.501 ms, - preprocess: 0.084 ms, - infer: 7.119 ms, - postprocess: 0.562 ms copy: 1.448 ms, - preprocess: 0.078 ms, - infer: 8.113 ms, - postprocess: 0.723 ms copy: 1.712 ms, - preprocess: 0.097 ms, - infer: 7.316 ms, - postprocess: 0.617 ms copy: 1.264 ms, - preprocess: 0.053 ms, - infer: 17.391 ms, - postprocess: 0.703 ms copy: 1.836 ms, - preprocess: 0.072 ms, - infer: 14.695 ms, - postprocess: 0.724 ms copy: 1.931 ms, - preprocess: 0.085 ms, - infer: 16.078 ms, - postprocess: 1.862 ms copy: 1.987 ms, - preprocess: 0.069 ms, - infer: 16.968 ms, - postprocess: 0.750 ms copy: 1.904 ms, - preprocess: 0.081 ms, - infer: 17.883 ms, - postprocess: 0.723 ms copy: 1.713 ms, - preprocess: 0.068 ms, - infer: 14.653 ms, - postprocess: 0.718 ms copy: 1.937 ms, - preprocess: 0.071 ms, - infer: 14.150 ms, - postprocess: 0.816 ms copy: 1.916 ms, - preprocess: 0.077 ms, - infer: 14.740 ms, - postprocess: 0.770 ms copy: 1.901 ms, - preprocess: 0.073 ms, - infer: 21.471 ms, - postprocess: 0.843 ms copy: 2.130 ms, - preprocess: 0.066 ms, - infer: 14.294 ms, - postprocess: 0.957 ms copy: 2.367 ms, - preprocess: 0.084 ms, - infer: 15.107 ms, - postprocess: 1.067 ms copy: 1.825 ms, - preprocess: 0.071 ms, - infer: 14.697 ms, - postprocess: 0.845 ms copy: 1.289 ms, - preprocess: 0.050 ms, - infer: 14.330 ms, - postprocess: 0.849 ms copy: 2.233 ms, - preprocess: 0.075 ms, - infer: 21.494 ms, - postprocess: 0.826 ms copy: 1.489 ms, - preprocess: 0.069 ms, - infer: 20.073 ms, - postprocess: 2.022 ms copy: 1.781 ms, - preprocess: 0.063 ms, - infer: 16.085 ms, - postprocess: 0.767 ms copy: 1.863 ms, - preprocess: 0.062 ms, - infer: 23.314 ms, - postprocess: 0.759 ms copy: 1.150 ms, - preprocess: 0.043 ms, - infer: 24.782 ms, - postprocess: 0.727 ms copy: 1.641 ms, - preprocess: 0.055 ms, - infer: 14.630 ms, - postprocess: 0.684 ms copy: 1.707 ms, - preprocess: 0.074 ms, - infer: 14.466 ms, - postprocess: 0.775 ms copy: 1.686 ms, - preprocess: 0.074 ms, - infer: 17.311 ms, - postprocess: 0.923 ms copy: 1.917 ms, - preprocess: 0.086 ms, - infer: 27.046 ms, - postprocess: 0.738 ms copy: 1.772 ms, - preprocess: 0.070 ms, - infer: 24.148 ms, - postprocess: 0.835 ms copy: 2.255 ms, - preprocess: 0.079 ms, - infer: 24.280 ms, - postprocess: 0.752 ms copy: 1.895 ms, - preprocess: 0.087 ms, - infer: 24.930 ms, - postprocess: 0.714 ms copy: 1.447 ms, - preprocess: 0.062 ms, - infer: 14.594 ms, - postprocess: 0.779 ms copy: 2.237 ms, - preprocess: 0.074 ms, - infer: 21.439 ms, - postprocess: 0.869 ms copy: 1.830 ms, - preprocess: 0.067 ms, - infer: 15.582 ms, - postprocess: 0.677 ms copy: 2.018 ms, - preprocess: 0.066 ms, - infer: 14.622 ms, - postprocess: 0.734 ms copy: 1.273 ms, - preprocess: 0.052 ms, - infer: 19.301 ms, - postprocess: 0.776 ms copy: 2.100 ms, - preprocess: 0.090 ms, - infer: 14.328 ms, - postprocess: 0.776 ms copy: 2.058 ms, - preprocess: 0.086 ms, - infer: 14.699 ms, - postprocess: 0.677 ms copy: 2.497 ms, - preprocess: 0.135 ms, - infer: 21.778 ms, - postprocess: 0.749 ms copy: 2.167 ms, - preprocess: 0.063 ms, - infer: 16.514 ms, - postprocess: 0.753 ms copy: 2.237 ms, - preprocess: 0.074 ms, - infer: 14.930 ms, - postprocess: 0.958 ms copy: 1.475 ms, - preprocess: 0.061 ms, - infer: 14.186 ms, - postprocess: 0.657 ms copy: 1.792 ms, - preprocess: 0.066 ms, - infer: 16.020 ms, - postprocess: 0.720 ms copy: 1.978 ms, - preprocess: 0.067 ms, - infer: 14.446 ms, - postprocess: 0.758 ms copy: 2.108 ms, - preprocess: 0.070 ms, - infer: 21.315 ms, - postprocess: 0.751 ms copy: 1.337 ms, - preprocess: 0.063 ms, - infer: 15.316 ms, - postprocess: 1.152 ms copy: 1.663 ms, - preprocess: 0.060 ms, - infer: 16.922 ms, - postprocess: 0.760 ms copy: 1.603 ms, - preprocess: 0.059 ms, - infer: 25.303 ms, - postprocess: 0.779 ms copy: 1.777 ms, - preprocess: 0.065 ms, - infer: 14.599 ms, - postprocess: 0.776 ms copy: 1.693 ms, - preprocess: 0.072 ms, - infer: 14.719 ms, - postprocess: 0.721 ms copy: 1.700 ms, - preprocess: 0.065 ms, - infer: 14.494 ms, - postprocess: 0.764 ms copy: 1.902 ms, - preprocess: 0.080 ms, - infer: 23.502 ms, - postprocess: 2.005 ms copy: 2.093 ms, - preprocess: 0.074 ms, - infer: 16.909 ms, - postprocess: 1.224 ms copy: 1.955 ms, - preprocess: 0.069 ms, - infer: 18.906 ms, - postprocess: 0.709 ms copy: 1.219 ms, - preprocess: 0.044 ms, - infer: 20.888 ms, - postprocess: 0.682 ms copy: 1.607 ms, - preprocess: 0.073 ms, - infer: 14.672 ms, - postprocess: 0.745 ms copy: 1.742 ms, - preprocess: 0.074 ms, - infer: 14.118 ms, - postprocess: 1.002 ms copy: 1.758 ms, - preprocess: 0.064 ms, - infer: 18.126 ms, - postprocess: 3.590 ms copy: 1.611 ms, - preprocess: 0.063 ms, - infer: 14.373 ms, - postprocess: 0.764 ms copy: 1.624 ms, - preprocess: 0.070 ms, - infer: 14.628 ms, - postprocess: 0.723 ms copy: 1.225 ms, - preprocess: 0.040 ms, - infer: 14.580 ms, - postprocess: 0.709 ms copy: 1.585 ms, - preprocess: 0.063 ms, - infer: 20.186 ms, - postprocess: 0.814 ms copy: 1.922 ms, - preprocess: 0.067 ms, - infer: 14.649 ms, - postprocess: 0.935 ms copy: 1.158 ms, - preprocess: 0.041 ms, - infer: 14.536 ms, - postprocess: 0.630 ms copy: 1.794 ms, - preprocess: 0.056 ms, - infer: 19.818 ms, - postprocess: 0.698 ms copy: 2.154 ms, - preprocess: 0.053 ms, - infer: 17.351 ms, - postprocess: 1.985 ms copy: 1.577 ms, - preprocess: 0.058 ms, - infer: 21.829 ms, - postprocess: 3.990 ms copy: 1.597 ms, - preprocess: 0.058 ms, - infer: 20.798 ms, - postprocess: 0.707 ms copy: 1.606 ms, - preprocess: 0.056 ms, - infer: 19.730 ms, - postprocess: 0.661 ms copy: 1.490 ms, - preprocess: 0.053 ms, - infer: 18.489 ms, - postprocess: 0.672 ms copy: 1.151 ms, - preprocess: 0.041 ms, - infer: 14.574 ms, - postprocess: 0.677 ms copy: 1.488 ms, - preprocess: 0.063 ms, - infer: 22.286 ms, - postprocess: 1.514 ms copy: 1.464 ms, - preprocess: 0.054 ms, - infer: 28.332 ms, - postprocess: 0.707 ms copy: 1.633 ms, - preprocess: 0.080 ms, - infer: 18.326 ms, - postprocess: 1.643 ms copy: 2.051 ms, - preprocess: 0.088 ms, - infer: 14.331 ms, - postprocess: 0.782 ms copy: 1.770 ms, - preprocess: 0.073 ms, - infer: 14.490 ms, - postprocess: 1.112 ms copy: 1.970 ms, - preprocess: 0.082 ms, - infer: 13.788 ms, - postprocess: 0.830 ms copy: 1.887 ms, - preprocess: 0.072 ms, - infer: 13.999 ms, - postprocess: 0.844 ms copy: 1.780 ms, - preprocess: 0.069 ms, - infer: 14.101 ms, - postprocess: 0.710 ms copy: 1.888 ms, - preprocess: 0.086 ms, - infer: 19.188 ms, - postprocess: 0.696 ms copy: 1.418 ms, - preprocess: 0.062 ms, - infer: 20.797 ms, - postprocess: 2.178 ms copy: 1.496 ms, - preprocess: 0.062 ms, - infer: 15.878 ms, - postprocess: 0.738 ms copy: 2.207 ms, - preprocess: 0.065 ms, - infer: 14.961 ms, - postprocess: 0.939 ms copy: 1.715 ms, - preprocess: 0.062 ms, - infer: 16.217 ms, - postprocess: 0.857 ms copy: 2.026 ms, - preprocess: 0.063 ms, - infer: 16.645 ms, - postprocess: 0.712 ms copy: 1.427 ms, - preprocess: 0.061 ms, - infer: 16.929 ms, - postprocess: 0.781 ms copy: 1.864 ms, - preprocess: 0.057 ms, - infer: 51.465 ms, - postprocess: 0.799 ms copy: 1.630 ms, - preprocess: 0.059 ms, - infer: 17.639 ms, - postprocess: 0.717 ms copy: 1.215 ms, - preprocess: 0.048 ms, - infer: 29.348 ms, - postprocess: 1.124 ms copy: 1.912 ms, - preprocess: 0.060 ms, - infer: 15.204 ms, - postprocess: 0.616 ms copy: 1.619 ms, - preprocess: 0.064 ms, - infer: 15.254 ms, - postprocess: 0.646 ms copy: 2.171 ms, - preprocess: 0.094 ms, - infer: 14.685 ms, - postprocess: 0.652 ms copy: 1.820 ms, - preprocess: 0.078 ms, - infer: 14.539 ms, - postprocess: 0.707 ms copy: 1.911 ms, - preprocess: 0.067 ms, - infer: 16.770 ms, - postprocess: 0.646 ms copy: 1.256 ms, - preprocess: 0.047 ms, - infer: 21.974 ms, - postprocess: 0.710 ms copy: 1.654 ms, - preprocess: 0.068 ms, - infer: 16.772 ms, - postprocess: 0.673 ms copy: 1.785 ms, - preprocess: 0.066 ms, - infer: 14.092 ms, - postprocess: 0.665 ms copy: 2.179 ms, - preprocess: 0.104 ms, - infer: 13.481 ms, - postprocess: 0.824 ms copy: 1.522 ms, - preprocess: 0.065 ms, - infer: 13.583 ms, - postprocess: 0.799 ms copy: 1.117 ms, - preprocess: 0.044 ms, - infer: 17.066 ms, - postprocess: 0.595 ms copy: 1.582 ms, - preprocess: 0.058 ms, - infer: 18.653 ms, - postprocess: 0.750 ms copy: 1.597 ms, - preprocess: 0.060 ms, - infer: 15.741 ms, - postprocess: 0.708 ms copy: 1.532 ms, - preprocess: 0.045 ms, - infer: 16.873 ms, - postprocess: 0.717 ms copy: 1.579 ms, - preprocess: 0.058 ms, - infer: 15.024 ms, - postprocess: 0.696 ms copy: 1.608 ms, - preprocess: 0.068 ms, - infer: 14.520 ms, - postprocess: 0.644 ms copy: 1.723 ms, - preprocess: 0.068 ms, - infer: 16.243 ms, - postprocess: 0.670 ms copy: 1.708 ms, - preprocess: 0.064 ms, - infer: 15.002 ms, - postprocess: 0.648 ms copy: 1.902 ms, - preprocess: 0.060 ms, - infer: 13.472 ms, - postprocess: 0.600 ms copy: 1.416 ms, - preprocess: 0.064 ms, - infer: 15.683 ms, - postprocess: 0.741 ms copy: 1.590 ms, - preprocess: 0.055 ms, - infer: 16.353 ms, - postprocess: 0.688 ms copy: 1.579 ms, - preprocess: 0.060 ms, - infer: 16.229 ms, - postprocess: 0.711 ms copy: 1.687 ms, - preprocess: 0.074 ms, - infer: 13.476 ms, - postprocess: 1.826 ms copy: 1.599 ms, - preprocess: 0.060 ms, - infer: 24.663 ms, - postprocess: 0.670 ms copy: 1.849 ms, - preprocess: 0.076 ms, - infer: 16.224 ms, - postprocess: 0.863 ms copy: 1.711 ms, - preprocess: 0.081 ms, - infer: 14.664 ms, - postprocess: 0.737 ms copy: 1.642 ms, - preprocess: 0.071 ms, - infer: 17.908 ms, - postprocess: 0.675 ms copy: 1.743 ms, - preprocess: 0.063 ms, - infer: 14.230 ms, - postprocess: 0.767 ms copy: 1.612 ms, - preprocess: 0.060 ms, - infer: 14.446 ms, - postprocess: 1.556 ms copy: 1.654 ms, - preprocess: 0.156 ms, - infer: 23.492 ms, - postprocess: 0.795 ms copy: 1.741 ms, - preprocess: 0.077 ms, - infer: 25.221 ms, - postprocess: 0.765 ms copy: 1.544 ms, - preprocess: 0.049 ms, - infer: 25.658 ms, - postprocess: 0.720 ms copy: 2.227 ms, - preprocess: 0.073 ms, - infer: 18.730 ms, - postprocess: 0.836 ms copy: 1.735 ms, - preprocess: 0.067 ms, - infer: 18.637 ms, - postprocess: 2.366 ms copy: 2.847 ms, - preprocess: 0.066 ms, - infer: 24.685 ms, - postprocess: 0.956 ms copy: 1.792 ms, - preprocess: 0.068 ms, - infer: 33.444 ms, - postprocess: 0.929 ms copy: 2.100 ms, - preprocess: 0.080 ms, - infer: 19.516 ms, - postprocess: 0.748 ms copy: 1.636 ms, - preprocess: 0.058 ms, - infer: 30.000 ms, - postprocess: 0.726 ms copy: 2.115 ms, - preprocess: 0.064 ms, - infer: 16.608 ms, - postprocess: 3.078 ms copy: 2.571 ms, - preprocess: 0.043 ms, - infer: 26.906 ms, - postprocess: 0.631 ms copy: 1.609 ms, - preprocess: 0.063 ms, - infer: 16.216 ms, - postprocess: 0.712 ms copy: 1.742 ms, - preprocess: 0.060 ms, - infer: 15.720 ms, - postprocess: 0.671 ms copy: 1.368 ms, - preprocess: 0.060 ms, - infer: 16.327 ms, - postprocess: 0.774 ms copy: 1.923 ms, - preprocess: 0.072 ms, - infer: 13.895 ms, - postprocess: 0.695 ms copy: 1.880 ms, - preprocess: 0.078 ms, - infer: 13.810 ms, - postprocess: 0.978 ms copy: 1.998 ms, - preprocess: 0.074 ms, - infer: 20.346 ms, - postprocess: 0.648 ms copy: 1.672 ms, - preprocess: 0.073 ms, - infer: 13.755 ms, - postprocess: 0.676 ms copy: 1.531 ms, - preprocess: 0.077 ms, - infer: 13.660 ms, - postprocess: 0.768 ms copy: 1.858 ms, - preprocess: 0.066 ms, - infer: 13.839 ms, - postprocess: 0.703 ms copy: 1.361 ms, - preprocess: 0.056 ms, - infer: 13.762 ms, - postprocess: 0.680 ms copy: 1.880 ms, - preprocess: 0.069 ms, - infer: 13.520 ms, - postprocess: 0.730 ms copy: 2.454 ms, - preprocess: 0.084 ms, - infer: 21.866 ms, - postprocess: 0.733 ms copy: 1.692 ms, - preprocess: 0.117 ms, - infer: 15.801 ms, - postprocess: 2.453 ms copy: 1.896 ms, - preprocess: 0.068 ms, - infer: 13.628 ms, - postprocess: 0.914 ms copy: 1.738 ms, - preprocess: 0.066 ms, - infer: 13.626 ms, - postprocess: 0.772 ms copy: 2.520 ms, - preprocess: 0.051 ms, - infer: 33.990 ms, - postprocess: 1.097 ms copy: 2.256 ms, - preprocess: 0.055 ms, - infer: 32.704 ms, - postprocess: 1.095 ms copy: 2.292 ms, - preprocess: 0.066 ms, - infer: 21.078 ms, - postprocess: 1.119 ms copy: 1.827 ms, - preprocess: 0.062 ms, - infer: 21.095 ms, - postprocess: 1.111 ms copy: 1.958 ms, - preprocess: 0.064 ms, - infer: 28.401 ms, - postprocess: 1.201 ms copy: 2.311 ms, - preprocess: 0.059 ms, - infer: 27.083 ms, - postprocess: 1.155 ms copy: 1.634 ms, - preprocess: 0.060 ms, - infer: 21.377 ms, - postprocess: 1.140 ms copy: 2.162 ms, - preprocess: 0.068 ms, - infer: 28.936 ms, - postprocess: 1.149 ms copy: 1.882 ms, - preprocess: 0.065 ms, - infer: 23.056 ms, - postprocess: 1.167 ms copy: 1.404 ms, - preprocess: 0.045 ms, - infer: 21.204 ms, - postprocess: 1.140 ms copy: 2.136 ms, - preprocess: 0.062 ms, - infer: 25.593 ms, - postprocess: 1.092 ms copy: 1.967 ms, - preprocess: 0.070 ms, - infer: 30.667 ms, - postprocess: 1.133 ms copy: 2.103 ms, - preprocess: 0.069 ms, - infer: 36.956 ms, - postprocess: 1.134 ms copy: 1.799 ms, - preprocess: 0.062 ms, - infer: 24.612 ms, - postprocess: 1.125 ms copy: 1.986 ms, - preprocess: 0.066 ms, - infer: 24.035 ms, - postprocess: 1.123 ms copy: 1.841 ms, - preprocess: 0.062 ms, - infer: 21.197 ms, - postprocess: 1.142 ms copy: 2.896 ms, - preprocess: 0.078 ms, - infer: 25.898 ms, - postprocess: 1.204 ms copy: 2.702 ms, - preprocess: 0.081 ms, - infer: 66.956 ms, - postprocess: 4.723 ms copy: 3.741 ms, - preprocess: 0.084 ms, - infer: 23.571 ms, - postprocess: 0.735 ms copy: 1.769 ms, - preprocess: 0.076 ms, - infer: 29.384 ms, - postprocess: 0.724 ms copy: 1.712 ms, - preprocess: 0.067 ms, - infer: 14.460 ms, - postprocess: 0.736 ms copy: 1.883 ms, - preprocess: 0.060 ms, - infer: 14.577 ms, - postprocess: 0.716 ms copy: 1.906 ms, - preprocess: 0.076 ms, - infer: 16.674 ms, - postprocess: 0.669 ms copy: 2.147 ms, - preprocess: 0.083 ms, - infer: 21.148 ms, - postprocess: 1.185 ms copy: 2.111 ms, - preprocess: 0.079 ms, - infer: 26.892 ms, - postprocess: 1.141 ms copy: 2.009 ms, - preprocess: 0.074 ms, - infer: 30.592 ms, - postprocess: 1.206 ms copy: 1.768 ms, - preprocess: 0.064 ms, - infer: 21.289 ms, - postprocess: 1.106 ms copy: 1.784 ms, - preprocess: 0.062 ms, - infer: 21.445 ms, - postprocess: 1.104 ms copy: 2.247 ms, - preprocess: 0.069 ms, - infer: 21.258 ms, - postprocess: 1.155 ms copy: 2.182 ms, - preprocess: 0.079 ms, - infer: 26.805 ms, - postprocess: 1.147 ms copy: 2.124 ms, - preprocess: 0.088 ms, - infer: 23.321 ms, - postprocess: 1.184 ms copy: 2.162 ms, - preprocess: 0.073 ms, - infer: 21.382 ms, - postprocess: 1.356 ms copy: 1.916 ms, - preprocess: 0.073 ms, - infer: 47.429 ms, - postprocess: 1.207 ms copy: 1.406 ms, - preprocess: 0.043 ms, - infer: 33.998 ms, - postprocess: 1.105 ms copy: 1.907 ms, - preprocess: 0.062 ms, - infer: 65.601 ms, - postprocess: 1.329 ms copy: 1.490 ms, - preprocess: 0.053 ms, - infer: 17.680 ms, - postprocess: 0.804 ms copy: 1.748 ms, - preprocess: 0.056 ms, - infer: 21.675 ms, - postprocess: 0.761 ms copy: 1.642 ms, - preprocess: 0.072 ms, - infer: 15.721 ms, - postprocess: 0.922 ms copy: 1.548 ms, - preprocess: 0.061 ms, - infer: 15.147 ms, - postprocess: 0.710 ms copy: 1.993 ms, - preprocess: 0.072 ms, - infer: 14.284 ms, - postprocess: 0.849 ms copy: 1.815 ms, - preprocess: 0.069 ms, - infer: 16.340 ms, - postprocess: 0.723 ms copy: 2.359 ms, - preprocess: 0.070 ms, - infer: 18.683 ms, - postprocess: 0.803 ms copy: 1.708 ms, - preprocess: 0.067 ms, - infer: 24.090 ms, - postprocess: 0.796 ms copy: 1.278 ms, - preprocess: 0.051 ms, - infer: 16.678 ms, - postprocess: 0.676 ms copy: 1.146 ms, - preprocess: 0.037 ms, - infer: 16.097 ms, - postprocess: 0.695 ms copy: 1.763 ms, - preprocess: 0.056 ms, - infer: 16.893 ms, - postprocess: 0.712 ms copy: 1.790 ms, - preprocess: 0.060 ms, - infer: 14.224 ms, - postprocess: 0.717 ms copy: 1.465 ms, - preprocess: 0.059 ms, - infer: 19.600 ms, - postprocess: 0.707 ms copy: 1.693 ms, - preprocess: 0.074 ms, - infer: 14.712 ms, - postprocess: 0.878 ms copy: 2.401 ms, - preprocess: 0.076 ms, - infer: 14.582 ms, - postprocess: 1.150 ms copy: 1.821 ms, - preprocess: 0.081 ms, - infer: 14.742 ms, - postprocess: 1.178 ms copy: 1.284 ms, - preprocess: 0.050 ms, - infer: 21.825 ms, - postprocess: 0.704 ms copy: 1.785 ms, - preprocess: 0.083 ms, - infer: 17.255 ms, - postprocess: 0.772 ms copy: 1.683 ms, - preprocess: 0.066 ms, - infer: 14.403 ms, - postprocess: 0.715 ms copy: 1.709 ms, - preprocess: 0.077 ms, - infer: 14.199 ms, - postprocess: 0.861 ms copy: 1.962 ms, - preprocess: 0.069 ms, - infer: 17.181 ms, - postprocess: 0.800 ms copy: 1.712 ms, - preprocess: 0.062 ms, - infer: 22.085 ms, - postprocess: 0.731 ms copy: 1.635 ms, - preprocess: 0.059 ms, - infer: 21.294 ms, - postprocess: 0.740 ms copy: 1.599 ms, - preprocess: 0.061 ms, - infer: 19.765 ms, - postprocess: 0.726 ms copy: 1.628 ms, - preprocess: 0.044 ms, - infer: 18.064 ms, - postprocess: 1.117 ms copy: 1.966 ms, - preprocess: 0.071 ms, - infer: 17.325 ms, - postprocess: 0.894 ms copy: 1.888 ms, - preprocess: 0.068 ms, - infer: 14.180 ms, - postprocess: 0.876 ms copy: 1.543 ms, - preprocess: 0.053 ms, - infer: 15.721 ms, - postprocess: 2.588 ms copy: 1.804 ms, - preprocess: 0.060 ms, - infer: 37.551 ms, - postprocess: 0.825 ms copy: 1.893 ms, - preprocess: 0.079 ms, - infer: 17.529 ms, - postprocess: 0.776 ms copy: 1.634 ms, - preprocess: 0.080 ms, - infer: 16.887 ms, - postprocess: 0.734 ms copy: 1.928 ms, - preprocess: 0.068 ms, - infer: 17.937 ms, - postprocess: 0.788 ms copy: 1.716 ms, - preprocess: 0.073 ms, - infer: 17.165 ms, - postprocess: 0.760 ms copy: 1.751 ms, - preprocess: 0.077 ms, - infer: 17.385 ms, - postprocess: 0.809 ms copy: 1.231 ms, - preprocess: 0.048 ms, - infer: 16.757 ms, - postprocess: 0.764 ms copy: 1.820 ms, - preprocess: 0.075 ms, - infer: 14.781 ms, - postprocess: 0.767 ms copy: 1.439 ms, - preprocess: 0.061 ms, - infer: 26.025 ms, - postprocess: 2.767 ms copy: 2.979 ms, - preprocess: 0.062 ms, - infer: 184.079 ms, - postprocess: 0.482 ms copy: 0.713 ms, - preprocess: 0.044 ms, - infer: 2.636 ms, - postprocess: 0.330 ms copy: 1.944 ms, - preprocess: 0.079 ms, - infer: 3.807 ms, - postprocess: 0.507 ms copy: 0.860 ms, - preprocess: 0.047 ms, - infer: 2.651 ms, - postprocess: 0.361 ms copy: 1.202 ms, - preprocess: 0.067 ms, - infer: 2.779 ms, - postprocess: 0.389 ms copy: 1.368 ms, - preprocess: 0.090 ms, - infer: 2.994 ms, - postprocess: 0.568 ms copy: 0.851 ms, - preprocess: 0.052 ms, - infer: 2.797 ms, - postprocess: 0.420 ms copy: 1.332 ms, - preprocess: 0.070 ms, - infer: 2.782 ms, - postprocess: 0.437 ms copy: 1.380 ms, - preprocess: 0.080 ms, - infer: 2.807 ms, - postprocess: 0.390 ms copy: 1.264 ms, - preprocess: 0.070 ms, - infer: 3.132 ms, - postprocess: 0.392 ms copy: 1.054 ms, - preprocess: 0.062 ms, - infer: 3.169 ms, - postprocess: 0.425 ms copy: 1.981 ms, - preprocess: 0.081 ms, - infer: 3.377 ms, - postprocess: 0.446 ms copy: 1.523 ms, - preprocess: 0.086 ms, - infer: 3.156 ms, - postprocess: 0.876 ms copy: 1.474 ms, - preprocess: 0.065 ms, - infer: 2.828 ms, - postprocess: 0.440 ms copy: 0.808 ms, - preprocess: 0.051 ms, - infer: 2.775 ms, - postprocess: 0.412 ms copy: 1.548 ms, - preprocess: 0.095 ms, - infer: 3.145 ms, - postprocess: 0.464 ms copy: 1.092 ms, - preprocess: 0.064 ms, - infer: 2.875 ms, - postprocess: 0.494 ms copy: 1.456 ms, - preprocess: 0.094 ms, - infer: 3.297 ms, - postprocess: 0.381 ms copy: 1.435 ms, - preprocess: 0.073 ms, - infer: 3.058 ms, - postprocess: 0.430 ms copy: 1.528 ms, - preprocess: 0.065 ms, - infer: 2.846 ms, - postprocess: 0.429 ms copy: 0.756 ms, - preprocess: 0.046 ms, - infer: 3.572 ms, - postprocess: 0.423 ms copy: 1.255 ms, - preprocess: 0.070 ms, - infer: 2.692 ms, - postprocess: 0.417 ms copy: 1.262 ms, - preprocess: 0.083 ms, - infer: 2.797 ms, - postprocess: 0.476 ms copy: 1.496 ms, - preprocess: 0.063 ms, - infer: 2.745 ms, - postprocess: 0.424 ms copy: 1.869 ms, - preprocess: 0.082 ms, - infer: 2.923 ms, - postprocess: 0.470 ms copy: 0.934 ms, - preprocess: 0.052 ms, - infer: 2.783 ms, - postprocess: 0.389 ms copy: 1.355 ms, - preprocess: 0.070 ms, - infer: 2.829 ms, - postprocess: 0.365 ms copy: 1.655 ms, - preprocess: 0.060 ms, - infer: 2.900 ms, - postprocess: 0.429 ms copy: 1.070 ms, - preprocess: 0.063 ms, - infer: 3.930 ms, - postprocess: 0.400 ms copy: 1.678 ms, - preprocess: 0.080 ms, - infer: 2.839 ms, - postprocess: 0.429 ms copy: 1.892 ms, - preprocess: 0.063 ms, - infer: 2.866 ms, - postprocess: 0.381 ms copy: 1.707 ms, - preprocess: 0.059 ms, - infer: 2.782 ms, - postprocess: 0.389 ms copy: 1.225 ms, - preprocess: 0.062 ms, - infer: 10.705 ms, - postprocess: 0.617 ms copy: 1.023 ms, - preprocess: 0.045 ms, - infer: 9.027 ms, - postprocess: 0.609 ms copy: 0.881 ms, - preprocess: 0.042 ms, - infer: 7.862 ms, - postprocess: 0.569 ms copy: 1.775 ms, - preprocess: 0.065 ms, - infer: 9.128 ms, - postprocess: 0.630 ms copy: 1.356 ms, - preprocess: 0.066 ms, - infer: 7.810 ms, - postprocess: 0.606 ms copy: 1.415 ms, - preprocess: 0.080 ms, - infer: 7.896 ms, - postprocess: 0.741 ms copy: 1.306 ms, - preprocess: 0.066 ms, - infer: 9.177 ms, - postprocess: 0.719 ms copy: 1.670 ms, - preprocess: 0.060 ms, - infer: 8.080 ms, - postprocess: 0.661 ms copy: 1.210 ms, - preprocess: 0.060 ms, - infer: 8.129 ms, - postprocess: 0.610 ms copy: 0.961 ms, - preprocess: 0.045 ms, - infer: 8.880 ms, - postprocess: 0.624 ms copy: 1.671 ms, - preprocess: 0.078 ms, - infer: 8.627 ms, - postprocess: 1.131 ms copy: 1.412 ms, - preprocess: 0.071 ms, - infer: 9.526 ms, - postprocess: 0.924 ms copy: 1.277 ms, - preprocess: 0.063 ms, - infer: 8.289 ms, - postprocess: 0.605 ms

FeiYull commented 7 months ago

是笔记本还是台式机?

FeiYull @.***

------------------ 原始邮件 ------------------ 发件人: yohnyang @.> 发送时间: 2023年12月25日 12:36 收件人: FeiYull/TensorRT-Alpha @.> 抄送: FeiYull @.>, Comment @.> 主题: Re: [FeiYull/TensorRT-Alpha] v8检测模型速度 (Issue #63)

[12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] Init CUDA: CPU +442, GPU +0, now: CPU 14318, GPU 1252 (MiB) [12/25/2023-12:32:49] [I] [TRT] Loaded engine size: 7 MiB [12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +0, now: CPU 0, GPU 0 (MiB) [12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +0, now: CPU 0, GPU 0 (MiB) init: 1272.88 copy: 0.970 ms, - preprocess: 0.054 ms, - infer: 2.920 ms, - postprocess: 0.486 ms copy: 0.718 ms, - preprocess: 0.042 ms, - infer: 2.861 ms, - postprocess: 0.466 ms copy: 1.111 ms, - preprocess: 0.060 ms, - infer: 2.694 ms, - postprocess: 0.348 ms copy: 1.163 ms, - preprocess: 0.066 ms, - infer: 2.827 ms, - postprocess: 0.380 ms copy: 1.038 ms, - preprocess: 0.072 ms, - infer: 3.420 ms, - postprocess: 0.363 ms copy: 1.149 ms, - preprocess: 0.064 ms, - infer: 3.401 ms, - postprocess: 0.456 ms copy: 1.383 ms, - preprocess: 0.055 ms, - infer: 2.712 ms, - postprocess: 0.408 ms copy: 1.188 ms, - preprocess: 0.060 ms, - infer: 2.801 ms, - postprocess: 0.355 ms copy: 0.790 ms, - preprocess: 0.040 ms, - infer: 2.865 ms, - postprocess: 0.395 ms copy: 1.315 ms, - preprocess: 0.041 ms, - infer: 2.711 ms, - postprocess: 0.312 ms copy: 1.016 ms, - preprocess: 0.071 ms, - infer: 2.688 ms, - postprocess: 0.353 ms copy: 1.099 ms, - preprocess: 0.074 ms, - infer: 3.055 ms, - postprocess: 0.476 ms copy: 1.450 ms, - preprocess: 0.077 ms, - infer: 2.807 ms, - postprocess: 0.428 ms copy: 1.060 ms, - preprocess: 0.063 ms, - infer: 2.736 ms, - postprocess: 0.422 ms copy: 1.165 ms, - preprocess: 0.067 ms, - infer: 3.286 ms, - postprocess: 0.384 ms copy: 1.077 ms, - preprocess: 0.074 ms, - infer: 2.992 ms, - postprocess: 0.462 ms copy: 1.144 ms, - preprocess: 0.077 ms, - infer: 2.971 ms, - postprocess: 0.556 ms copy: 1.007 ms, - preprocess: 0.059 ms, - infer: 2.931 ms, - postprocess: 0.352 ms copy: 1.701 ms, - preprocess: 0.139 ms, - infer: 2.917 ms, - postprocess: 0.713 ms copy: 0.804 ms, - preprocess: 0.048 ms, - infer: 3.272 ms, - postprocess: 0.506 ms copy: 0.848 ms, - preprocess: 0.049 ms, - infer: 2.808 ms, - postprocess: 0.423 ms copy: 1.916 ms, - preprocess: 0.087 ms, - infer: 2.844 ms, - postprocess: 0.443 ms copy: 1.543 ms, - preprocess: 0.074 ms, - infer: 2.906 ms, - postprocess: 0.503 ms copy: 2.071 ms, - preprocess: 0.094 ms, - infer: 3.012 ms, - postprocess: 0.473 ms copy: 1.616 ms, - preprocess: 0.098 ms, - infer: 2.999 ms, - postprocess: 0.429 ms copy: 1.363 ms, - preprocess: 0.078 ms, - infer: 2.894 ms, - postprocess: 0.388 ms copy: 1.090 ms, - preprocess: 0.064 ms, - infer: 3.412 ms, - postprocess: 0.492 ms copy: 1.452 ms, - preprocess: 0.088 ms, - infer: 3.614 ms, - postprocess: 0.500 ms copy: 1.386 ms, - preprocess: 0.089 ms, - infer: 2.893 ms, - postprocess: 0.542 ms copy: 1.525 ms, - preprocess: 0.102 ms, - infer: 2.949 ms, - postprocess: 0.475 ms copy: 0.780 ms, - preprocess: 0.052 ms, - infer: 2.700 ms, - postprocess: 0.455 ms copy: 1.705 ms, - preprocess: 0.138 ms, - infer: 3.550 ms, - postprocess: 0.803 ms copy: 0.897 ms, - preprocess: 0.045 ms, - infer: 2.998 ms, - postprocess: 0.369 ms copy: 0.842 ms, - preprocess: 0.043 ms, - infer: 3.074 ms, - postprocess: 0.467 ms copy: 1.786 ms, - preprocess: 0.080 ms, - infer: 2.905 ms, - postprocess: 0.499 ms copy: 0.957 ms, - preprocess: 0.049 ms, - infer: 3.179 ms, - postprocess: 0.346 ms copy: 1.065 ms, - preprocess: 0.041 ms, - infer: 2.746 ms, - postprocess: 0.367 ms copy: 1.123 ms, - preprocess: 0.050 ms, - infer: 2.882 ms, - postprocess: 0.374 ms copy: 1.468 ms, - preprocess: 0.079 ms, - infer: 3.133 ms, - postprocess: 0.466 ms copy: 1.003 ms, - preprocess: 0.049 ms, - infer: 2.702 ms, - postprocess: 0.349 ms copy: 1.513 ms, - preprocess: 0.183 ms, - infer: 3.818 ms, - postprocess: 0.631 ms copy: 1.896 ms, - preprocess: 0.096 ms, - infer: 3.241 ms, - postprocess: 0.673 ms copy: 0.896 ms, - preprocess: 0.059 ms, - infer: 2.786 ms, - postprocess: 0.377 ms copy: 1.449 ms, - preprocess: 0.064 ms, - infer: 2.742 ms, - postprocess: 0.462 ms copy: 1.831 ms, - preprocess: 0.072 ms, - infer: 2.842 ms, - postprocess: 0.420 ms copy: 0.915 ms, - preprocess: 0.051 ms, - infer: 2.738 ms, - postprocess: 0.371 ms copy: 1.255 ms, - preprocess: 0.071 ms, - infer: 2.812 ms, - postprocess: 0.402 ms copy: 1.429 ms, - preprocess: 0.084 ms, - infer: 2.976 ms, - postprocess: 0.564 ms copy: 1.628 ms, - preprocess: 0.087 ms, - infer: 3.636 ms, - postprocess: 0.454 ms copy: 1.556 ms, - preprocess: 0.079 ms, - infer: 3.243 ms, - postprocess: 0.445 ms copy: 1.844 ms, - preprocess: 0.079 ms, - infer: 3.016 ms, - postprocess: 0.567 ms copy: 1.447 ms, - preprocess: 0.079 ms, - infer: 3.287 ms, - postprocess: 0.469 ms copy: 1.891 ms, - preprocess: 0.091 ms, - infer: 2.946 ms, - postprocess: 0.501 ms copy: 1.507 ms, - preprocess: 0.080 ms, - infer: 2.867 ms, - postprocess: 0.480 ms copy: 1.604 ms, - preprocess: 0.089 ms, - infer: 2.898 ms, - postprocess: 0.560 ms copy: 1.547 ms, - preprocess: 0.077 ms, - infer: 3.247 ms, - postprocess: 0.411 ms copy: 1.445 ms, - preprocess: 0.083 ms, - infer: 2.890 ms, - postprocess: 0.431 ms copy: 1.415 ms, - preprocess: 0.081 ms, - infer: 2.831 ms, - postprocess: 0.402 ms copy: 0.936 ms, - preprocess: 0.049 ms, - infer: 2.855 ms, - postprocess: 0.371 ms copy: 1.068 ms, - preprocess: 0.066 ms, - infer: 2.879 ms, - postprocess: 0.426 ms copy: 0.963 ms, - preprocess: 0.051 ms, - infer: 2.705 ms, - postprocess: 0.431 ms copy: 1.907 ms, - preprocess: 0.079 ms, - infer: 3.298 ms, - postprocess: 0.536 ms copy: 0.880 ms, - preprocess: 0.045 ms, - infer: 2.776 ms, - postprocess: 0.418 ms copy: 1.525 ms, - preprocess: 0.056 ms, - infer: 2.780 ms, - postprocess: 0.482 ms copy: 1.562 ms, - preprocess: 0.085 ms, - infer: 2.987 ms, - postprocess: 0.478 ms copy: 1.656 ms, - preprocess: 0.090 ms, - infer: 4.395 ms, - postprocess: 0.617 ms copy: 1.571 ms, - preprocess: 0.091 ms, - infer: 2.904 ms, - postprocess: 0.470 ms copy: 1.423 ms, - preprocess: 0.080 ms, - infer: 2.879 ms, - postprocess: 0.398 ms copy: 1.577 ms, - preprocess: 0.080 ms, - infer: 3.234 ms, - postprocess: 0.501 ms copy: 0.991 ms, - preprocess: 0.056 ms, - infer: 2.764 ms, - postprocess: 0.368 ms copy: 1.493 ms, - preprocess: 0.071 ms, - infer: 3.190 ms, - postprocess: 0.525 ms copy: 1.524 ms, - preprocess: 0.086 ms, - infer: 3.204 ms, - postprocess: 0.543 ms copy: 1.492 ms, - preprocess: 0.089 ms, - infer: 3.259 ms, - postprocess: 0.543 ms copy: 1.554 ms, - preprocess: 0.089 ms, - infer: 4.515 ms, - postprocess: 0.820 ms copy: 1.750 ms, - preprocess: 0.086 ms, - infer: 3.465 ms, - postprocess: 0.458 ms copy: 0.850 ms, - preprocess: 0.050 ms, - infer: 2.714 ms, - postprocess: 0.362 ms copy: 1.398 ms, - preprocess: 0.074 ms, - infer: 2.808 ms, - postprocess: 0.482 ms copy: 1.702 ms, - preprocess: 0.079 ms, - infer: 2.805 ms, - postprocess: 0.445 ms copy: 1.639 ms, - preprocess: 0.079 ms, - infer: 2.903 ms, - postprocess: 0.454 ms copy: 1.605 ms, - preprocess: 0.096 ms, - infer: 3.177 ms, - postprocess: 0.434 ms copy: 1.448 ms, - preprocess: 0.080 ms, - infer: 2.891 ms, - postprocess: 0.405 ms copy: 1.726 ms, - preprocess: 0.089 ms, - infer: 2.929 ms, - postprocess: 0.428 ms copy: 1.513 ms, - preprocess: 0.090 ms, - infer: 2.898 ms, - postprocess: 0.529 ms copy: 1.637 ms, - preprocess: 0.096 ms, - infer: 3.125 ms, - postprocess: 0.477 ms copy: 1.705 ms, - preprocess: 0.104 ms, - infer: 3.307 ms, - postprocess: 0.568 ms copy: 1.520 ms, - preprocess: 0.075 ms, - infer: 2.822 ms, - postprocess: 0.470 ms copy: 1.891 ms, - preprocess: 0.075 ms, - infer: 7.916 ms, - postprocess: 0.712 ms copy: 1.552 ms, - preprocess: 0.075 ms, - infer: 10.377 ms, - postprocess: 0.597 ms copy: 1.450 ms, - preprocess: 0.073 ms, - infer: 9.113 ms, - postprocess: 0.632 ms copy: 1.661 ms, - preprocess: 0.102 ms, - infer: 8.525 ms, - postprocess: 0.762 ms copy: 1.923 ms, - preprocess: 0.097 ms, - infer: 8.240 ms, - postprocess: 0.617 ms copy: 1.540 ms, - preprocess: 0.087 ms, - infer: 8.731 ms, - postprocess: 0.637 ms copy: 1.619 ms, - preprocess: 0.072 ms, - infer: 11.964 ms, - postprocess: 0.687 ms copy: 1.545 ms, - preprocess: 0.072 ms, - infer: 11.431 ms, - postprocess: 0.615 ms copy: 1.445 ms, - preprocess: 0.081 ms, - infer: 8.924 ms, - postprocess: 0.623 ms copy: 1.633 ms, - preprocess: 0.086 ms, - infer: 8.990 ms, - postprocess: 0.691 ms copy: 1.298 ms, - preprocess: 0.067 ms, - infer: 8.209 ms, - postprocess: 0.743 ms copy: 1.560 ms, - preprocess: 0.086 ms, - infer: 10.029 ms, - postprocess: 0.623 ms copy: 1.823 ms, - preprocess: 0.075 ms, - infer: 8.460 ms, - postprocess: 0.602 ms copy: 2.344 ms, - preprocess: 0.068 ms, - infer: 13.186 ms, - postprocess: 0.665 ms copy: 1.852 ms, - preprocess: 0.080 ms, - infer: 13.792 ms, - postprocess: 0.686 ms copy: 1.753 ms, - preprocess: 0.069 ms, - infer: 19.976 ms, - postprocess: 0.653 ms copy: 2.096 ms, - preprocess: 0.091 ms, - infer: 13.315 ms, - postprocess: 0.877 ms copy: 2.704 ms, - preprocess: 0.069 ms, - infer: 13.448 ms, - postprocess: 0.683 ms copy: 1.786 ms, - preprocess: 0.077 ms, - infer: 15.824 ms, - postprocess: 0.785 ms copy: 1.747 ms, - preprocess: 0.068 ms, - infer: 13.364 ms, - postprocess: 0.697 ms copy: 2.313 ms, - preprocess: 0.083 ms, - infer: 13.895 ms, - postprocess: 1.702 ms copy: 1.225 ms, - preprocess: 0.049 ms, - infer: 19.847 ms, - postprocess: 0.613 ms copy: 1.794 ms, - preprocess: 0.081 ms, - infer: 13.535 ms, - postprocess: 0.734 ms copy: 2.554 ms, - preprocess: 0.073 ms, - infer: 13.545 ms, - postprocess: 0.820 ms copy: 1.945 ms, - preprocess: 0.076 ms, - infer: 14.034 ms, - postprocess: 0.823 ms copy: 1.467 ms, - preprocess: 0.062 ms, - infer: 13.837 ms, - postprocess: 0.769 ms copy: 1.892 ms, - preprocess: 0.084 ms, - infer: 13.878 ms, - postprocess: 0.712 ms copy: 1.836 ms, - preprocess: 0.067 ms, - infer: 24.783 ms, - postprocess: 0.668 ms copy: 1.769 ms, - preprocess: 0.067 ms, - infer: 14.089 ms, - postprocess: 0.717 ms copy: 1.858 ms, - preprocess: 0.068 ms, - infer: 14.298 ms, - postprocess: 0.873 ms copy: 1.974 ms, - preprocess: 0.075 ms, - infer: 17.546 ms, - postprocess: 0.702 ms copy: 2.365 ms, - preprocess: 0.082 ms, - infer: 25.993 ms, - postprocess: 3.339 ms copy: 2.342 ms, - preprocess: 0.070 ms, - infer: 21.202 ms, - postprocess: 1.125 ms copy: 2.279 ms, - preprocess: 0.075 ms, - infer: 25.741 ms, - postprocess: 1.193 ms copy: 2.060 ms, - preprocess: 0.072 ms, - infer: 30.792 ms, - postprocess: 1.174 ms copy: 2.326 ms, - preprocess: 0.069 ms, - infer: 25.668 ms, - postprocess: 1.194 ms copy: 2.208 ms, - preprocess: 0.077 ms, - infer: 32.283 ms, - postprocess: 1.335 ms copy: 2.141 ms, - preprocess: 0.071 ms, - infer: 20.916 ms, - postprocess: 1.117 ms copy: 1.656 ms, - preprocess: 0.072 ms, - infer: 35.625 ms, - postprocess: 1.103 ms copy: 2.251 ms, - preprocess: 0.074 ms, - infer: 21.370 ms, - postprocess: 1.266 ms copy: 1.425 ms, - preprocess: 0.047 ms, - infer: 25.668 ms, - postprocess: 1.061 ms copy: 1.959 ms, - preprocess: 0.061 ms, - infer: 27.841 ms, - postprocess: 1.092 ms copy: 1.622 ms, - preprocess: 0.060 ms, - infer: 23.172 ms, - postprocess: 1.341 ms copy: 1.893 ms, - preprocess: 0.062 ms, - infer: 21.296 ms, - postprocess: 1.148 ms copy: 2.114 ms, - preprocess: 0.092 ms, - infer: 21.356 ms, - postprocess: 1.175 ms copy: 1.958 ms, - preprocess: 0.067 ms, - infer: 24.029 ms, - postprocess: 1.160 ms copy: 2.224 ms, - preprocess: 0.065 ms, - infer: 29.107 ms, - postprocess: 1.364 ms copy: 2.005 ms, - preprocess: 0.094 ms, - infer: 32.317 ms, - postprocess: 1.167 ms copy: 2.680 ms, - preprocess: 0.084 ms, - infer: 25.248 ms, - postprocess: 1.168 ms copy: 2.186 ms, - preprocess: 0.088 ms, - infer: 23.497 ms, - postprocess: 1.228 ms copy: 2.362 ms, - preprocess: 0.082 ms, - infer: 25.735 ms, - postprocess: 1.191 ms copy: 1.386 ms, - preprocess: 0.046 ms, - infer: 21.097 ms, - postprocess: 1.318 ms copy: 1.917 ms, - preprocess: 0.059 ms, - infer: 21.212 ms, - postprocess: 1.144 ms copy: 1.856 ms, - preprocess: 0.065 ms, - infer: 22.861 ms, - postprocess: 1.233 ms copy: 1.955 ms, - preprocess: 0.077 ms, - infer: 34.530 ms, - postprocess: 1.138 ms copy: 2.265 ms, - preprocess: 0.062 ms, - infer: 21.288 ms, - postprocess: 1.083 ms copy: 1.933 ms, - preprocess: 0.063 ms, - infer: 26.214 ms, - postprocess: 1.216 ms copy: 1.932 ms, - preprocess: 0.078 ms, - infer: 33.267 ms, - postprocess: 3.214 ms copy: 1.879 ms, - preprocess: 0.065 ms, - infer: 21.437 ms, - postprocess: 1.125 ms copy: 1.780 ms, - preprocess: 0.062 ms, - infer: 20.888 ms, - postprocess: 1.058 ms copy: 1.782 ms, - preprocess: 0.084 ms, - infer: 21.362 ms, - postprocess: 1.130 ms copy: 1.878 ms, - preprocess: 0.065 ms, - infer: 25.753 ms, - postprocess: 1.149 ms copy: 1.359 ms, - preprocess: 0.045 ms, - infer: 21.491 ms, - postprocess: 1.074 ms copy: 1.715 ms, - preprocess: 0.059 ms, - infer: 20.997 ms, - postprocess: 1.084 ms copy: 1.890 ms, - preprocess: 0.073 ms, - infer: 21.102 ms, - postprocess: 1.133 ms copy: 1.826 ms, - preprocess: 0.073 ms, - infer: 21.265 ms, - postprocess: 1.153 ms copy: 2.214 ms, - preprocess: 0.058 ms, - infer: 21.274 ms, - postprocess: 1.129 ms copy: 1.758 ms, - preprocess: 0.062 ms, - infer: 25.212 ms, - postprocess: 1.086 ms copy: 2.050 ms, - preprocess: 0.073 ms, - infer: 24.712 ms, - postprocess: 1.199 ms copy: 2.013 ms, - preprocess: 0.062 ms, - infer: 21.500 ms, - postprocess: 1.176 ms copy: 2.470 ms, - preprocess: 0.082 ms, - infer: 29.893 ms, - postprocess: 1.264 ms copy: 2.408 ms, - preprocess: 0.081 ms, - infer: 21.338 ms, - postprocess: 1.172 ms copy: 2.215 ms, - preprocess: 0.068 ms, - infer: 21.240 ms, - postprocess: 1.287 ms copy: 1.937 ms, - preprocess: 0.066 ms, - infer: 20.920 ms, - postprocess: 1.115 ms copy: 2.063 ms, - preprocess: 0.087 ms, - infer: 27.792 ms, - postprocess: 1.561 ms copy: 3.063 ms, - preprocess: 0.074 ms, - infer: 21.141 ms, - postprocess: 1.515 ms copy: 2.699 ms, - preprocess: 0.069 ms, - infer: 21.937 ms, - postprocess: 1.156 ms copy: 1.362 ms, - preprocess: 0.044 ms, - infer: 31.353 ms, - postprocess: 1.038 ms copy: 1.844 ms, - preprocess: 0.126 ms, - infer: 21.361 ms, - postprocess: 1.215 ms copy: 1.948 ms, - preprocess: 0.079 ms, - infer: 25.203 ms, - postprocess: 0.828 ms copy: 2.253 ms, - preprocess: 0.071 ms, - infer: 17.444 ms, - postprocess: 0.656 ms copy: 2.674 ms, - preprocess: 0.066 ms, - infer: 18.893 ms, - postprocess: 0.690 ms copy: 1.704 ms, - preprocess: 0.101 ms, - infer: 15.877 ms, - postprocess: 0.832 ms copy: 1.996 ms, - preprocess: 0.077 ms, - infer: 14.686 ms, - postprocess: 0.718 ms copy: 1.844 ms, - preprocess: 0.066 ms, - infer: 14.252 ms, - postprocess: 0.700 ms copy: 1.433 ms, - preprocess: 0.062 ms, - infer: 17.132 ms, - postprocess: 0.702 ms copy: 1.737 ms, - preprocess: 0.061 ms, - infer: 14.598 ms, - postprocess: 0.735 ms copy: 2.251 ms, - preprocess: 0.076 ms, - infer: 14.396 ms, - postprocess: 0.851 ms copy: 2.067 ms, - preprocess: 0.087 ms, - infer: 22.577 ms, - postprocess: 0.945 ms copy: 1.945 ms, - preprocess: 0.079 ms, - infer: 17.284 ms, - postprocess: 0.716 ms copy: 1.800 ms, - preprocess: 0.064 ms, - infer: 14.718 ms, - postprocess: 0.930 ms copy: 1.651 ms, - preprocess: 0.063 ms, - infer: 14.670 ms, - postprocess: 0.701 ms copy: 1.675 ms, - preprocess: 0.063 ms, - infer: 14.627 ms, - postprocess: 0.758 ms copy: 1.562 ms, - preprocess: 0.059 ms, - infer: 14.343 ms, - postprocess: 0.707 ms copy: 1.634 ms, - preprocess: 0.062 ms, - infer: 15.184 ms, - postprocess: 0.703 ms copy: 1.619 ms, - preprocess: 0.058 ms, - infer: 18.662 ms, - postprocess: 0.678 ms copy: 2.020 ms, - preprocess: 0.066 ms, - infer: 14.676 ms, - postprocess: 1.132 ms copy: 2.026 ms, - preprocess: 0.045 ms, - infer: 14.556 ms, - postprocess: 0.690 ms copy: 1.818 ms, - preprocess: 0.055 ms, - infer: 15.023 ms, - postprocess: 0.750 ms copy: 2.478 ms, - preprocess: 0.057 ms, - infer: 14.253 ms, - postprocess: 1.229 ms copy: 2.132 ms, - preprocess: 0.077 ms, - infer: 14.556 ms, - postprocess: 0.738 ms copy: 1.908 ms, - preprocess: 0.072 ms, - infer: 19.609 ms, - postprocess: 0.687 ms copy: 1.885 ms, - preprocess: 0.068 ms, - infer: 14.528 ms, - postprocess: 0.837 ms copy: 1.959 ms, - preprocess: 0.071 ms, - infer: 14.680 ms, - postprocess: 0.725 ms copy: 1.874 ms, - preprocess: 0.079 ms, - infer: 14.682 ms, - postprocess: 0.731 ms copy: 2.228 ms, - preprocess: 0.075 ms, - infer: 17.218 ms, - postprocess: 0.804 ms copy: 1.835 ms, - preprocess: 0.068 ms, - infer: 17.184 ms, - postprocess: 0.748 ms copy: 2.153 ms, - preprocess: 0.085 ms, - infer: 14.861 ms, - postprocess: 0.727 ms copy: 1.276 ms, - preprocess: 0.049 ms, - infer: 14.601 ms, - postprocess: 0.695 ms copy: 1.254 ms, - preprocess: 0.051 ms, - infer: 18.069 ms, - postprocess: 0.710 ms copy: 1.837 ms, - preprocess: 0.074 ms, - infer: 27.491 ms, - postprocess: 0.900 ms copy: 2.051 ms, - preprocess: 0.071 ms, - infer: 30.904 ms, - postprocess: 1.202 ms copy: 2.093 ms, - preprocess: 0.095 ms, - infer: 21.451 ms, - postprocess: 1.278 ms copy: 2.301 ms, - preprocess: 0.077 ms, - infer: 28.468 ms, - postprocess: 1.423 ms copy: 1.448 ms, - preprocess: 0.048 ms, - infer: 24.795 ms, - postprocess: 1.205 ms copy: 2.005 ms, - preprocess: 0.063 ms, - infer: 22.759 ms, - postprocess: 1.130 ms copy: 1.970 ms, - preprocess: 0.062 ms, - infer: 50.494 ms, - postprocess: 1.211 ms copy: 1.421 ms, - preprocess: 0.060 ms, - infer: 19.760 ms, - postprocess: 0.735 ms copy: 1.782 ms, - preprocess: 0.060 ms, - infer: 17.340 ms, - postprocess: 0.706 ms copy: 1.250 ms, - preprocess: 0.054 ms, - infer: 17.619 ms, - postprocess: 0.856 ms copy: 2.430 ms, - preprocess: 0.066 ms, - infer: 20.279 ms, - postprocess: 0.740 ms copy: 1.895 ms, - preprocess: 0.072 ms, - infer: 25.548 ms, - postprocess: 0.720 ms copy: 1.702 ms, - preprocess: 0.114 ms, - infer: 20.860 ms, - postprocess: 1.409 ms copy: 2.266 ms, - preprocess: 0.074 ms, - infer: 17.437 ms, - postprocess: 0.729 ms copy: 2.010 ms, - preprocess: 0.078 ms, - infer: 34.700 ms, - postprocess: 1.007 ms copy: 1.855 ms, - preprocess: 0.106 ms, - infer: 21.767 ms, - postprocess: 0.896 ms copy: 1.417 ms, - preprocess: 0.062 ms, - infer: 16.798 ms, - postprocess: 0.721 ms copy: 1.564 ms, - preprocess: 0.049 ms, - infer: 14.625 ms, - postprocess: 1.081 ms copy: 2.237 ms, - preprocess: 0.093 ms, - infer: 20.694 ms, - postprocess: 0.957 ms copy: 1.726 ms, - preprocess: 0.062 ms, - infer: 32.925 ms, - postprocess: 0.803 ms copy: 1.957 ms, - preprocess: 0.059 ms, - infer: 20.203 ms, - postprocess: 0.762 ms copy: 1.664 ms, - preprocess: 0.062 ms, - infer: 18.425 ms, - postprocess: 0.695 ms copy: 1.737 ms, - preprocess: 0.073 ms, - infer: 14.559 ms, - postprocess: 0.827 ms copy: 1.663 ms, - preprocess: 0.066 ms, - infer: 15.439 ms, - postprocess: 0.780 ms copy: 1.243 ms, - preprocess: 0.055 ms, - infer: 13.475 ms, - postprocess: 0.680 ms copy: 1.978 ms, - preprocess: 0.074 ms, - infer: 13.730 ms, - postprocess: 0.676 ms copy: 1.931 ms, - preprocess: 0.067 ms, - infer: 13.835 ms, - postprocess: 0.703 ms copy: 1.511 ms, - preprocess: 0.062 ms, - infer: 15.961 ms, - postprocess: 0.718 ms copy: 3.626 ms, - preprocess: 0.075 ms, - infer: 19.501 ms, - postprocess: 0.964 ms copy: 1.751 ms, - preprocess: 0.068 ms, - infer: 15.198 ms, - postprocess: 0.696 ms copy: 1.791 ms, - preprocess: 0.074 ms, - infer: 13.962 ms, - postprocess: 0.714 ms copy: 1.904 ms, - preprocess: 0.084 ms, - infer: 19.808 ms, - postprocess: 0.735 ms copy: 2.128 ms, - preprocess: 0.074 ms, - infer: 22.877 ms, - postprocess: 3.279 ms copy: 1.941 ms, - preprocess: 0.069 ms, - infer: 21.859 ms, - postprocess: 0.762 ms copy: 2.250 ms, - preprocess: 0.072 ms, - infer: 16.579 ms, - postprocess: 0.698 ms copy: 1.838 ms, - preprocess: 0.067 ms, - infer: 30.826 ms, - postprocess: 0.709 ms copy: 1.586 ms, - preprocess: 0.062 ms, - infer: 29.099 ms, - postprocess: 0.705 ms copy: 1.914 ms, - preprocess: 0.078 ms, - infer: 20.668 ms, - postprocess: 0.666 ms copy: 2.193 ms, - preprocess: 0.069 ms, - infer: 14.113 ms, - postprocess: 0.986 ms copy: 1.662 ms, - preprocess: 0.060 ms, - infer: 18.840 ms, - postprocess: 0.707 ms copy: 1.669 ms, - preprocess: 0.076 ms, - infer: 23.782 ms, - postprocess: 0.677 ms copy: 2.090 ms, - preprocess: 0.082 ms, - infer: 17.516 ms, - postprocess: 0.694 ms copy: 1.703 ms, - preprocess: 0.066 ms, - infer: 15.466 ms, - postprocess: 0.621 ms copy: 1.663 ms, - preprocess: 0.072 ms, - infer: 14.389 ms, - postprocess: 0.737 ms copy: 1.831 ms, - preprocess: 0.056 ms, - infer: 17.134 ms, - postprocess: 0.642 ms copy: 1.298 ms, - preprocess: 0.062 ms, - infer: 16.373 ms, - postprocess: 0.686 ms copy: 1.551 ms, - preprocess: 0.065 ms, - infer: 21.248 ms, - postprocess: 4.269 ms copy: 1.697 ms, - preprocess: 0.059 ms, - infer: 18.801 ms, - postprocess: 1.098 ms copy: 1.248 ms, - preprocess: 0.062 ms, - infer: 7.251 ms, - postprocess: 0.626 ms copy: 1.193 ms, - preprocess: 0.069 ms, - infer: 8.871 ms, - postprocess: 0.671 ms copy: 0.840 ms, - preprocess: 0.041 ms, - infer: 7.125 ms, - postprocess: 0.521 ms copy: 1.293 ms, - preprocess: 0.060 ms, - infer: 9.325 ms, - postprocess: 0.591 ms copy: 1.271 ms, - preprocess: 0.066 ms, - infer: 7.199 ms, - postprocess: 0.524 ms copy: 1.393 ms, - preprocess: 0.088 ms, - infer: 7.218 ms, - postprocess: 0.559 ms copy: 1.392 ms, - preprocess: 0.067 ms, - infer: 8.192 ms, - postprocess: 0.751 ms copy: 1.363 ms, - preprocess: 0.078 ms, - infer: 8.907 ms, - postprocess: 0.589 ms copy: 1.363 ms, - preprocess: 0.056 ms, - infer: 7.602 ms, - postprocess: 0.573 ms copy: 0.912 ms, - preprocess: 0.064 ms, - infer: 10.278 ms, - postprocess: 0.543 ms copy: 1.519 ms, - preprocess: 0.062 ms, - infer: 7.166 ms, - postprocess: 0.567 ms copy: 1.420 ms, - preprocess: 0.076 ms, - infer: 14.824 ms, - postprocess: 0.579 ms copy: 1.265 ms, - preprocess: 0.062 ms, - infer: 8.595 ms, - postprocess: 0.543 ms copy: 0.825 ms, - preprocess: 0.038 ms, - infer: 7.093 ms, - postprocess: 0.460 ms copy: 0.852 ms, - preprocess: 0.038 ms, - infer: 7.070 ms, - postprocess: 0.522 ms copy: 1.332 ms, - preprocess: 0.064 ms, - infer: 7.200 ms, - postprocess: 0.517 ms copy: 1.201 ms, - preprocess: 0.062 ms, - infer: 7.194 ms, - postprocess: 1.673 ms copy: 1.503 ms, - preprocess: 0.086 ms, - infer: 7.189 ms, - postprocess: 0.563 ms copy: 1.276 ms, - preprocess: 0.066 ms, - infer: 7.291 ms, - postprocess: 0.544 ms copy: 1.345 ms, - preprocess: 0.066 ms, - infer: 7.264 ms, - postprocess: 0.586 ms copy: 1.314 ms, - preprocess: 0.078 ms, - infer: 7.241 ms, - postprocess: 0.534 ms copy: 1.268 ms, - preprocess: 0.057 ms, - infer: 7.177 ms, - postprocess: 0.582 ms copy: 1.083 ms, - preprocess: 0.052 ms, - infer: 7.691 ms, - postprocess: 0.595 ms copy: 1.310 ms, - preprocess: 0.069 ms, - infer: 12.187 ms, - postprocess: 0.590 ms copy: 1.521 ms, - preprocess: 0.065 ms, - infer: 7.185 ms, - postprocess: 0.544 ms copy: 1.527 ms, - preprocess: 0.079 ms, - infer: 7.358 ms, - postprocess: 0.721 ms copy: 0.995 ms, - preprocess: 0.049 ms, - infer: 9.110 ms, - postprocess: 0.549 ms copy: 1.743 ms, - preprocess: 0.072 ms, - infer: 12.078 ms, - postprocess: 0.568 ms copy: 0.903 ms, - preprocess: 0.043 ms, - infer: 10.742 ms, - postprocess: 0.501 ms copy: 1.444 ms, - preprocess: 0.069 ms, - infer: 8.765 ms, - postprocess: 0.566 ms copy: 1.850 ms, - preprocess: 0.074 ms, - infer: 23.044 ms, - postprocess: 0.689 ms copy: 1.527 ms, - preprocess: 0.063 ms, - infer: 17.135 ms, - postprocess: 0.676 ms copy: 1.222 ms, - preprocess: 0.048 ms, - infer: 17.052 ms, - postprocess: 0.659 ms copy: 1.735 ms, - preprocess: 0.064 ms, - infer: 108.521 ms, - postprocess: 0.413 ms copy: 0.723 ms, - preprocess: 0.045 ms, - infer: 2.687 ms, - postprocess: 0.352 ms copy: 1.602 ms, - preprocess: 0.076 ms, - infer: 3.324 ms, - postprocess: 0.440 ms copy: 1.189 ms, - preprocess: 0.071 ms, - infer: 3.633 ms, - postprocess: 0.383 ms copy: 1.243 ms, - preprocess: 0.071 ms, - infer: 2.809 ms, - postprocess: 0.357 ms copy: 0.747 ms, - preprocess: 0.043 ms, - infer: 2.807 ms, - postprocess: 0.661 ms copy: 0.830 ms, - preprocess: 0.044 ms, - infer: 3.465 ms, - postprocess: 0.369 ms copy: 1.957 ms, - preprocess: 0.062 ms, - infer: 3.682 ms, - postprocess: 0.642 ms copy: 1.519 ms, - preprocess: 0.063 ms, - infer: 3.478 ms, - postprocess: 0.532 ms copy: 1.383 ms, - preprocess: 0.079 ms, - infer: 3.049 ms, - postprocess: 0.824 ms copy: 1.187 ms, - preprocess: 0.081 ms, - infer: 3.091 ms, - postprocess: 0.552 ms copy: 1.094 ms, - preprocess: 0.068 ms, - infer: 2.750 ms, - postprocess: 0.469 ms copy: 0.690 ms, - preprocess: 0.041 ms, - infer: 3.891 ms, - postprocess: 0.375 ms copy: 1.700 ms, - preprocess: 0.061 ms, - infer: 2.927 ms, - postprocess: 0.433 ms copy: 1.199 ms, - preprocess: 0.069 ms, - infer: 2.682 ms, - postprocess: 0.411 ms copy: 1.002 ms, - preprocess: 0.062 ms, - infer: 2.635 ms, - postprocess: 0.381 ms copy: 1.137 ms, - preprocess: 0.064 ms, - infer: 2.852 ms, - postprocess: 0.579 ms copy: 1.174 ms, - preprocess: 0.065 ms, - infer: 2.809 ms, - postprocess: 0.396 ms copy: 1.089 ms, - preprocess: 0.064 ms, - infer: 3.054 ms, - postprocess: 0.421 ms copy: 1.164 ms, - preprocess: 0.066 ms, - infer: 3.411 ms, - postprocess: 0.456 ms copy: 1.237 ms, - preprocess: 0.068 ms, - infer: 3.031 ms, - postprocess: 0.391 ms copy: 1.289 ms, - preprocess: 0.064 ms, - infer: 2.974 ms, - postprocess: 0.357 ms copy: 0.991 ms, - preprocess: 0.057 ms, - infer: 2.751 ms, - postprocess: 0.459 ms copy: 1.340 ms, - preprocess: 0.073 ms, - infer: 3.349 ms, - postprocess: 0.536 ms copy: 0.906 ms, - preprocess: 0.052 ms, - infer: 2.714 ms, - postprocess: 0.395 ms copy: 1.230 ms, - preprocess: 0.073 ms, - infer: 3.317 ms, - postprocess: 0.445 ms copy: 1.384 ms, - preprocess: 0.058 ms, - infer: 2.952 ms, - postprocess: 0.612 ms copy: 1.151 ms, - preprocess: 0.070 ms, - infer: 2.744 ms, - postprocess: 0.369 ms copy: 1.181 ms, - preprocess: 0.070 ms, - infer: 3.544 ms, - postprocess: 0.388 ms copy: 1.230 ms, - preprocess: 0.068 ms, - infer: 2.775 ms, - postprocess: 0.400 ms copy: 0.812 ms, - preprocess: 0.047 ms, - infer: 2.659 ms, - postprocess: 0.417 ms copy: 1.353 ms, - preprocess: 0.072 ms, - infer: 2.759 ms, - postprocess: 0.364 ms copy: 1.308 ms, - preprocess: 0.079 ms, - infer: 2.792 ms, - postprocess: 0.466 ms copy: 1.476 ms, - preprocess: 0.096 ms, - infer: 3.295 ms, - postprocess: 0.513 ms copy: 1.391 ms, - preprocess: 0.078 ms, - infer: 2.902 ms, - postprocess: 0.445 ms copy: 1.552 ms, - preprocess: 0.074 ms, - infer: 3.258 ms, - postprocess: 0.403 ms copy: 1.015 ms, - preprocess: 0.046 ms, - infer: 2.911 ms, - postprocess: 0.380 ms copy: 1.168 ms, - preprocess: 0.064 ms, - infer: 3.479 ms, - postprocess: 0.465 ms copy: 1.748 ms, - preprocess: 0.063 ms, - infer: 14.500 ms, - postprocess: 0.736 ms copy: 1.151 ms, - preprocess: 0.043 ms, - infer: 20.359 ms, - postprocess: 0.719 ms copy: 1.697 ms, - preprocess: 0.070 ms, - infer: 14.435 ms, - postprocess: 0.761 ms copy: 2.075 ms, - preprocess: 0.060 ms, - infer: 15.849 ms, - postprocess: 0.946 ms copy: 1.732 ms, - preprocess: 0.064 ms, - infer: 14.388 ms, - postprocess: 0.727 ms copy: 2.109 ms, - preprocess: 0.079 ms, - infer: 18.983 ms, - postprocess: 0.823 ms copy: 2.533 ms, - preprocess: 0.063 ms, - infer: 24.606 ms, - postprocess: 0.681 ms copy: 2.247 ms, - preprocess: 0.071 ms, - infer: 18.034 ms, - postprocess: 1.020 ms copy: 1.247 ms, - preprocess: 0.048 ms, - infer: 14.429 ms, - postprocess: 0.726 ms copy: 1.792 ms, - preprocess: 0.060 ms, - infer: 14.530 ms, - postprocess: 0.931 ms copy: 2.366 ms, - preprocess: 0.083 ms, - infer: 14.545 ms, - postprocess: 0.729 ms copy: 1.677 ms, - preprocess: 0.057 ms, - infer: 17.083 ms, - postprocess: 0.999 ms copy: 1.653 ms, - preprocess: 0.063 ms, - infer: 22.552 ms, - postprocess: 0.691 ms copy: 1.566 ms, - preprocess: 0.079 ms, - infer: 18.022 ms, - postprocess: 0.720 ms copy: 1.158 ms, - preprocess: 0.043 ms, - infer: 21.065 ms, - postprocess: 0.748 ms copy: 1.592 ms, - preprocess: 0.077 ms, - infer: 16.409 ms, - postprocess: 0.811 ms copy: 1.178 ms, - preprocess: 0.043 ms, - infer: 15.816 ms, - postprocess: 1.949 ms copy: 1.450 ms, - preprocess: 0.042 ms, - infer: 17.133 ms, - postprocess: 0.704 ms copy: 1.559 ms, - preprocess: 0.057 ms, - infer: 16.503 ms, - postprocess: 0.723 ms copy: 1.361 ms, - preprocess: 0.057 ms, - infer: 20.441 ms, - postprocess: 1.137 ms copy: 2.026 ms, - preprocess: 0.057 ms, - infer: 19.511 ms, - postprocess: 0.699 ms copy: 1.673 ms, - preprocess: 0.065 ms, - infer: 14.661 ms, - postprocess: 0.773 ms copy: 1.644 ms, - preprocess: 0.060 ms, - infer: 17.406 ms, - postprocess: 0.781 ms copy: 1.180 ms, - preprocess: 0.044 ms, - infer: 14.395 ms, - postprocess: 0.658 ms copy: 1.507 ms, - preprocess: 0.066 ms, - infer: 14.432 ms, - postprocess: 0.817 ms copy: 2.010 ms, - preprocess: 0.058 ms, - infer: 14.434 ms, - postprocess: 0.704 ms copy: 1.478 ms, - preprocess: 0.062 ms, - infer: 14.608 ms, - postprocess: 0.811 ms copy: 1.919 ms, - preprocess: 0.073 ms, - infer: 21.559 ms, - postprocess: 1.001 ms copy: 1.220 ms, - preprocess: 0.052 ms, - infer: 28.607 ms, - postprocess: 0.738 ms copy: 1.700 ms, - preprocess: 0.045 ms, - infer: 14.358 ms, - postprocess: 0.989 ms copy: 1.202 ms, - preprocess: 0.043 ms, - infer: 14.549 ms, - postprocess: 0.676 ms copy: 2.253 ms, - preprocess: 0.076 ms, - infer: 14.572 ms, - postprocess: 1.263 ms copy: 1.638 ms, - preprocess: 0.063 ms, - infer: 14.961 ms, - postprocess: 0.772 ms copy: 1.262 ms, - preprocess: 0.056 ms, - infer: 14.446 ms, - postprocess: 0.694 ms copy: 1.644 ms, - preprocess: 0.055 ms, - infer: 18.422 ms, - postprocess: 0.716 ms copy: 1.848 ms, - preprocess: 0.078 ms, - infer: 15.361 ms, - postprocess: 2.198 ms copy: 1.263 ms, - preprocess: 0.050 ms, - infer: 21.399 ms, - postprocess: 0.734 ms copy: 2.351 ms, - preprocess: 0.084 ms, - infer: 14.489 ms, - postprocess: 0.868 ms copy: 1.761 ms, - preprocess: 0.068 ms, - infer: 16.719 ms, - postprocess: 0.695 ms copy: 2.026 ms, - preprocess: 0.058 ms, - infer: 24.740 ms, - postprocess: 0.663 ms copy: 2.039 ms, - preprocess: 0.059 ms, - infer: 14.421 ms, - postprocess: 0.917 ms copy: 1.865 ms, - preprocess: 0.078 ms, - infer: 14.502 ms, - postprocess: 0.972 ms copy: 1.654 ms, - preprocess: 0.071 ms, - infer: 14.443 ms, - postprocess: 0.805 ms copy: 1.855 ms, - preprocess: 0.055 ms, - infer: 14.608 ms, - postprocess: 1.102 ms copy: 2.648 ms, - preprocess: 0.120 ms, - infer: 17.511 ms, - postprocess: 0.730 ms copy: 1.757 ms, - preprocess: 0.074 ms, - infer: 16.602 ms, - postprocess: 0.854 ms copy: 2.241 ms, - preprocess: 0.087 ms, - infer: 15.174 ms, - postprocess: 1.370 ms copy: 1.837 ms, - preprocess: 0.078 ms, - infer: 14.608 ms, - postprocess: 0.767 ms copy: 1.760 ms, - preprocess: 0.073 ms, - infer: 14.533 ms, - postprocess: 0.753 ms copy: 1.811 ms, - preprocess: 0.065 ms, - infer: 15.627 ms, - postprocess: 0.804 ms copy: 1.872 ms, - preprocess: 0.091 ms, - infer: 14.649 ms, - postprocess: 0.797 ms copy: 2.139 ms, - preprocess: 0.066 ms, - infer: 14.706 ms, - postprocess: 0.711 ms copy: 1.885 ms, - preprocess: 0.070 ms, - infer: 14.601 ms, - postprocess: 0.720 ms copy: 1.565 ms, - preprocess: 0.065 ms, - infer: 23.535 ms, - postprocess: 0.800 ms copy: 1.901 ms, - preprocess: 0.069 ms, - infer: 15.601 ms, - postprocess: 0.797 ms copy: 1.719 ms, - preprocess: 0.076 ms, - infer: 14.386 ms, - postprocess: 0.711 ms copy: 2.181 ms, - preprocess: 0.072 ms, - infer: 14.547 ms, - postprocess: 0.776 ms copy: 1.573 ms, - preprocess: 0.062 ms, - infer: 14.431 ms, - postprocess: 0.825 ms copy: 1.702 ms, - preprocess: 0.066 ms, - infer: 19.902 ms, - postprocess: 0.876 ms copy: 1.929 ms, - preprocess: 0.073 ms, - infer: 17.590 ms, - postprocess: 0.751 ms copy: 1.283 ms, - preprocess: 0.061 ms, - infer: 19.243 ms, - postprocess: 0.750 ms copy: 1.669 ms, - preprocess: 0.073 ms, - infer: 24.934 ms, - postprocess: 0.751 ms copy: 1.573 ms, - preprocess: 0.059 ms, - infer: 17.829 ms, - postprocess: 0.711 ms copy: 1.917 ms, - preprocess: 0.059 ms, - infer: 20.903 ms, - postprocess: 0.700 ms copy: 1.734 ms, - preprocess: 0.065 ms, - infer: 14.198 ms, - postprocess: 0.749 ms copy: 1.825 ms, - preprocess: 0.066 ms, - infer: 14.135 ms, - postprocess: 0.676 ms copy: 2.041 ms, - preprocess: 0.081 ms, - infer: 18.345 ms, - postprocess: 0.761 ms copy: 1.347 ms, - preprocess: 0.088 ms, - infer: 16.948 ms, - postprocess: 0.777 ms copy: 1.613 ms, - preprocess: 0.065 ms, - infer: 16.224 ms, - postprocess: 0.770 ms copy: 2.191 ms, - preprocess: 0.101 ms, - infer: 14.283 ms, - postprocess: 0.695 ms copy: 1.993 ms, - preprocess: 0.101 ms, - infer: 14.265 ms, - postprocess: 0.692 ms copy: 2.102 ms, - preprocess: 0.066 ms, - infer: 14.342 ms, - postprocess: 1.030 ms copy: 1.604 ms, - preprocess: 0.063 ms, - infer: 14.189 ms, - postprocess: 0.721 ms copy: 1.545 ms, - preprocess: 0.059 ms, - infer: 16.670 ms, - postprocess: 0.781 ms copy: 1.555 ms, - preprocess: 0.058 ms, - infer: 14.439 ms, - postprocess: 0.737 ms copy: 1.414 ms, - preprocess: 0.059 ms, - infer: 14.421 ms, - postprocess: 0.726 ms copy: 1.205 ms, - preprocess: 0.046 ms, - infer: 14.048 ms, - postprocess: 0.668 ms copy: 1.943 ms, - preprocess: 0.076 ms, - infer: 17.082 ms, - postprocess: 2.973 ms copy: 1.849 ms, - preprocess: 0.069 ms, - infer: 24.450 ms, - postprocess: 0.703 ms copy: 2.186 ms, - preprocess: 0.079 ms, - infer: 16.782 ms, - postprocess: 0.767 ms copy: 1.218 ms, - preprocess: 0.048 ms, - infer: 17.725 ms, - postprocess: 0.706 ms copy: 2.148 ms, - preprocess: 0.062 ms, - infer: 17.132 ms, - postprocess: 0.772 ms copy: 1.711 ms, - preprocess: 0.067 ms, - infer: 47.123 ms, - postprocess: 0.723 ms copy: 2.326 ms, - preprocess: 0.043 ms, - infer: 28.176 ms, - postprocess: 0.739 ms copy: 1.653 ms, - preprocess: 0.060 ms, - infer: 25.590 ms, - postprocess: 0.688 ms copy: 1.532 ms, - preprocess: 0.058 ms, - infer: 13.285 ms, - postprocess: 1.275 ms copy: 1.557 ms, - preprocess: 0.060 ms, - infer: 17.017 ms, - postprocess: 0.714 ms copy: 1.420 ms, - preprocess: 0.062 ms, - infer: 12.917 ms, - postprocess: 0.621 ms copy: 1.410 ms, - preprocess: 0.043 ms, - infer: 18.640 ms, - postprocess: 0.599 ms copy: 1.709 ms, - preprocess: 0.069 ms, - infer: 13.564 ms, - postprocess: 0.863 ms copy: 1.770 ms, - preprocess: 0.071 ms, - infer: 13.243 ms, - postprocess: 0.678 ms copy: 1.723 ms, - preprocess: 0.068 ms, - infer: 13.077 ms, - postprocess: 0.737 ms copy: 1.863 ms, - preprocess: 0.110 ms, - infer: 13.213 ms, - postprocess: 0.667 ms copy: 1.862 ms, - preprocess: 0.075 ms, - infer: 15.182 ms, - postprocess: 0.726 ms copy: 1.957 ms, - preprocess: 0.121 ms, - infer: 13.020 ms, - postprocess: 0.727 ms copy: 1.835 ms, - preprocess: 0.070 ms, - infer: 13.185 ms, - postprocess: 0.674 ms copy: 1.429 ms, - preprocess: 0.062 ms, - infer: 13.067 ms, - postprocess: 0.733 ms copy: 1.284 ms, - preprocess: 0.046 ms, - infer: 12.901 ms, - postprocess: 0.695 ms copy: 1.138 ms, - preprocess: 0.046 ms, - infer: 12.768 ms, - postprocess: 0.598 ms copy: 1.849 ms, - preprocess: 0.063 ms, - infer: 13.321 ms, - postprocess: 0.639 ms copy: 1.833 ms, - preprocess: 0.079 ms, - infer: 13.007 ms, - postprocess: 1.698 ms copy: 1.209 ms, - preprocess: 0.050 ms, - infer: 15.543 ms, - postprocess: 0.674 ms copy: 1.884 ms, - preprocess: 0.080 ms, - infer: 13.076 ms, - postprocess: 0.624 ms copy: 1.969 ms, - preprocess: 0.085 ms, - infer: 12.853 ms, - postprocess: 0.710 ms copy: 1.829 ms, - preprocess: 0.066 ms, - infer: 19.148 ms, - postprocess: 0.783 ms copy: 1.473 ms, - preprocess: 0.062 ms, - infer: 20.258 ms, - postprocess: 0.621 ms copy: 2.236 ms, - preprocess: 0.085 ms, - infer: 13.471 ms, - postprocess: 0.666 ms copy: 1.468 ms, - preprocess: 0.062 ms, - infer: 16.532 ms, - postprocess: 0.665 ms copy: 1.929 ms, - preprocess: 0.085 ms, - infer: 17.169 ms, - postprocess: 0.701 ms copy: 1.759 ms, - preprocess: 0.067 ms, - infer: 16.528 ms, - postprocess: 0.677 ms copy: 1.808 ms, - preprocess: 0.073 ms, - infer: 18.539 ms, - postprocess: 0.718 ms copy: 1.819 ms, - preprocess: 0.081 ms, - infer: 17.782 ms, - postprocess: 0.754 ms copy: 1.990 ms, - preprocess: 0.085 ms, - infer: 14.064 ms, - postprocess: 0.781 ms copy: 2.091 ms, - preprocess: 0.077 ms, - infer: 14.203 ms, - postprocess: 0.787 ms copy: 1.115 ms, - preprocess: 0.048 ms, - infer: 13.604 ms, - postprocess: 0.623 ms copy: 1.370 ms, - preprocess: 0.050 ms, - infer: 14.174 ms, - postprocess: 0.669 ms copy: 2.657 ms, - preprocess: 0.064 ms, - infer: 13.832 ms, - postprocess: 1.067 ms copy: 1.842 ms, - preprocess: 0.072 ms, - infer: 19.508 ms, - postprocess: 0.727 ms copy: 2.230 ms, - preprocess: 0.066 ms, - infer: 16.888 ms, - postprocess: 0.675 ms copy: 1.597 ms, - preprocess: 0.064 ms, - infer: 17.800 ms, - postprocess: 0.661 ms copy: 1.734 ms, - preprocess: 0.076 ms, - infer: 14.034 ms, - postprocess: 0.678 ms copy: 2.007 ms, - preprocess: 0.081 ms, - infer: 14.194 ms, - postprocess: 0.779 ms copy: 2.028 ms, - preprocess: 0.065 ms, - infer: 14.237 ms, - postprocess: 0.739 ms copy: 1.927 ms, - preprocess: 0.070 ms, - infer: 17.039 ms, - postprocess: 0.699 ms copy: 1.785 ms, - preprocess: 0.066 ms, - infer: 17.290 ms, - postprocess: 0.732 ms copy: 2.367 ms, - preprocess: 0.077 ms, - infer: 18.768 ms, - postprocess: 1.937 ms copy: 1.641 ms, - preprocess: 0.063 ms, - infer: 17.120 ms, - postprocess: 0.777 ms copy: 1.814 ms, - preprocess: 0.057 ms, - infer: 22.101 ms, - postprocess: 0.707 ms copy: 2.573 ms, - preprocess: 0.043 ms, - infer: 33.762 ms, - postprocess: 0.716 ms copy: 1.534 ms, - preprocess: 0.044 ms, - infer: 19.761 ms, - postprocess: 0.790 ms copy: 3.212 ms, - preprocess: 0.061 ms, - infer: 22.938 ms, - postprocess: 0.703 ms copy: 1.606 ms, - preprocess: 0.062 ms, - infer: 36.869 ms, - postprocess: 0.747 ms copy: 1.627 ms, - preprocess: 0.064 ms, - infer: 15.999 ms, - postprocess: 0.667 ms copy: 1.579 ms, - preprocess: 0.061 ms, - infer: 21.645 ms, - postprocess: 1.121 ms copy: 1.125 ms, - preprocess: 0.043 ms, - infer: 13.384 ms, - postprocess: 0.618 ms copy: 1.139 ms, - preprocess: 0.042 ms, - infer: 18.515 ms, - postprocess: 0.605 ms copy: 1.853 ms, - preprocess: 0.071 ms, - infer: 15.012 ms, - postprocess: 0.669 ms copy: 1.954 ms, - preprocess: 0.066 ms, - infer: 13.084 ms, - postprocess: 1.937 ms copy: 1.340 ms, - preprocess: 0.067 ms, - infer: 15.988 ms, - postprocess: 0.747 ms copy: 1.190 ms, - preprocess: 0.042 ms, - infer: 24.327 ms, - postprocess: 0.634 ms copy: 1.113 ms, - preprocess: 0.042 ms, - infer: 14.692 ms, - postprocess: 1.546 ms copy: 1.540 ms, - preprocess: 0.054 ms, - infer: 15.881 ms, - postprocess: 0.610 ms copy: 1.566 ms, - preprocess: 0.063 ms, - infer: 20.903 ms, - postprocess: 0.651 ms copy: 1.756 ms, - preprocess: 0.074 ms, - infer: 16.380 ms, - postprocess: 0.808 ms copy: 1.371 ms, - preprocess: 0.060 ms, - infer: 13.342 ms, - postprocess: 0.683 ms copy: 1.697 ms, - preprocess: 0.062 ms, - infer: 13.301 ms, - postprocess: 0.618 ms copy: 1.851 ms, - preprocess: 0.079 ms, - infer: 13.322 ms, - postprocess: 0.637 ms copy: 1.970 ms, - preprocess: 0.064 ms, - infer: 13.164 ms, - postprocess: 0.671 ms copy: 1.384 ms, - preprocess: 0.062 ms, - infer: 13.421 ms, - postprocess: 0.611 ms copy: 1.806 ms, - preprocess: 0.070 ms, - infer: 13.172 ms, - postprocess: 0.704 ms copy: 2.859 ms, - preprocess: 0.136 ms, - infer: 19.081 ms, - postprocess: 0.867 ms copy: 1.632 ms, - preprocess: 0.065 ms, - infer: 13.077 ms, - postprocess: 0.676 ms copy: 2.133 ms, - preprocess: 0.100 ms, - infer: 13.279 ms, - postprocess: 0.683 ms copy: 2.020 ms, - preprocess: 0.080 ms, - infer: 13.300 ms, - postprocess: 0.738 ms copy: 1.474 ms, - preprocess: 0.071 ms, - infer: 16.909 ms, - postprocess: 1.408 ms copy: 2.032 ms, - preprocess: 0.070 ms, - infer: 19.585 ms, - postprocess: 0.724 ms copy: 1.964 ms, - preprocess: 0.078 ms, - infer: 15.640 ms, - postprocess: 0.714 ms copy: 1.459 ms, - preprocess: 0.049 ms, - infer: 14.117 ms, - postprocess: 0.665 ms copy: 2.192 ms, - preprocess: 0.080 ms, - infer: 14.686 ms, - postprocess: 0.833 ms copy: 1.227 ms, - preprocess: 0.053 ms, - infer: 16.887 ms, - postprocess: 1.976 ms copy: 2.031 ms, - preprocess: 0.063 ms, - infer: 19.794 ms, - postprocess: 0.941 ms copy: 1.637 ms, - preprocess: 0.065 ms, - infer: 15.525 ms, - postprocess: 0.758 ms copy: 1.686 ms, - preprocess: 0.064 ms, - infer: 14.120 ms, - postprocess: 0.674 ms copy: 1.851 ms, - preprocess: 0.067 ms, - infer: 14.327 ms, - postprocess: 0.689 ms copy: 1.921 ms, - preprocess: 0.080 ms, - infer: 38.119 ms, - postprocess: 1.039 ms copy: 2.811 ms, - preprocess: 0.064 ms, - infer: 15.085 ms, - postprocess: 0.943 ms copy: 1.369 ms, - preprocess: 0.062 ms, - infer: 19.262 ms, - postprocess: 0.728 ms copy: 1.879 ms, - preprocess: 0.061 ms, - infer: 17.559 ms, - postprocess: 0.740 ms copy: 1.644 ms, - preprocess: 0.065 ms, - infer: 19.897 ms, - postprocess: 1.762 ms copy: 1.738 ms, - preprocess: 0.067 ms, - infer: 17.059 ms, - postprocess: 0.729 ms copy: 1.695 ms, - preprocess: 0.063 ms, - infer: 14.152 ms, - postprocess: 0.804 ms copy: 1.735 ms, - preprocess: 0.063 ms, - infer: 15.104 ms, - postprocess: 1.261 ms copy: 1.718 ms, - preprocess: 0.074 ms, - infer: 14.650 ms, - postprocess: 0.802 ms copy: 2.268 ms, - preprocess: 0.079 ms, - infer: 18.683 ms, - postprocess: 0.914 ms copy: 1.910 ms, - preprocess: 0.067 ms, - infer: 25.717 ms, - postprocess: 0.984 ms copy: 1.877 ms, - preprocess: 0.069 ms, - infer: 40.010 ms, - postprocess: 0.742 ms copy: 1.746 ms, - preprocess: 0.074 ms, - infer: 14.074 ms, - postprocess: 0.652 ms copy: 1.848 ms, - preprocess: 0.067 ms, - infer: 14.108 ms, - postprocess: 1.046 ms copy: 1.900 ms, - preprocess: 0.063 ms, - infer: 19.507 ms, - postprocess: 0.738 ms copy: 1.995 ms, - preprocess: 0.075 ms, - infer: 28.842 ms, - postprocess: 0.687 ms copy: 1.954 ms, - preprocess: 0.081 ms, - infer: 14.232 ms, - postprocess: 0.743 ms copy: 1.883 ms, - preprocess: 0.080 ms, - infer: 23.139 ms, - postprocess: 0.771 ms copy: 2.039 ms, - preprocess: 0.139 ms, - infer: 14.697 ms, - postprocess: 0.943 ms copy: 1.999 ms, - preprocess: 0.086 ms, - infer: 14.271 ms, - postprocess: 0.747 ms copy: 2.350 ms, - preprocess: 0.073 ms, - infer: 14.167 ms, - postprocess: 0.800 ms copy: 2.016 ms, - preprocess: 0.092 ms, - infer: 27.721 ms, - postprocess: 0.849 ms copy: 2.536 ms, - preprocess: 0.076 ms, - infer: 14.275 ms, - postprocess: 0.973 ms copy: 1.225 ms, - preprocess: 0.052 ms, - infer: 20.683 ms, - postprocess: 0.701 ms copy: 1.800 ms, - preprocess: 0.059 ms, - infer: 15.740 ms, - postprocess: 0.717 ms copy: 1.857 ms, - preprocess: 0.065 ms, - infer: 35.393 ms, - postprocess: 0.705 ms copy: 1.349 ms, - preprocess: 0.061 ms, - infer: 20.716 ms, - postprocess: 0.686 ms copy: 1.326 ms, - preprocess: 0.055 ms, - infer: 20.517 ms, - postprocess: 0.673 ms copy: 1.315 ms, - preprocess: 0.057 ms, - infer: 19.412 ms, - postprocess: 0.717 ms copy: 1.625 ms, - preprocess: 0.071 ms, - infer: 22.023 ms, - postprocess: 0.833 ms copy: 1.932 ms, - preprocess: 0.063 ms, - infer: 13.913 ms, - postprocess: 0.958 ms copy: 1.118 ms, - preprocess: 0.041 ms, - infer: 20.092 ms, - postprocess: 0.725 ms copy: 1.778 ms, - preprocess: 0.049 ms, - infer: 20.764 ms, - postprocess: 0.714 ms copy: 1.410 ms, - preprocess: 0.079 ms, - infer: 2.890 ms, - postprocess: 0.528 ms copy: 0.960 ms, - preprocess: 0.061 ms, - infer: 3.080 ms, - postprocess: 0.490 ms copy: 1.496 ms, - preprocess: 0.083 ms, - infer: 2.905 ms, - postprocess: 0.598 ms copy: 1.052 ms, - preprocess: 0.062 ms, - infer: 2.879 ms, - postprocess: 0.483 ms copy: 1.882 ms, - preprocess: 0.079 ms, - infer: 3.111 ms, - postprocess: 0.422 ms copy: 1.660 ms, - preprocess: 0.065 ms, - infer: 3.075 ms, - postprocess: 0.387 ms copy: 0.876 ms, - preprocess: 0.048 ms, - infer: 2.890 ms, - postprocess: 0.395 ms copy: 0.743 ms, - preprocess: 0.042 ms, - infer: 3.318 ms, - postprocess: 0.383 ms copy: 1.431 ms, - preprocess: 0.072 ms, - infer: 3.116 ms, - postprocess: 0.544 ms copy: 1.409 ms, - preprocess: 0.085 ms, - infer: 2.840 ms, - postprocess: 0.424 ms copy: 1.492 ms, - preprocess: 0.112 ms, - infer: 2.856 ms, - postprocess: 0.376 ms copy: 1.341 ms, - preprocess: 0.094 ms, - infer: 2.786 ms, - postprocess: 0.420 ms copy: 1.386 ms, - preprocess: 0.071 ms, - infer: 2.733 ms, - postprocess: 0.408 ms copy: 1.087 ms, - preprocess: 0.069 ms, - infer: 2.823 ms, - postprocess: 0.347 ms copy: 1.180 ms, - preprocess: 0.083 ms, - infer: 2.936 ms, - postprocess: 0.433 ms copy: 1.115 ms, - preprocess: 0.067 ms, - infer: 2.777 ms, - postprocess: 0.347 ms copy: 1.571 ms, - preprocess: 0.080 ms, - infer: 2.853 ms, - postprocess: 0.389 ms copy: 1.351 ms, - preprocess: 0.069 ms, - infer: 2.871 ms, - postprocess: 0.360 ms copy: 0.983 ms, - preprocess: 0.069 ms, - infer: 2.827 ms, - postprocess: 0.460 ms copy: 1.494 ms, - preprocess: 0.096 ms, - infer: 3.314 ms, - postprocess: 0.490 ms copy: 1.435 ms, - preprocess: 0.093 ms, - infer: 3.542 ms, - postprocess: 0.573 ms copy: 0.836 ms, - preprocess: 0.053 ms, - infer: 3.015 ms, - postprocess: 0.384 ms copy: 1.353 ms, - preprocess: 0.066 ms, - infer: 2.765 ms, - postprocess: 0.447 ms copy: 1.424 ms, - preprocess: 0.082 ms, - infer: 3.189 ms, - postprocess: 0.488 ms copy: 1.367 ms, - preprocess: 0.107 ms, - infer: 3.072 ms, - postprocess: 0.442 ms copy: 1.139 ms, - preprocess: 0.070 ms, - infer: 3.074 ms, - postprocess: 0.481 ms copy: 1.124 ms, - preprocess: 0.067 ms, - infer: 2.745 ms, - postprocess: 0.402 ms copy: 1.585 ms, - preprocess: 0.073 ms, - infer: 2.837 ms, - postprocess: 0.497 ms copy: 1.550 ms, - preprocess: 0.089 ms, - infer: 3.383 ms, - postprocess: 0.424 ms copy: 1.577 ms, - preprocess: 0.082 ms, - infer: 3.128 ms, - postprocess: 0.812 ms copy: 1.074 ms, - preprocess: 0.062 ms, - infer: 2.884 ms, - postprocess: 0.542 ms copy: 1.404 ms, - preprocess: 0.084 ms, - infer: 3.379 ms, - postprocess: 0.484 ms copy: 1.323 ms, - preprocess: 0.074 ms, - infer: 2.984 ms, - postprocess: 0.551 ms copy: 1.262 ms, - preprocess: 0.074 ms, - infer: 2.810 ms, - postprocess: 0.373 ms copy: 0.964 ms, - preprocess: 0.057 ms, - infer: 2.758 ms, - postprocess: 0.429 ms copy: 1.245 ms, - preprocess: 0.074 ms, - infer: 2.801 ms, - postprocess: 0.465 ms copy: 1.094 ms, - preprocess: 0.068 ms, - infer: 2.741 ms, - postprocess: 0.452 ms copy: 1.176 ms, - preprocess: 0.067 ms, - infer: 2.725 ms, - postprocess: 0.414 ms copy: 1.319 ms, - preprocess: 0.175 ms, - infer: 4.246 ms, - postprocess: 0.899 ms copy: 1.188 ms, - preprocess: 0.067 ms, - infer: 2.932 ms, - postprocess: 0.413 ms copy: 0.797 ms, - preprocess: 0.045 ms, - infer: 2.643 ms, - postprocess: 0.746 ms copy: 1.406 ms, - preprocess: 0.078 ms, - infer: 2.934 ms, - postprocess: 0.374 ms copy: 1.391 ms, - preprocess: 0.077 ms, - infer: 3.087 ms, - postprocess: 0.418 ms copy: 1.354 ms, - preprocess: 0.085 ms, - infer: 3.319 ms, - postprocess: 0.467 ms copy: 1.547 ms, - preprocess: 0.090 ms, - infer: 3.852 ms, - postprocess: 0.618 ms copy: 1.766 ms, - preprocess: 0.082 ms, - infer: 3.045 ms, - postprocess: 0.535 ms copy: 2.007 ms, - preprocess: 0.089 ms, - infer: 2.980 ms, - postprocess: 0.508 ms copy: 1.482 ms, - preprocess: 0.088 ms, - infer: 2.904 ms, - postprocess: 0.418 ms copy: 1.558 ms, - preprocess: 0.069 ms, - infer: 2.890 ms, - postprocess: 0.511 ms copy: 1.426 ms, - preprocess: 0.071 ms, - infer: 2.815 ms, - postprocess: 0.395 ms copy: 1.414 ms, - preprocess: 0.078 ms, - infer: 2.927 ms, - postprocess: 0.453 ms copy: 1.027 ms, - preprocess: 0.054 ms, - infer: 2.837 ms, - postprocess: 0.394 ms copy: 1.428 ms, - preprocess: 0.092 ms, - infer: 3.091 ms, - postprocess: 0.380 ms copy: 1.385 ms, - preprocess: 0.080 ms, - infer: 3.339 ms, - postprocess: 0.514 ms copy: 1.242 ms, - preprocess: 0.085 ms, - infer: 2.829 ms, - postprocess: 0.468 ms copy: 1.278 ms, - preprocess: 0.082 ms, - infer: 2.845 ms, - postprocess: 0.473 ms copy: 1.023 ms, - preprocess: 0.063 ms, - infer: 2.812 ms, - postprocess: 0.378 ms copy: 1.770 ms, - preprocess: 0.064 ms, - infer: 2.854 ms, - postprocess: 0.455 ms copy: 1.549 ms, - preprocess: 0.076 ms, - infer: 2.780 ms, - postprocess: 0.382 ms copy: 1.365 ms, - preprocess: 0.088 ms, - infer: 2.801 ms, - postprocess: 0.386 ms copy: 0.893 ms, - preprocess: 0.054 ms, - infer: 2.808 ms, - postprocess: 0.403 ms copy: 1.419 ms, - preprocess: 0.071 ms, - infer: 3.605 ms, - postprocess: 0.631 ms copy: 1.424 ms, - preprocess: 0.169 ms, - infer: 3.023 ms, - postprocess: 0.566 ms copy: 0.948 ms, - preprocess: 0.059 ms, - infer: 2.721 ms, - postprocess: 0.389 ms copy: 2.137 ms, - preprocess: 0.141 ms, - infer: 9.524 ms, - postprocess: 0.863 ms copy: 1.957 ms, - preprocess: 0.063 ms, - infer: 8.742 ms, - postprocess: 0.593 ms copy: 1.803 ms, - preprocess: 0.076 ms, - infer: 10.490 ms, - postprocess: 0.728 ms copy: 1.738 ms, - preprocess: 0.083 ms, - infer: 8.234 ms, - postprocess: 0.661 ms copy: 1.614 ms, - preprocess: 0.084 ms, - infer: 10.138 ms, - postprocess: 0.724 ms copy: 1.633 ms, - preprocess: 0.081 ms, - infer: 8.260 ms, - postprocess: 0.790 ms copy: 1.592 ms, - preprocess: 0.080 ms, - infer: 8.386 ms, - postprocess: 0.666 ms copy: 2.167 ms, - preprocess: 0.064 ms, - infer: 8.342 ms, - postprocess: 0.732 ms copy: 1.025 ms, - preprocess: 0.046 ms, - infer: 9.664 ms, - postprocess: 1.356 ms copy: 1.609 ms, - preprocess: 0.056 ms, - infer: 11.125 ms, - postprocess: 0.637 ms copy: 0.976 ms, - preprocess: 0.046 ms, - infer: 9.952 ms, - postprocess: 0.612 ms copy: 0.896 ms, - preprocess: 0.038 ms, - infer: 11.882 ms, - postprocess: 0.584 ms copy: 0.964 ms, - preprocess: 0.049 ms, - infer: 8.874 ms, - postprocess: 0.613 ms copy: 1.784 ms, - preprocess: 0.058 ms, - infer: 9.072 ms, - postprocess: 0.643 ms copy: 1.393 ms, - preprocess: 0.068 ms, - infer: 12.454 ms, - postprocess: 0.907 ms copy: 1.422 ms, - preprocess: 0.069 ms, - infer: 9.026 ms, - postprocess: 1.015 ms copy: 1.553 ms, - preprocess: 0.082 ms, - infer: 10.422 ms, - postprocess: 0.720 ms copy: 1.507 ms, - preprocess: 0.069 ms, - infer: 10.647 ms, - postprocess: 0.708 ms copy: 1.357 ms, - preprocess: 0.064 ms, - infer: 9.772 ms, - postprocess: 0.661 ms copy: 1.895 ms, - preprocess: 0.068 ms, - infer: 13.577 ms, - postprocess: 0.678 ms copy: 2.225 ms, - preprocess: 0.059 ms, - infer: 13.583 ms, - postprocess: 0.746 ms copy: 1.334 ms, - preprocess: 0.072 ms, - infer: 16.075 ms, - postprocess: 1.941 ms copy: 1.716 ms, - preprocess: 0.060 ms, - infer: 19.254 ms, - postprocess: 0.781 ms copy: 1.557 ms, - preprocess: 0.060 ms, - infer: 23.375 ms, - postprocess: 0.770 ms copy: 2.203 ms, - preprocess: 0.069 ms, - infer: 14.643 ms, - postprocess: 1.019 ms copy: 1.249 ms, - preprocess: 0.047 ms, - infer: 15.139 ms, - postprocess: 0.669 ms copy: 1.555 ms, - preprocess: 0.050 ms, - infer: 15.508 ms, - postprocess: 0.732 ms copy: 1.674 ms, - preprocess: 0.074 ms, - infer: 16.735 ms, - postprocess: 0.838 ms copy: 2.688 ms, - preprocess: 0.077 ms, - infer: 18.485 ms, - postprocess: 1.727 ms copy: 2.068 ms, - preprocess: 0.074 ms, - infer: 31.418 ms, - postprocess: 0.791 ms copy: 1.555 ms, - preprocess: 0.065 ms, - infer: 14.944 ms, - postprocess: 0.752 ms copy: 1.692 ms, - preprocess: 0.072 ms, - infer: 14.869 ms, - postprocess: 0.885 ms copy: 1.939 ms, - preprocess: 0.041 ms, - infer: 14.227 ms, - postprocess: 0.886 ms copy: 1.818 ms, - preprocess: 0.058 ms, - infer: 14.089 ms, - postprocess: 0.788 ms copy: 1.879 ms, - preprocess: 0.069 ms, - infer: 19.157 ms, - postprocess: 0.719 ms copy: 1.317 ms, - preprocess: 0.051 ms, - infer: 27.866 ms, - postprocess: 0.651 ms copy: 1.130 ms, - preprocess: 0.034 ms, - infer: 19.841 ms, - postprocess: 0.674 ms copy: 1.470 ms, - preprocess: 0.054 ms, - infer: 14.931 ms, - postprocess: 0.860 ms copy: 2.923 ms, - preprocess: 0.050 ms, - infer: 19.032 ms, - postprocess: 0.716 ms copy: 1.731 ms, - preprocess: 0.075 ms, - infer: 17.162 ms, - postprocess: 0.846 ms copy: 1.835 ms, - preprocess: 0.069 ms, - infer: 14.960 ms, - postprocess: 0.691 ms copy: 1.946 ms, - preprocess: 0.065 ms, - infer: 14.402 ms, - postprocess: 0.757 ms copy: 2.081 ms, - preprocess: 0.079 ms, - infer: 17.795 ms, - postprocess: 0.774 ms copy: 1.906 ms, - preprocess: 0.101 ms, - infer: 15.003 ms, - postprocess: 0.965 ms copy: 2.093 ms, - preprocess: 0.066 ms, - infer: 48.237 ms, - postprocess: 0.851 ms copy: 2.134 ms, - preprocess: 0.064 ms, - infer: 16.053 ms, - postprocess: 0.732 ms copy: 2.178 ms, - preprocess: 0.071 ms, - infer: 21.680 ms, - postprocess: 0.748 ms copy: 1.257 ms, - preprocess: 0.050 ms, - infer: 17.525 ms, - postprocess: 0.761 ms copy: 1.830 ms, - preprocess: 0.074 ms, - infer: 16.902 ms, - postprocess: 0.738 ms copy: 1.743 ms, - preprocess: 0.066 ms, - infer: 17.443 ms, - postprocess: 0.955 ms copy: 1.963 ms, - preprocess: 0.082 ms, - infer: 14.764 ms, - postprocess: 0.781 ms copy: 1.777 ms, - preprocess: 0.066 ms, - infer: 20.278 ms, - postprocess: 0.753 ms copy: 1.193 ms, - preprocess: 0.045 ms, - infer: 17.348 ms, - postprocess: 0.723 ms copy: 1.679 ms, - preprocess: 0.058 ms, - infer: 17.181 ms, - postprocess: 0.991 ms copy: 1.164 ms, - preprocess: 0.044 ms, - infer: 34.137 ms, - postprocess: 4.280 ms copy: 1.671 ms, - preprocess: 0.055 ms, - infer: 36.070 ms, - postprocess: 0.815 ms copy: 1.195 ms, - preprocess: 0.042 ms, - infer: 38.511 ms, - postprocess: 0.690 ms copy: 1.633 ms, - preprocess: 0.068 ms, - infer: 18.951 ms, - postprocess: 1.166 ms copy: 1.903 ms, - preprocess: 0.062 ms, - infer: 16.313 ms, - postprocess: 0.760 ms copy: 1.865 ms, - preprocess: 0.075 ms, - infer: 37.591 ms, - postprocess: 1.563 ms copy: 1.828 ms, - preprocess: 0.060 ms, - infer: 20.682 ms, - postprocess: 0.688 ms copy: 1.580 ms, - preprocess: 0.061 ms, - infer: 16.881 ms, - postprocess: 0.674 ms copy: 2.172 ms, - preprocess: 0.070 ms, - infer: 13.768 ms, - postprocess: 0.997 ms copy: 1.565 ms, - preprocess: 0.060 ms, - infer: 14.944 ms, - postprocess: 0.641 ms copy: 1.855 ms, - preprocess: 0.063 ms, - infer: 13.166 ms, - postprocess: 0.652 ms copy: 2.058 ms, - preprocess: 0.077 ms, - infer: 20.005 ms, - postprocess: 0.866 ms copy: 1.692 ms, - preprocess: 0.076 ms, - infer: 33.023 ms, - postprocess: 0.722 ms copy: 1.544 ms, - preprocess: 0.046 ms, - infer: 18.274 ms, - postprocess: 0.611 ms copy: 1.961 ms, - preprocess: 0.084 ms, - infer: 16.914 ms, - postprocess: 0.878 ms copy: 1.187 ms, - preprocess: 0.050 ms, - infer: 17.484 ms, - postprocess: 0.764 ms copy: 1.816 ms, - preprocess: 0.061 ms, - infer: 23.719 ms, - postprocess: 0.717 ms copy: 1.676 ms, - preprocess: 0.069 ms, - infer: 14.898 ms, - postprocess: 0.701 ms copy: 2.432 ms, - preprocess: 0.068 ms, - infer: 13.506 ms, - postprocess: 0.840 ms copy: 1.704 ms, - preprocess: 0.066 ms, - infer: 13.217 ms, - postprocess: 0.742 ms copy: 1.514 ms, - preprocess: 0.057 ms, - infer: 15.883 ms, - postprocess: 0.621 ms copy: 1.596 ms, - preprocess: 0.061 ms, - infer: 13.570 ms, - postprocess: 0.588 ms copy: 1.378 ms, - preprocess: 0.059 ms, - infer: 20.181 ms, - postprocess: 0.647 ms copy: 1.621 ms, - preprocess: 0.059 ms, - infer: 14.665 ms, - postprocess: 0.673 ms copy: 1.221 ms, - preprocess: 0.043 ms, - infer: 28.360 ms, - postprocess: 0.630 ms copy: 1.793 ms, - preprocess: 0.064 ms, - infer: 17.880 ms, - postprocess: 0.651 ms copy: 1.939 ms, - preprocess: 0.063 ms, - infer: 26.679 ms, - postprocess: 1.045 ms copy: 1.710 ms, - preprocess: 0.067 ms, - infer: 24.410 ms, - postprocess: 0.929 ms copy: 2.060 ms, - preprocess: 0.064 ms, - infer: 13.642 ms, - postprocess: 1.773 ms copy: 1.491 ms, - preprocess: 0.046 ms, - infer: 15.232 ms, - postprocess: 0.586 ms copy: 1.647 ms, - preprocess: 0.056 ms, - infer: 13.409 ms, - postprocess: 0.687 ms copy: 1.848 ms, - preprocess: 0.077 ms, - infer: 14.210 ms, - postprocess: 0.972 ms copy: 1.443 ms, - preprocess: 0.062 ms, - infer: 13.712 ms, - postprocess: 0.632 ms copy: 1.190 ms, - preprocess: 0.046 ms, - infer: 13.779 ms, - postprocess: 0.634 ms copy: 1.866 ms, - preprocess: 0.069 ms, - infer: 13.916 ms, - postprocess: 0.784 ms copy: 1.721 ms, - preprocess: 0.067 ms, - infer: 19.619 ms, - postprocess: 0.721 ms copy: 1.201 ms, - preprocess: 0.045 ms, - infer: 17.793 ms, - postprocess: 1.000 ms copy: 1.738 ms, - preprocess: 0.059 ms, - infer: 18.485 ms, - postprocess: 0.735 ms copy: 1.714 ms, - preprocess: 0.134 ms, - infer: 18.691 ms, - postprocess: 0.731 ms copy: 1.236 ms, - preprocess: 0.045 ms, - infer: 14.295 ms, - postprocess: 0.648 ms copy: 1.864 ms, - preprocess: 0.056 ms, - infer: 13.889 ms, - postprocess: 0.655 ms copy: 1.646 ms, - preprocess: 0.064 ms, - infer: 32.013 ms, - postprocess: 0.834 ms copy: 1.940 ms, - preprocess: 0.078 ms, - infer: 22.168 ms, - postprocess: 0.721 ms copy: 3.116 ms, - preprocess: 0.396 ms, - infer: 20.216 ms, - postprocess: 0.713 ms copy: 1.454 ms, - preprocess: 0.062 ms, - infer: 40.811 ms, - postprocess: 0.680 ms copy: 1.633 ms, - preprocess: 0.073 ms, - infer: 22.675 ms, - postprocess: 0.645 ms copy: 1.300 ms, - preprocess: 0.045 ms, - infer: 22.784 ms, - postprocess: 2.279 ms copy: 1.528 ms, - preprocess: 0.052 ms, - infer: 13.063 ms, - postprocess: 0.701 ms copy: 1.747 ms, - preprocess: 0.065 ms, - infer: 12.840 ms, - postprocess: 0.729 ms copy: 1.846 ms, - preprocess: 0.095 ms, - infer: 13.203 ms, - postprocess: 0.707 ms copy: 1.714 ms, - preprocess: 0.071 ms, - infer: 19.180 ms, - postprocess: 0.665 ms copy: 1.844 ms, - preprocess: 0.082 ms, - infer: 15.445 ms, - postprocess: 0.634 ms copy: 1.628 ms, - preprocess: 0.048 ms, - infer: 25.569 ms, - postprocess: 0.682 ms copy: 1.767 ms, - preprocess: 0.071 ms, - infer: 22.458 ms, - postprocess: 0.615 ms copy: 1.395 ms, - preprocess: 0.072 ms, - infer: 7.362 ms, - postprocess: 0.573 ms copy: 1.419 ms, - preprocess: 0.083 ms, - infer: 10.849 ms, - postprocess: 0.887 ms copy: 0.897 ms, - preprocess: 0.043 ms, - infer: 7.266 ms, - postprocess: 0.578 ms copy: 1.159 ms, - preprocess: 0.046 ms, - infer: 8.899 ms, - postprocess: 0.572 ms copy: 1.344 ms, - preprocess: 0.079 ms, - infer: 7.342 ms, - postprocess: 0.593 ms copy: 1.599 ms, - preprocess: 0.075 ms, - infer: 7.304 ms, - postprocess: 0.548 ms copy: 1.364 ms, - preprocess: 0.064 ms, - infer: 7.529 ms, - postprocess: 0.624 ms copy: 1.409 ms, - preprocess: 0.059 ms, - infer: 12.011 ms, - postprocess: 0.541 ms copy: 0.885 ms, - preprocess: 0.045 ms, - infer: 8.612 ms, - postprocess: 0.571 ms copy: 0.918 ms, - preprocess: 0.044 ms, - infer: 7.304 ms, - postprocess: 0.621 ms copy: 1.564 ms, - preprocess: 0.076 ms, - infer: 7.359 ms, - postprocess: 0.570 ms copy: 1.714 ms, - preprocess: 0.079 ms, - infer: 7.354 ms, - postprocess: 0.592 ms copy: 1.358 ms, - preprocess: 0.079 ms, - infer: 7.415 ms, - postprocess: 0.692 ms copy: 1.440 ms, - preprocess: 0.074 ms, - infer: 7.704 ms, - postprocess: 0.601 ms copy: 1.208 ms, - preprocess: 0.061 ms, - infer: 7.344 ms, - postprocess: 1.057 ms copy: 1.737 ms, - preprocess: 0.127 ms, - infer: 7.684 ms, - postprocess: 0.676 ms copy: 1.531 ms, - preprocess: 0.083 ms, - infer: 7.588 ms, - postprocess: 0.708 ms copy: 1.577 ms, - preprocess: 0.084 ms, - infer: 7.445 ms, - postprocess: 0.608 ms copy: 2.069 ms, - preprocess: 0.136 ms, - infer: 7.449 ms, - postprocess: 0.757 ms copy: 1.852 ms, - preprocess: 0.212 ms, - infer: 7.662 ms, - postprocess: 0.774 ms copy: 1.216 ms, - preprocess: 0.062 ms, - infer: 7.568 ms, - postprocess: 0.578 ms copy: 1.678 ms, - preprocess: 0.077 ms, - infer: 7.350 ms, - postprocess: 0.571 ms copy: 1.524 ms, - preprocess: 0.076 ms, - infer: 7.395 ms, - postprocess: 0.621 ms copy: 1.608 ms, - preprocess: 0.082 ms, - infer: 7.410 ms, - postprocess: 0.580 ms copy: 1.514 ms, - preprocess: 0.063 ms, - infer: 9.706 ms, - postprocess: 0.693 ms copy: 1.023 ms, - preprocess: 0.052 ms, - infer: 8.063 ms, - postprocess: 0.549 ms copy: 1.695 ms, - preprocess: 0.067 ms, - infer: 8.645 ms, - postprocess: 0.566 ms copy: 1.944 ms, - preprocess: 0.074 ms, - infer: 8.179 ms, - postprocess: 0.566 ms copy: 1.568 ms, - preprocess: 0.071 ms, - infer: 7.431 ms, - postprocess: 1.462 ms copy: 2.117 ms, - preprocess: 0.058 ms, - infer: 15.641 ms, - postprocess: 0.676 ms copy: 2.071 ms, - preprocess: 0.056 ms, - infer: 13.994 ms, - postprocess: 0.689 ms copy: 1.737 ms, - preprocess: 0.077 ms, - infer: 14.506 ms, - postprocess: 0.721 ms copy: 1.877 ms, - preprocess: 0.077 ms, - infer: 14.293 ms, - postprocess: 0.738 ms copy: 1.493 ms, - preprocess: 0.062 ms, - infer: 14.853 ms, - postprocess: 0.690 ms copy: 2.053 ms, - preprocess: 0.070 ms, - infer: 20.497 ms, - postprocess: 0.823 ms copy: 2.351 ms, - preprocess: 0.069 ms, - infer: 14.246 ms, - postprocess: 1.056 ms copy: 1.484 ms, - preprocess: 0.063 ms, - infer: 14.636 ms, - postprocess: 0.835 ms copy: 1.947 ms, - preprocess: 0.116 ms, - infer: 14.508 ms, - postprocess: 0.824 ms copy: 2.004 ms, - preprocess: 0.072 ms, - infer: 21.350 ms, - postprocess: 0.830 ms copy: 1.590 ms, - preprocess: 0.068 ms, - infer: 17.187 ms, - postprocess: 0.840 ms copy: 1.188 ms, - preprocess: 0.042 ms, - infer: 14.728 ms, - postprocess: 0.729 ms copy: 1.757 ms, - preprocess: 0.060 ms, - infer: 14.213 ms, - postprocess: 0.914 ms copy: 1.959 ms, - preprocess: 0.112 ms, - infer: 14.619 ms, - postprocess: 0.767 ms copy: 2.075 ms, - preprocess: 0.064 ms, - infer: 21.402 ms, - postprocess: 0.788 ms copy: 1.942 ms, - preprocess: 0.063 ms, - infer: 17.206 ms, - postprocess: 0.767 ms copy: 1.635 ms, - preprocess: 0.061 ms, - infer: 15.562 ms, - postprocess: 0.716 ms copy: 1.798 ms, - preprocess: 0.066 ms, - infer: 17.133 ms, - postprocess: 0.725 ms copy: 1.189 ms, - preprocess: 0.045 ms, - infer: 14.570 ms, - postprocess: 0.700 ms copy: 1.151 ms, - preprocess: 0.038 ms, - infer: 19.992 ms, - postprocess: 0.719 ms copy: 1.773 ms, - preprocess: 0.065 ms, - infer: 14.221 ms, - postprocess: 0.800 ms copy: 2.142 ms, - preprocess: 0.072 ms, - infer: 15.464 ms, - postprocess: 1.185 ms copy: 1.407 ms, - preprocess: 0.063 ms, - infer: 14.451 ms, - postprocess: 0.772 ms copy: 1.960 ms, - preprocess: 0.129 ms, - infer: 19.660 ms, - postprocess: 0.911 ms copy: 1.954 ms, - preprocess: 0.060 ms, - infer: 19.535 ms, - postprocess: 0.739 ms copy: 1.653 ms, - preprocess: 0.063 ms, - infer: 22.125 ms, - postprocess: 0.731 ms copy: 1.586 ms, - preprocess: 0.053 ms, - infer: 16.842 ms, - postprocess: 0.724 ms copy: 1.829 ms, - preprocess: 0.103 ms, - infer: 16.598 ms, - postprocess: 0.763 ms copy: 1.697 ms, - preprocess: 0.062 ms, - infer: 14.663 ms, - postprocess: 0.729 ms copy: 1.707 ms, - preprocess: 0.063 ms, - infer: 14.653 ms, - postprocess: 0.847 ms copy: 1.541 ms, - preprocess: 0.056 ms, - infer: 14.463 ms, - postprocess: 0.796 ms copy: 1.710 ms, - preprocess: 0.057 ms, - infer: 14.107 ms, - postprocess: 0.847 ms copy: 1.637 ms, - preprocess: 0.074 ms, - infer: 14.636 ms, - postprocess: 0.862 ms copy: 1.845 ms, - preprocess: 0.093 ms, - infer: 14.604 ms, - postprocess: 0.940 ms copy: 2.108 ms, - preprocess: 0.089 ms, - infer: 22.316 ms, - postprocess: 0.972 ms copy: 1.157 ms, - preprocess: 0.048 ms, - infer: 17.214 ms, - postprocess: 0.743 ms copy: 1.611 ms, - preprocess: 0.051 ms, - infer: 18.038 ms, - postprocess: 0.971 ms copy: 1.422 ms, - preprocess: 0.061 ms, - infer: 14.540 ms, - postprocess: 0.869 ms copy: 1.689 ms, - preprocess: 0.059 ms, - infer: 16.148 ms, - postprocess: 0.757 ms copy: 1.559 ms, - preprocess: 0.058 ms, - infer: 14.561 ms, - postprocess: 0.836 ms copy: 1.954 ms, - preprocess: 0.057 ms, - infer: 14.130 ms, - postprocess: 0.707 ms copy: 1.604 ms, - preprocess: 0.062 ms, - infer: 14.310 ms, - postprocess: 0.782 ms copy: 1.245 ms, - preprocess: 0.043 ms, - infer: 14.552 ms,

yohnyang commented 7 months ago

台式机

xzlhcx commented 6 months ago

@yohnyang 请问您是用的batch infer吗,相比于batch1是线性增加耗时的吗

yohnyang commented 6 months ago

batch推理的,不过设置的batchsize=1,每次推理一张图

xzlhcx commented 6 months ago

@yohnyang 请问有试过多batch推理么,耗时是线性增加的么

ZJDATY commented 6 months ago

我知道 显卡设置里没有设置高性能,他跑一会就会节能运行的