search

airockchip / rknn_model_zoo

Apache License 2.0
1.05k stars 192 forks source link

rknn_inputs_set耗时问题 #167

Closed OMG59E closed 3 months ago

OMG59E commented 3 months ago

3588 跑了个 性能数据，为什么rknn_inputs_set这么耗时，内部会copy数据吗？

mobilenet_v2

rknn_inputs_set        ave time: 1.802ms, max_time: 1.954, min_time: 1.744, tp99: 1.920, tp99.9: 1.948
rknn_run        ave time: 2.652ms, max_time: 3.730, min_time: 2.308, tp99: 3.699, tp99.9: 3.718
rknn_outputs_get        ave time: 0.029ms, max_time: 0.045, min_time: 0.028, tp99: 0.033, tp99.9: 0.044
inference        ave time: 4.483ms, max_time: 5.653, min_time: 4.190, tp99: 5.579, tp99.9: 5.635

yolov5s_relu

rknn_inputs_set ave time: 14.845ms, max_time: 15.891, min_time: 14.253, tp99: 15.540, tp99.9: 15.891
rknn_run ave time: 17.486ms, max_time: 23.652, min_time: 16.326, tp99: 23.622, tp99.9: 23.652
rknn_outputs_get ave time: 1.226ms, max_time: 1.642, min_time: 1.127, tp99: 1.633, tp99.9: 1.642
inference ave time: 33.557ms, max_time: 40.977, min_time: 32.084, tp99: 40.614, tp99.9: 40.977