使用gpu比使用cpu识别图片还要慢

[xlz2004]

第一个是不使用gpu，第二个使用gpu

• 运行指令/CommD:\PRJ_OCR\Scripts\python.exe D:\000DOC\26_PycharmProjects\paddle\main.py [2024/03/29 03:59:46] ppocr DEBUG: Namespace(alpha=1.0, alphacolor=(255, 255, 255), benchmark=False, beta=1.0, binarize=False, cls_batch_num=6, cls_image_shape='3, 48, 192', cls_model_dir='C:\Users\Windows11/.paddleocr/whl\cls\ch_ppocr_mobile_v2.0_cls_infer', cls_thresh=0.9, cpu_threads=10, crop_res_save_dir='./output', det=True, det_algorithm='DB', det_box_type='quad', det_db_box_thresh=0.6, det_db_score_mode='fast', det_db_thresh=0.3, det_db_unclip_ratio=1.5, det_east_cover_thresh=0.1, det_east_nms_thresh=0.2, det_east_score_thresh=0.8, det_limit_side_len=960, det_limit_type='max', det_model_dir='C:\Users\Windows11/.paddleocr/whl\det\ch\ch_PP-OCRv4_det_infer', det_pse_box_thresh=0.85, det_pse_min_area=16, det_pse_scale=1, det_pse_thresh=0, det_sast_nms_thresh=0.2, det_sast_score_thresh=0.5, draw_img_save_dir='./inference_results', drop_score=0.5, e2e_algorithm='PGNet', e2e_char_dict_path='./ppocr/utils/ic15_dict.txt', e2e_limit_side_len=768, e2e_limit_type='max', e2e_model_dir=None, e2e_pgnet_mode='fast', e2e_pgnet_score_thresh=0.5, e2e_pgnet_valid_set='totaltext', enable_mkldnn=False, fourier_degree=5, gpu_id=0, gpu_mem=500, help='==SUPPRESS==', image_dir=None, image_orientation=False, invert=False, ir_optim=True, kie_algorithm='LayoutXLM', label_list=['0', '180'], lang='ch', layout=True, layout_dict_path=None, layout_model_dir=None, layout_nms_threshold=0.5, layout_score_threshold=0.5, max_batch_size=10, max_text_length=25, merge_no_span_structure=True, min_subgraph_size=15, mode='structure', ocr=True, ocr_order_method=None, ocr_version='PP-OCRv4', output='./output', page_num=0, precision='fp32', process_id=0, re_model_dir=None, rec=True, rec_algorithm='SVTR_LCNet', rec_batch_num=6, rec_char_dict_path='C:\Users\Windows11\AppData\Local\Programs\Python\Python38\lib\site-packages\paddleocr\ppocr\utils\ppocr_keys_v1.txt', rec_image_inverse=True, rec_image_shape='3, 48, 320', rec_model_dir='C:\Users\Windows11/.paddleocr/whl\rec\ch\ch_PP-OCRv4_rec_infer', recovery=False, save_crop_res=False, save_log_path='./log_output/', scales=[8, 16, 32], ser_dict_path='../train_data/XFUND/class_list_xfun.txt', ser_model_dir=None, show_log=True, sr_batch_num=1, sr_image_shape='3, 32, 128', sr_model_dir=None, structure_version='PP-StructureV2', table=True, table_algorithm='TableAttn', table_char_dict_path=None, table_max_len=488, table_model_dir=None, total_process_num=1, type='ocr', use_angle_cls=True, use_dilation=False, use_gpu=False, use_mp=False, use_npu=False, use_onnx=False, use_pdf2docx_api=False, use_pdserving=False, use_space_char=True, use_tensorrt=False, use_visual_backbone=True, use_xpu=False, vis_font_path='./doc/fonts/simfang.ttf', warmup=False) [2024/03/29 03:59:47] ppocr DEBUG: dt_boxes num : 6, elapsed : 0.14869236946105957 [2024/03/29 03:59:47] ppocr DEBUG: cls num : 6, elapsed : 0.03500008583068848 [2024/03/29 03:59:47] ppocr DEBUG: rec_res num : 6, elapsed : 0.11900019645690918 [[[57.0, 32.0], [174.0, 30.0], [175.0, 59.0], [58.0, 61.0]], ('购买数量：', 0.985855221748352)] [[[228.0, 35.0], [269.0, 35.0], [269.0, 63.0], [228.0, 63.0]], ('-10', 0.9117453098297119)] [[[413.0, 31.0], [455.0, 31.0], [455.0, 65.0], [413.0, 65.0]], ('10', 0.9987417459487915)] [[[604.0, 35.0], [650.0, 35.0], [650.0, 63.0], [604.0, 63.0]], ('+10', 0.9976823925971985)] [[[375.0, 138.0], [565.0, 142.0], [564.0, 177.0], [374.0, 173.0]], ('23230 购买', 0.9448067545890808)] [[[77.0, 167.0], [184.0, 167.0], [184.0, 191.0], [77.0, 191.0]], ('联络人兑换', 0.9958815574645996)] 程序执行时间： 0.30669188499450684 秒 程序执行时间： 0.3186922073364258 秒 D:\PRJ_OCR\Scripts\python.exe D:\000DOC\26_PycharmProjects\paddle\main.py [2024/03/29 04:02:52] ppocr DEBUG: Namespace(alpha=1.0, alphacolor=(255, 255, 255), benchmark=False, beta=1.0, binarize=False, cls_batch_num=6, cls_image_shape='3, 48, 192', cls_model_dir='C:\Users\Windows11/.paddleocr/whl\cls\ch_ppocr_mobile_v2.0_cls_infer', cls_thresh=0.9, cpu_threads=10, crop_res_save_dir='./output', det=True, det_algorithm='DB', det_box_type='quad', det_db_box_thresh=0.6, det_db_score_mode='fast', det_db_thresh=0.3, det_db_unclip_ratio=1.5, det_east_cover_thresh=0.1, det_east_nms_thresh=0.2, det_east_score_thresh=0.8, det_limit_side_len=960, det_limit_type='max', det_model_dir='C:\Users\Windows11/.paddleocr/whl\det\ch\ch_PP-OCRv4_det_infer', det_pse_box_thresh=0.85, det_pse_min_area=16, det_pse_scale=1, det_pse_thresh=0, det_sast_nms_thresh=0.2, det_sast_score_thresh=0.5, draw_img_save_dir='./inference_results', drop_score=0.5, e2e_algorithm='PGNet', e2e_char_dict_path='./ppocr/utils/ic15_dict.txt', e2e_limit_side_len=768, e2e_limit_type='max', e2e_model_dir=None, e2e_pgnet_mode='fast', e2e_pgnet_score_thresh=0.5, e2e_pgnet_valid_set='totaltext', enable_mkldnn=False, fourier_degree=5, gpu_id=0, gpu_mem=500, help='==SUPPRESS==', image_dir=None, image_orientation=False, invert=False, ir_optim=True, kie_algorithm='LayoutXLM', label_list=['0', '180'], lang='ch', layout=True, layout_dict_path=None, layout_model_dir=None, layout_nms_threshold=0.5, layout_score_threshold=0.5, max_batch_size=10, max_text_length=25, merge_no_span_structure=True, min_subgraph_size=15, mode='structure', ocr=True, ocr_order_method=None, ocr_version='PP-OCRv4', output='./output', page_num=0, precision='fp32', process_id=0, re_model_dir=None, rec=True, rec_algorithm='SVTR_LCNet', rec_batch_num=6, rec_char_dict_path='C:\Users\Windows11\AppData\Local\Programs\Python\Python38\lib\site-packages\paddleocr\ppocr\utils\ppocr_keys_v1.txt', rec_image_inverse=True, rec_image_shape='3, 48, 320', rec_model_dir='C:\Users\Windows11/.paddleocr/whl\rec\ch\ch_PP-OCRv4_rec_infer', recovery=False, save_crop_res=False, save_log_path='./log_output/', scales=[8, 16, 32], ser_dict_path='../train_data/XFUND/class_list_xfun.txt', ser_model_dir=None, show_log=True, sr_batch_num=1, sr_image_shape='3, 32, 128', sr_model_dir=None, structure_version='PP-StructureV2', table=True, table_algorithm='TableAttn', table_char_dict_path=None, table_max_len=488, table_model_dir=None, total_process_num=1, type='ocr', use_angle_cls=True, use_dilation=False, use_gpu=True, use_mp=False, use_npu=False, use_onnx=False, use_pdf2docx_api=False, use_pdserving=False, use_space_char=True, use_tensorrt=False, use_visual_backbone=True, use_xpu=False, vis_font_path='./doc/fonts/simfang.ttf', warmup=False) [2024/03/29 04:02:58] ppocr DEBUG: dt_boxes num : 6, elapsed : 0.3146381378173828 [2024/03/29 04:02:58] ppocr DEBUG: cls num : 6, elapsed : 0.01999974250793457 [2024/03/29 04:02:58] ppocr DEBUG: rec_res num : 6, elapsed : 0.05050992965698242 [[[57.0, 32.0], [174.0, 30.0], [175.0, 59.0], [58.0, 61.0]], ('购买数量：', 0.9859111905097961)] [[[228.0, 35.0], [269.0, 35.0], [269.0, 63.0], [228.0, 63.0]], ('-10', 0.9116573333740234)] [[[413.0, 31.0], [455.0, 31.0], [455.0, 65.0], [413.0, 65.0]], ('10', 0.9987435340881348)] [[[604.0, 35.0], [650.0, 35.0], [650.0, 63.0], [604.0, 63.0]], ('+10', 0.9977341294288635)] [[[375.0, 138.0], [565.0, 142.0], [564.0, 177.0], [374.0, 173.0]], ('23230 购买', 0.9444223046302795)] [[[77.0, 167.0], [184.0, 167.0], [184.0, 191.0], [77.0, 191.0]], ('联络人兑换', 0.9959731101989746)] 程序执行时间： 0.39014768600463867 秒 程序执行时间： 0.4001471996307373 秒

[zhangyubo0722]

使用gpu进行预测时gpu有利用率吗

[tiesanguaixia]

使用gpu进行预测时gpu有利用率吗

您好，我在使用GPU识别文字时速度也很慢，我也提了一个issue但没有人回复

[tink2123]

如果要测试推理速度，需要跑多张图，去除第一次调用的推理时间，计算平均速度。 只跑一张图会包含模型初始化时间，因此这个值不准确。

[478756994]

我使用onnxruntime cuda比cpu慢一倍多，能观察到使用了gpu核心。使用tensorrt provider就好了。