PaddlePaddle / PaddleDetection

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.
Apache License 2.0
12.64k stars 2.87k forks source link

mask-rtdetr推理时内存不断上升 #9021

Open LLsmile opened 3 months ago

LLsmile commented 3 months ago

问题确认 Search before asking

请提出你的问题 Please ask your question

运行命令:python tools/infer.py --config configs/mask_rtdetr/mask_rtdetr_hgnetv2_l_6x_coco.yml -o use_gpu=true weights=output/mask_rt-detr/70.pdparams --infer_dir synthetic/test/images/ --output_dir output/mask_rt-detr/vis_synthetic --save_results true 然后通过htop指令能看到内存不断上涨,直至测试了40张图片后内存达到系统内存极限,报错W0608 10:13:39.401028 2552216 sampler.cpp:194] bvar is busy at sampling for 2 seconds! 并卡死

LLsmile commented 3 months ago

Screenshot from 2024-06-08 10-15-27

lyuwenyu commented 3 months ago

发下paddle版本? 已经修改了其他什么没

David-dotcom666 commented 2 months ago

@lyuwenyu 我这边测试的内存变化有点奇怪,不知道正不正常,在加载进detector时,内存大概1个G,然后预测第一张图大概到5.7个G,第二张图开始基本稳定在7.5个多G 连续测试 paddle是3.0beta版本,ppdet是最新的develop 另外想请教下我现在测试2400*2000左右的,网络的input是640的图,一张图500多ms(2080ti的卡),这速度正常吗

David-dotcom666 commented 1 month ago

@LLsmile 请问你有解决这个问题吗