Closed AlanNewImage closed 3 years ago
Output Buffers: 3 Output Buffers: 3 Output Buffers: 3 Output Buffers: 3 avg: 37.9915 this is yolo4_berkely_fp16,only 26fps download weights from this repo, and convert model to .rt by test_yolo4_berkeley
Hi @AlanNewImage What is the commit/branch you are working on? Thank you
branch master
I get 244fps for yolo4tiny_fp16 based the newest commit, but only 29fps for yolo4_berkeley_fp16.
What is the NV power mode? (try MAXN) What is your CUDA/cuDNN/tensorRT version? Thank you.
Thanks for your reply; CUDA: 10.2 TensorRT: 7.1.3 cudnn: 8.0.0.180
Ok I tested yolo4tiny_fp16 and yolo4_berkely_pf16 on an AGX xavier with your SW versions (CUDA 10.2, TensorRT 7.1.3, cudnn 8.0.0.180). (commit a992c9feb5fb5c7a64da59f6c5a6f0c1c1a6cf2d)
I set the NV power mode to 0 (MAXN), and I ran sudo jetson_clocks
.
with test_rtinference: yolo4tiny_fp16 --> ~ 315FPS yolo4_berkely_fp16 --> ~ 40fps
I also tested tkDNN with: NV power mode set to 3 (30W all) (and then ran sudo jetson_clocks
again).
yolo4tiny_fp16 --> ~ 210FPS yolo4_berkely_fp16 --> ~ 27fps
Are you sure that NV power mode is set to 0? After changing the power mode, did you run the 'sudo jetson_clocks' command again?
Thank you very much! I get 335 fps after set nvpmodel to 0 . WOW,it's amazing. Thanks again.
Hi:
I test yolo4tiny in AGX use newest repo ,only achieved about 120fps. launched jetson_clocks test by test_rtinference test in two diffrent AGX Xavier and have the same result
Output Buffers: 2 Output Buffers: 2 Output Buffers: 2 Output Buffers: 2 avg: 8.43752