int8.rt unable to generate

ceccocats / tkDNN

Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms

GNU General Public License v2.0

718 stars 209 forks source link

int8.rt unable to generate #253

Closed B1ackg0d closed 3 years ago

B1ackg0d commented 3 years ago

I want to get yolo4tiny_int8.rt or other version of yolo4's int8.rt. I use test_all_tests.sh, but an error is reported. Can I ask a favour?Thanks in advance.

failed to open ../demo/COCO_val2017/all_images.txt
..\src\Int8BatchStream.cpp:69
Aborting...
unable to read serialRT file
..\tests\test_rtinference\rtinference.cpp:9
Aborting...

perseusdg commented 3 years ago

Did you download COCO_val2017/BDD dataset using either the download_validation.sh(for linux) or download_validation,py(for windows) before running test_all_tests.sh ,also I would recommend against doing this as it will take a considerable amount of time to complete (as it has to download all weights and generate the RT file for each and everyone of them) ,it might be better to follow the INT8 method mentioned in the docs

B1ackg0d commented 3 years ago

I get it.Thx!

B1ackg0d commented 3 years ago

download_validation.py is so slow, is there any better way?