retinface seems to fail to serialize on Jetson Orin AGX 64 GB

[whitewater69]

Env

• GPU : Jetson Orin AGX 64 Gb dev liot
• OS : Ubuntu 20.04
• Cuda version : 11.4
• TensorRT version : 8,5,2,1

About this repo

• Branch : Master
• Model : retinface

Your problem

When running sudo ./retina_r50 -s to serialize the model, the script seems to fail.

[03/08/2024-08:29:04] [W] [TRT] The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible. Loading weights: ../retinaface.wts Your platform support int8: 1 Building engine, please wait for a while... reading calib cache: r50_int8calib.table [03/08/2024-08:29:11] [W] [TRT] Unknown embedded device detected. Using 59662MiB as the allocation cap for memory on embedded devices. [03/08/2024-08:29:14] [E] [TRT] 1: Unexpected exception _Map_base::at Build engine successfully! retina_r50: /home/slacroix/retinaface/tensorrtx/retinaface/retina_r50.cpp:251: void APIToModel(unsigned int, nvinfer1::IHostMemory**): Assertion `engine != nullptr' failed. Aborted

Thank you for your help

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[MohdIsmaeil]

@whitewater69 : Did you solve the above issue?