The terminal shows that:
-------The first time the model is being built, the waiting time is long (about
15 mins), and there will be a text message when it is finished.-------
[11/12/2023-13:46:26] [TRT] [I] [MemUsageChange] Init CUDA: CPU +3, GPU +0, now: CPU 9224, GPU 1073 (MiB)
[11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init builder kernel library: CPU +1393, GPU +266, now: CPU 11763, GPU 1339 (MiB)
[11/12/2023-13:46:31] [TRT] [W] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[11/12/2023-13:46:31] [TRT] [W] onnx2trt_utils.cpp:400: One or more weights outside the range of INT32 was clamped
[11/12/2023-13:46:31] [TRT] [I] No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin.
[11/12/2023-13:46:31] [TRT] [I] Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace:
[11/12/2023-13:46:31] [TRT] [W] builtin_op_importers.cpp:5221: Attribute class_agnostic not found in plugin node! Ensure that the plugin creator has a default value defined or the engine may fail to build.
[11/12/2023-13:46:31] [TRT] [I] Successfully created plugin: EfficientNMS_TRT
Network Description
Input 'images' with shape (1, 3, 640, 640) and dtype DataType.FLOAT
Output 'num_dets' with shape (1, 1) and dtype DataType.INT32
Output 'det_boxes' with shape (1, 12, 4) and dtype DataType.FLOAT
Output 'det_scores' with shape (1, 12) and dtype DataType.FLOAT
Output 'det_classes' with shape (1, 12) and dtype DataType.INT32
Building fp16 Engine in E:\APEX_AIMBOT-master\APEX_AIMBOT-master\weights\best_apex.trt
[11/12/2023-13:46:31] [TRT] [I] Graph optimization time: 0.0187271 seconds.
[11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU -1, GPU +10, now: CPU 10815, GPU 1349 (MiB)
[11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init cuDNN: CPU +10, GPU +8, now: CPU 10825, GPU 1357 (MiB)
[11/12/2023-13:46:31] [TRT] [I] Local timing cache in use. Profiling results in this builder pass will not be stored.
The terminal shows that: -------The first time the model is being built, the waiting time is long (about 15 mins), and there will be a text message when it is finished.------- [11/12/2023-13:46:26] [TRT] [I] [MemUsageChange] Init CUDA: CPU +3, GPU +0, now: CPU 9224, GPU 1073 (MiB) [11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init builder kernel library: CPU +1393, GPU +266, now: CPU 11763, GPU 1339 (MiB) [11/12/2023-13:46:31] [TRT] [W] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [11/12/2023-13:46:31] [TRT] [W] onnx2trt_utils.cpp:400: One or more weights outside the range of INT32 was clamped [11/12/2023-13:46:31] [TRT] [I] No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin. [11/12/2023-13:46:31] [TRT] [I] Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace: [11/12/2023-13:46:31] [TRT] [W] builtin_op_importers.cpp:5221: Attribute class_agnostic not found in plugin node! Ensure that the plugin creator has a default value defined or the engine may fail to build. [11/12/2023-13:46:31] [TRT] [I] Successfully created plugin: EfficientNMS_TRT Network Description Input 'images' with shape (1, 3, 640, 640) and dtype DataType.FLOAT Output 'num_dets' with shape (1, 1) and dtype DataType.INT32 Output 'det_boxes' with shape (1, 12, 4) and dtype DataType.FLOAT Output 'det_scores' with shape (1, 12) and dtype DataType.FLOAT Output 'det_classes' with shape (1, 12) and dtype DataType.INT32 Building fp16 Engine in E:\APEX_AIMBOT-master\APEX_AIMBOT-master\weights\best_apex.trt [11/12/2023-13:46:31] [TRT] [I] Graph optimization time: 0.0187271 seconds. [11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU -1, GPU +10, now: CPU 10815, GPU 1349 (MiB) [11/12/2023-13:46:31] [TRT] [I] [MemUsageChange] Init cuDNN: CPU +10, GPU +8, now: CPU 10825, GPU 1357 (MiB) [11/12/2023-13:46:31] [TRT] [I] Local timing cache in use. Profiling results in this builder pass will not be stored.