search

NVIDIA-AI-IOT / tao_toolkit_recipes

Other
32 stars 15 forks source link

bash: tao-converter: command not found #17

Open MeHelge opened 9 months ago

MeHelge commented 9 months ago

Hi, i am getting this error after installing TensorRT OSS 22.02. What am I doing wrong?

nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

`nvidia-smi Thu Nov 23 08:56:52 2023
+---------------------------------------------------------------------------------------+ | NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 | |-----------------------------------------+----------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+======================+======================| | 0 NVIDIA GeForce RTX 2050 On | 00000000:01:00.0 Off | N/A | | N/A 48C P5 3W / 20W | 1224MiB / 4096MiB | 16% Default | | | | N/A | +-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=======================================================================================| +---------------------------------------------------------------------------------------+`

NAME="Ubuntu" VERSION="20.04.6 LTS (Focal Fossa)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 20.04.6 LTS" VERSION_ID="20.04"

`in_static.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterPlugin.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/specialSlicePlugin/specialSlicePlugin.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/splitPlugin.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/voxelGeneratorPlugin/voxelGenerator.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm75.cpp.o [ 21%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm80.cpp.o [ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm75.cpp.o [ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm80.cpp.o [ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm86.cpp.o [ 25%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm75.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm80.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm75.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm80.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm75.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm80.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm75.cpp.o [ 28%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm80.cpp.o [ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm75.cpp.o [ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm80.cpp.o [ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm75.cpp.o [ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm80.cpp.o [ 32%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm86.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm75.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm80.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm75.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm80.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm86.cpp.o [ 35%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm75.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm80.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm86.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm75.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm80.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm75.cpp.o [ 39%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm80.cpp.o [ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm75.cpp.o [ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm80.cpp.o [ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm86.cpp.o [ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm75.cpp.o [ 42%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm80.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm86.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_il_int8_128_32_kernel.sm80.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm75.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm80.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm72.cpp.o [ 46%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm75.cpp.o [ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm80.cpp.o [ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm86.cpp.o [ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm72.cpp.o [ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm75.cpp.o [ 50%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm80.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm86.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm75.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm80.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm72.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm75.cpp.o [ 53%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm80.cpp.o [ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm86.cpp.o [ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm72.cpp.o [ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm80.cpp.o [ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm75.cpp.o [ 57%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm86.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm75.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm75.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm80.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm80.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextInt8InterleavedPlugin.cpp.o [ 60%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContextPlugin.cpp.o [ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormPlugin.cpp.o [ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenPlugin.cpp.o [ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/fcPlugin/fcPlugin.cpp.o [ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluPlugin.cpp.o [ 64%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedPlugin.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormPlugin.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/checkMacrosPlugin.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/cudaDriverWrapper.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernel.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/nmsHelper.cpp.o [ 67%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/reducedMathPlugin.cpp.o [ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/batchedNMSInference.cu.o [ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o [ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/coordConvACPlugin/coordConvACPlugin.cu.o [ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/efficientNMSPlugin/efficientNMSInference.cu.o [ 71%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/groupNormalizationPlugin/groupNormalizationKernel.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormFwdImpl.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/instanceNormalizationPlugin/instanceNormalizationPlugin.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/scatterPlugin/scatterLayer.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/splitPlugin/split.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/allClassNMS.cu.o [ 75%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/bboxDeltas2Proposals.cu.o /tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(107): warning #1444-D: function "saturate(float)" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX , T_BBOX , T_BBOX *, nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (151): here instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void , void , void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]" (200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(109): warning #1444-D: function "saturate(float)" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX , T_BBOX , T_BBOX *, nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (151): here instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void , void , void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]" (200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(111): warning #1444-D: function "saturate(float)" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX , T_BBOX , T_BBOX *, nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (151): here instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void , void , void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]" (200): here

/tmp/TensorRT/plugin/batchedNMSPlugin/gatherNMSOutputs.cu(113): warning #1444-D: function "saturate(float)" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherNMSOutputs_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX , T_BBOX , T_BBOX *, nv_bool, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (151): here instantiation of "pluginStatus_t gatherNMSOutputs_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void , void , void *, __nv_bool, float) [with T_BBOX=float, T_SCORE=float]" (200): here

[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/common.cu.o /tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?

[ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/cropAndResizeKernel.cu.o [ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBBoxes.cu.o [ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/decodeBbox3DKernels.cu.o [ 78%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/detectionForward.cu.o [ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/extractFgScores.cu.o [ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gatherTopDetections.cu.o /tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, nv_bool, int, nv_bool, int, int, nv_bool, const T_BBOX , const T_BBOX , T_BBOX *, nv_bool) [with T_BBOX=float, nthds_per_cta=512U]" (309): here instantiation of "pluginStatus_t decodeBBoxes_gpu(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, __nv_bool, int, nv_bool, int, int, __nv_bool, const void , const void , void *, __nv_bool) [with T_BBOX=float]" (350): here

/tmp/TensorRT/plugin/common/kernels/decodeBBoxes.cu(282): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void decodeBBoxes_kernel<T_BBOX,nthds_per_cta>(int, nvinfer1::plugin::CodeTypeSSD, nv_bool, int, nv_bool, int, int, nv_bool, const T_BBOX , const T_BBOX , T_BBOX *, nv_bool) [with T_BBOX=half, nthds_per_cta=512U]" (309): here instantiation of "pluginStatus_t decodeBBoxes_gpu(cudaStream_t, int, nvinfer1::plugin::CodeTypeSSD, nv_bool, int, nv_bool, int, int, __nv_bool, const void , const void , void *, nv_bool) [with T_BBOX=half]" (351): here

[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/generateAnchors.cu.o [ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/gridAnchorLayer.cu.o /tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(97): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(115): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(96): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/splitPlugin/splitPlugin.h(94): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=float, T_SCORE=float]" (177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=float, T_SCORE=float]" (177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=float, T_SCORE=float]" (177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of __saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=float, T_SCORE=float, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=float, T_SCORE=float]" (177): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(93): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=half, T_SCORE=half, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=half, T_SCORE=__half]" (178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(95): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=half, T_SCORE=half, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=half, T_SCORE=__half]" (178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(97): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=half, T_SCORE=half, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=half, T_SCORE=__half]" (178): here

/tmp/TensorRT/plugin/common/kernels/gatherTopDetections.cu(99): warning #1444-D: function "saturate" /usr/local/cuda-11.8/bin/../targets/x86_64-linux/include/crt/device_functions.hpp(149): here was declared deprecated ("saturate() is deprecated in favor of saturatef() and may be removed in a future release (Use -Wno-deprecated-declarations to suppress this warning).") detected during: instantiation of "void gatherTopDetections_kernel<T_BBOX,T_SCORE,nthds_per_cta>(nv_bool, int, int, int, int, int, const int , const T_SCORE , const T_BBOX , int , T_BBOX *, T_SCORE) [with T_BBOX=half, T_SCORE=half, nthds_per_cta=32U]" (131): here instantiation of "pluginStatus_t gatherTopDetections_gpu<T_BBOX,T_SCORE>(cudaStream_t, nv_bool, int, int, int, int, int, const void , const void , const void , void , void *, float) [with T_BBOX=half, T_SCORE=__half]" (178): here

[ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/lReLU.cu.o [ 82%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/maskRCNNKernels.cu.o [ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/nmsLayer.cu.o [ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/normalizeLayer.cu.o [ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/permuteData.cu.o [ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/pillarScatterKernels.cu.o [ 85%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/priorBoxLayer.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalKernel.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/proposalsForward.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/regionForward.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/reorgForward.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/roiPooling.cu.o [ 89%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/rproiInferenceFused.cu.o [ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerClass.cu.o [ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/sortScoresPerImage.cu.o [ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/common/kernels/voxelGeneratorKernels.cu.o [ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/qkvToContext.cu.o /tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[ 92%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/bertQKVToContextPlugin/zeroPadding2d.cu.o [ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormKernel.cu.o [ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelHFace.cu.o [ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/embLayerNormPlugin/embLayerNormVarSeqlenKernelMTron.cu.o [ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/geluPlugin/geluKernel.cu.o /tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?

[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelHFace.cu.o /tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::EmbLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::EmbLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/embLayerNormPlugin/embLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::EmbLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(54): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::GeluPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::GeluPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::GeluPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/geluPlugin/geluPlugin.h(58): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::GeluPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(134): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(140): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(142): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::QKVToContextPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(138): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(224): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(230): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::QKVToContextVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(232): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/bertQKVToContextPlugin/qkvToContextPlugin.h(228): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::QKVToContextVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[ 96%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedKernelMTron.cu.o [100%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin_static.dir/skipLayerNormPlugin/skipLayerNormKernel.cu.o [100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/InferPlugin.cpp.o [100%] Building CXX object plugin/CMakeFiles/nvinfer_plugin_static.dir/__/samples/common/logger.cpp.o /tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const __nv_bool , const __nv_bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(56): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(62): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormPluginDynamic::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(64): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::SkipLayerNormPluginDynamic::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(60): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormPluginDynamic::configurePlugin" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(141): warning #997-D: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getOutputDimensions" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(147): warning #997-D: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::getWorkspaceSize" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(149): warning #997-D: function "nvinfer1::IPluginV2::enqueue(int32_t, const void const , void const , void *, cudaStream_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::enqueue" -- virtual function override intended?

/tmp/TensorRT/plugin/skipLayerNormPlugin/skipLayerNormPlugin.h(145): warning #997-D: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims , int32_t, const nvinfer1::Dims , int32_t, const nvinfer1::DataType , const nvinfer1::DataType , const bool , const bool , nvinfer1::PluginFormat, int32_t)" is hidden by "bert::SkipLayerNormVarSeqlenPlugin::configurePlugin" -- virtual function override intended?

[100%] Linking CXX static library ../libnvinfer_plugin_static.a [100%] Built target nvinfer_plugin_static ros@Helge:/tmp/TensorRT/build$ ARCH=x86_64 ros@Helge:/tmp/TensorRT/build$ cp libnvinfer_plugin.so.8.2. /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3 cp: cannot create regular file '/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so.8.2.3': Permission denied ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin.so.8.2. /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin.so.8.2.3 ros@Helge:/tmp/TensorRT/build$ sudo cp libnvinfer_plugin_static.a /usr/lib/$ARCH-linux-gnu/libnvinfer_plugin_static.a ros@Helge:/tmp/TensorRT/build$ tao-converter -k engine1 -e /workspaces/vscode_foxy_ros2_cuda_2/trt.fp16.engine -p points,1x204800x4,1x204800x4,1x204800x4 -p num_points,1,1,1 -t fp16 /workspaces/vscode_foxy_ros2_cuda_2/pointpillars_deployable.etlt bash: tao-converter: command not found`