NVIDIA / trt-samples-for-hackathon-cn

Simple samples for TensorRT programming
Apache License 2.0
1.47k stars 337 forks source link

TensorRT-LLM插件设置顺序错误导致engine运行时报错(TensorRT Hackathon 2023) #95

Open Eddie-Wang1120 opened 11 months ago

Eddie-Wang1120 commented 11 months ago

Environment TensorRT 9.0.0.2 EA Container used: registry.cn-hangzhou.aliyuncs.com/trt-hackathon/trt-hackathon:final_v1 NVIDIA-SMI 525.105.17 Driver Version: 525.105.17 CUDA Version: 12.1

Reproduction Steps: step 1 : git clone git@github.com:Eddie-Wang1120/Eddie-Wang-Hackathon2023.git step 2 : 进入examples/whisper目录 step 3 : 将build.py 304行开始的以下代码注释,将275行开始的相同代码Uncomment。 image step 4 : bash run_int8_kv_cache.sh

Expected Behavior: 应该出现的正确结果如下: image

Actual Behavior: 实际出现的结果如下: image