triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend
Apache License 2.0
581 stars 81 forks source link

what is the matching version of the triton-trtllm (trtlllm v0.9.0) image in NGC ? #451

Closed tongjinle123 closed 1 month ago

tongjinle123 commented 1 month ago

match the version between NGC docker and the trtllm