triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend
Apache License 2.0
711 stars 108 forks source link

Update TensorRT-LLM backend #620

Closed kaiyux closed 1 month ago