search

triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend
Apache License 2.0
581 stars 81 forks source link

Update TensorRT-LLM backend #504

Closed Shixiaowei02 closed 1 week ago