LTS for this Repo with NIMs on the horizon

triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend

Apache License 2.0

581 stars 81 forks source link

Closed IAINATDBI closed 2 weeks ago

IAINATDBI commented 2 weeks ago

Is there a strategy here that Triton/TensorRTLLM etc continues to sit in parallel with NIMs or will NIMs take over?

Cheers

byshiue commented 2 weeks ago

We will continue supporting the TRT-LLM and TRT-LLM triton backend.