TRT-LLM Quickstart Guide

triton-inference-server / triton_cli

Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.

48 stars 2 forks source link

Closed fpetrini15 closed 4 months ago

fpetrini15 commented 7 months ago

Goal: Restructure the Quickstart section to feature TRT-LLM

Secondary Goals: Remove unnecessary sections.