build: Upgrade to 24.08, TRT-LLM 0.12.0, and Triton CLI v0.0.11

triton-inference-server / triton_cli

Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.

48 stars 2 forks source link

Closed rmccorm4 closed 1 month ago

rmccorm4 commented 1 month ago

Bumps Triton version to 24.08
Bumps TRT-LLM version to 0.12.0
- Updates model config templates and checkpoint conversion scripts
Bumps Triton CLI version to 0.0.11
Updated triton profile to map to genai-perf profile per genai-perf updates in 24.08
Added Llama-3.1 8B/8B-Instruct support for TRT-LLM

rmccorm4 commented 1 month ago

Pipeline 18139996 passing ✅