basetenlabs / truss

The simplest way to serve AI/ML models in production
https://truss.baseten.co
MIT License
857 stars 61 forks source link

update briton server version #992

Closed GaryBaseten closed 4 weeks ago

GaryBaseten commented 4 weeks ago

Updates the Briton server version to:

BRITON_TRTLLM_BASE_IMAGE = "baseten/briton-server:250d9c29_v0.0.2"

The version string uses the first 8 characters of the TensorRT-LLM commit hash and appends the Briton version string.