[docs] Update trtllm docs for 0.28.0 - Githubissues

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution

Apache License 2.0

189 stars 63 forks source link

[docs] Update trtllm docs for 0.28.0 #1990

Closed ydm-amazon closed 2 months ago

ydm-amazon commented 3 months ago

Description

LMI 0.28.0 max num tokens table
Updating list of supported models
Removing option.rolling_batch=trtllm line in suggested serving.properties
add relevant new properties