bump up trtllm to 0.10.0

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution

Apache License 2.0

183 stars 58 forks source link

Closed ydm-amazon closed 3 weeks ago

ydm-amazon commented 1 month ago

Checklist

Notes:

I have found that transformers 4.40 is compatible with the container.
Running another build on this container after the changes to see if there are any errors (done)