search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
143 stars 37 forks source link

Adding llama 3.1 70B vllm #328

Closed htrivedi99 closed 3 months ago