search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
130 stars 37 forks source link

add max tokens to llama 3.1 example #337

Open philipkiely-baseten opened 1 month ago

dsingal0 commented 1 month ago

@philipkiely-baseten can you add it to 70B and 405B as well?