search

Chainlit / cookbook

Chainlit's cookbook repo
https://github.com/Chainlit/chainlit
726 stars 270 forks source link

Use max_new_tokens for Llama 2 #21

Closed philipkiely-baseten closed 1 year ago

philipkiely-baseten commented 1 year ago

Llama 2 requires max_new_tokens not max_tokens