search

simonw / llm

Access large language models from the command-line
https://llm.datasette.io
Apache License 2.0
3.43k stars 176 forks source link

Limit max tokens in response #513

Open detrin opened 2 weeks ago

detrin commented 2 weeks ago

After searching documentation and --help it seems like there is no way how we can limit the maximum number of output tokens as of now. https://llm.datasette.io/en/stable/search.html?q=max+tokens&check_keywords=yes&area=default