search

simonw / llm-gpt4all

Plugin for LLM adding support for the GPT4All collection of models
Apache License 2.0
194 stars 19 forks source link

200 is a bad default for `max_tokens` #31

Open simonw opened 2 months ago

simonw commented 2 months ago

https://github.com/simonw/llm-gpt4all/blob/363559a3accd49c5c0757a1bc843e0376c902bf2/llm_gpt4all.py#L75-L77

This affects models like Llama 3 8B.