search

langchain-ai / langchain-nvidia

MIT License
48 stars 15 forks source link

set default max_tokens to 1024 #38

Closed mattf closed 4 months ago

mattf commented 4 months ago

if max_tokens is not set the service picks a value. that value is small enough that users report the model is broken or has poor accuracy.

fixes #34