Thanks to @marioseixas. I'm a bit hesitant to set it to Inf because that could mean that the tool could in theory produce in an infinitely long response which would cause an infinitely high bill. Very unlikely, but who knows. Having 4096 tokens printed to the terminal is already pretty long.
Thanks to @marioseixas. I'm a bit hesitant to set it to
Infbecause that could mean that the tool could in theory produce in an infinitely long response which would cause an infinitely high bill. Very unlikely, but who knows. Having 4096 tokens printed to the terminal is already pretty long.