Closed marioseixas closed 1 year ago
Hello
congratz on this awesome tool
Please remove the max_tokens parameter, so it could default to (4096 - prompt tokens)
You should not set the max_token, according to the official openAI API, the default value is Inf, and the model can process up to 4096 tokens of information.
Hello
congratz on this awesome tool
Please remove the max_tokens parameter, so it could default to (4096 - prompt tokens)
You should not set the max_token, according to the official openAI API, the default value is Inf, and the model can process up to 4096 tokens of information.