Open robtail opened 3 months ago
@robtail You can use the "contextLength" option in your model in config.json to set a longer contextLength, or "completionOptions.maxTokens" for the output length. We'll be doing a better job of automatically detecting this in upcoming releases
Hi Sestinj,
Thanks for the fast reply! :)
contextLength was already set to million, see the original bug report:
"contextLength": 1000000,
And now i tried completionOptions.maxTokens to
"completionOptions.maxTokens": 8192,
but same issue still, it stop generate output after 2054 character. :( and the continue button not continue but start code generate again.
any suggestion?
Before submitting your bug report
Relevant environment info