Closed ParisNeo closed 1 year ago
Added the possibility to stop the generation process any time. Added a function to count the number of tokens that a prompt has. This is needed by GPT4All-ui to optimize the generation process.
Thanks alot
Thanks @ParisNeo
@ParisNeo as I told you, I think you can do the same with version 1.0.7, have you tried it ?
Added the possibility to stop the generation process any time. Added a function to count the number of tokens that a prompt has. This is needed by GPT4All-ui to optimize the generation process.
Thanks alot