Firstly, thanks for your wonderful work. I have a question here. For production ready purpose of gpt-fast. Currently, repeat penalty or stop string and more function is not including in this repository. This will cause LLM generate repeat sentences and generate non-complete sentence in the end. Is there any plan to support these features?
Firstly, thanks for your wonderful work. I have a question here. For production ready purpose of gpt-fast. Currently, repeat penalty or stop string and more function is not including in this repository. This will cause LLM generate repeat sentences and generate non-complete sentence in the end. Is there any plan to support these features?