[Feature Request] New item in the settings Api

ChatGPTNextWeb / ChatGPT-Next-Web

A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。

https://app.nextchat.dev/

MIT License

76.26k stars 59.06k forks source link

[Feature Request] New item in the settings Api #5310

Open investing0 opened 2 months ago

investing0 commented 2 months ago

Hello, is it possible to add "max new tokens" in the settings to change the length of the response from LLM? In some compatible api openai, there is a default limit, for example, in the response 400 tokens, but if you specify, for example, as in SillyTavern there is a setting Response (tokens) 2000 tokens, then the length of the response will match and will not be cut off

nextchat-manager[bot] commented 2 months ago

Please follow the issue template to update title and description of your issue.