Open imtuyethan opened 1 day ago
It takes super long to download the file, is it expected?
Minor UI issue:
It takes super long to download the file, is it expected?
This is a Github thing @imtuyethan . not related to the app
I have encountered this issue multiple times so far:
How could we handle this better, considering there are users like me who rarely download new models (unless new releases have insane high-quality performance) & keep using what I already have?
https://github.com/user-attachments/assets/0e54a062-dbe5-4f05-a86f-3068e8cac428
Tested on: [x] Mac:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
Seems like wrong prompt template?
With the same prompt, Llama 3.2 1B Instruct Q8 gave me a correct/thorough answer.
Tested on:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
Suddenly there's a weird line:
While normally it looks like this:
I think i broke the app.
Tested on:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
Wrong UI of RAG feature (Not urgent, we can fix this later when we improve this feature!):
(The design link is also super outdated - it is our old UI)
Tested on:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
Model: LlaVa 7B
Seems like wrong prompt template? And the model didn't generate thread title:
Tested on:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
Search in Hub doesn't work properly:
Tested on: [x] Mac:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
These descriptions are not helpful:
@imtuyethan
This UI needs to be improved:
@imtuyethan UI improvement:
Model
to Running Models
Tested on: [x] Mac:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
When I click Start Server
, it takes a while to start, but the button doesn't change, which makes me feel like it's not working.
Expected flow: Click Start Server
> Button says Starting...
in disable state > Button changes to Stop Server
once server starts successfully
When i perform any new actions, i need to manually scroll down to see it is recorded in server logs:
https://github.com/user-attachments/assets/6dccb33d-b0bc-4b83-b807-a851850ca2f2
This one should be left aligned:
When i click quit
, the app closes completely, is this expected? Because the latest stable release is not like this.
https://github.com/user-attachments/assets/ce3c21bf-9576-4b80-bbe0-74ed2cbd31a2
Tested on:
Operating System: MacOS Sonoma 14.2 Processor: Apple M2 RAM: 16GB
I tried to move Jan Data Folder to the desktop, but it took around 5mins then showed an error, I failed to relocate it. Then I checked my desktop; there are folders like settings, themes, models, and so on that have been moved.
When i tried to clear logs, Cortex logs remained, should it be deleted as well?
Step to reproduce:
https://github.com/user-attachments/assets/cae9f511-1c04-416d-8031-2e0ccccea78c
Nightly is currently broken
cc @hiento09 ^
@imtuyethan @hiento09 I can update or download without any issues. Might your computer be blocking certain requests?
119 (test-windows-app-2)
- Processor: Intel(R) Xeon(R) Silver 4214R CPU @ 2.40GHz 2.40 GHz
- CPU: Intel Xeon Silver 4214R @ 2.40GHz
- RAM: 96GB
- OS: 64-bit operating system
- Architecture: x64-based processor
- GPU: AMD Radeon RX 7600 (but Jan does not support)
Gemma 7B Q4
from hub gave weird responseSeems like a prompt template issue?
119 (test-windows-app-2)
- Processor: Intel(R) Xeon(R) Silver 4214R CPU @ 2.40GHz 2.40 GHz
- CPU: Intel Xeon Silver 4214R @ 2.40GHz
- RAM: 96GB
- OS: 64-bit operating system
- Architecture: x64-based processor
- GPU: AMD Radeon RX 7600 (but Jan does not support)
This should be aligned properly cc @urmauur
119 (test-windows-app-2)
- Processor: Intel(R) Xeon(R) Silver 4214R CPU @ 2.40GHz 2.40 GHz
- CPU: Intel Xeon Silver 4214R @ 2.40GHz
- RAM: 96GB
- OS: 64-bit operating system
- Architecture: x64-based processor
- GPU: AMD Radeon RX 7600 (but Jan does not support)
Is it a bug? @louis-jan
Regression Test Checklist
Get original QA checklist here: https://hackmd.io/@janhq/SJO9kXpJ1x Release Version: v0.5.7
A. Installation, Update, and Uninstallation
1. Users Install App (New User Flow)
2. Users Update App (Existing User Flow)
/models
directory has any JSON/YML files that change according to the update.3. Users Uninstall / Close App
Testing Script:
B. Chat and Thread Functionality
1. Users Can Chat with Jan (Default Assistant)
clear message
/delete entire chat
button functionality.create new chat
button and confirm that a new conversation will have an automatically generated thread title based on the user's message.regenerate
button to ensure it renews the response (single/multiple times).Instructions
are updated correctly after the user updates it midway through the conversation (mid-thread).Testing Script:
2. Model Display & Handling
Model Selection
should highlight recommended models based on user RAM (this is likely based on a static formula).Model Selection
should be grouped correctly.Testing Script:
3. Users Can Customize Thread Settings
Testing Script:
4. Users Can Click on a History Thread
Testing Script
C. Hub
1. Users Can Discover Recommended Models
2. Users Can Download Models Suitable for Their Devices
3. Users Can Import Models via a HuggingFace URL
Testing Script
4. Users Can Import New Models to the Hub
5. Users can Integrate With a Remote Server
Use
a remote model that they already set up in HubD. System Monitor
1. Users Can See Disk and RAM Utilization
2. Users Can Start and Stop Models Based on System Health
[x] Check the functionality of App log to ensure it opens the correct folder in the system file explorer.
Testing Script:
a. Verify Real-Time RAM and VRAM Utilization
b. Validate Utilization Percentages
c. Monitor Updates Dynamically
a. Verify Start/Stop Action for Models
b. Log Model Status Changes
c. App Log Functionality
a. Use Default Server Option
URL: http://localhost:1337/static/index.html
b. Configure and Use Custom Server Options
URL: http://localhost:1338/static/index.html
a. Model Settings • Test: Run the server with different model settings to ensure proper log capture. • Steps:
a. Model Functionality • Test: Check that model-related functions (e.g., starting/stopping models from the UI) are disabled while the local server is running. • Steps:
F. Settings
1. My Models
My Models
page & assigned to provider groups correctly.Testing Script
2. Appearance
Testing Script
3. Keyboard Shorcuts
Settings
>Keyboard Shortcuts
) to confirm they function correctly.4. Advanced Settings
Experimental Mode
Experimental Mode
toggle to ensure it works as expected.Data Folder Relocation
Jan Data Folder
option opens the correct folder in the system.2. Proxy and SSL Certificate
3. Logs and Data Management
Clear Logs
works.Reset to Factory Settings
option works correctly:Testing Script
4. Extensions
1. Install and Enable Extensions
Install Extensions
process by selecting and installing a plugin file.2. Extension Group Management
1. Model Providers
Test each model provider extension to ensure it updates properly and maintains functionality:
Anthropic (v1.0.2):
Cohere (v1.0.0):
Groq (v1.0.1):
Martian (v1.0.1):
Mistral (v1.0.1):
TensorRT-LLM (v0.0.3):
NVIDIA NIM (v1.0.1):
OpenAI (v1.0.2):
OpenRouter (v1.0.0):
Triton-TRT-LLM (v1.0.0):
[ ] Confirm that Triton-TRT-LLM API key works.
2. Core Extensions
Model Management (v1.0.33):
System Monitoring (v1.0.10):