janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.32k stars 1.36k forks source link

feat: Graceful failure for model loading (not `Something's Amiss` Error) #3517

Open imtuyethan opened 2 months ago

imtuyethan commented 2 months ago

Background

I'm always frustrated when users encounter vague "Something's Amiss" errors that don't provide actionable information, especially for common issues like VRAM limitations when loading large models. This leads to confusion and extra support requests.

Feature request

Implement improved error handling in Jan. Some issues that potentially cause this error:

Proposed Implementation

Based on the lates discussion, it's current pending collecting crash report from users #ana

Additional Notes

No response

0xSage commented 2 months ago

We should bubble up cortex errors Part of a longer discussion here https://github.com/orgs/janhq/projects/5/views/47?pane=issue&itemId=78540537