janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.74k stars 1.38k forks source link

bug: Hide Vulkan option for users who don't have GPU #4093

Open imtuyethan opened 4 days ago

imtuyethan commented 4 days ago

Jan version

0.5.8-736

Describe the Bug

Vulkan engine option is visible and can be enabled on systems without a GPU. Users who turn it on without having a GPU will see this error:

Could not load engine llama-cpp: Could not load library 'C:\Users\jan\AppData\Local\Programs\jan-nightly\resources\app.asar.unpacked\shared\engines\cortex.llamacpp\windows-amd64-vulkan\v0.1.39\engine.dll

Screenshot 2024-11-22 at 12 18 30 AM

=> Vulkan option should be hidden on systems without GPU capability

Steps to Reproduce

  1. Launch Jan on a system without GPU
  2. Go to Model > Engine Settings
  3. Enable Vulkan option
  4. Attempt to start model

What is your OS?