search

nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.58k stars 7.7k forks source link

Intel ARC device not listed as GPU #2811

Closed enderger closed 3 months ago

enderger commented 3 months ago

Bug Report

When running an Intel ARC GPU on GNU/Linux, the GPU is not listed as an option (this was tested with both the i915 and Xe drivers).

Steps to Reproduce

  1. Run an Intel ARC card (I'm using an A770)
  2. Launch GPT4ALL
  3. Attempt to select your device (and see the GPU is not listed as an option)

Expected Behavior

The GPU would be listed in the Device menu

Your Environment

Inxi Output (likely applicable):

❯ inxi -FSaz
System:
  Kernel: 6.10.3-1-default arch: x86_64 bits: 64 compiler: gcc v: 13.3.0
    clocksource: tsc avail: hpet,acpi_pm
    parameters: BOOT_IMAGE=/boot/vmlinuz-6.10.3-1-default
    root=UUID=671ce992-b8c9-4309-8dd8-40467d7a6049 splash=silent
    mitigations=auto quiet security=apparmor i915.force_probe=!56a0
    xe.force_probe=56a0
  Desktop: KDE Plasma v: 6.1.3 tk: Qt v: N/A info: frameworks v: 6.4.0
    wm: kwin_x11 tools: avail: xscreensaver vt: 2 dm: SDDM Distro: openSUSE
    Tumbleweed 20240807
Machine:
  Type: Desktop System: ASUS product: N/A v: N/A serial: <superuser required>
  Mobo: ASUSTeK model: PRIME B550-PLUS v: Rev X.0x
    serial: <superuser required> part-nu: SKU uuid: <superuser required>
    UEFI: American Megatrends v: 3002 date: 02/23/2023
CPU:
  Info: model: AMD Ryzen 5 5600X bits: 64 type: MT MCP arch: Zen 3+ gen: 4
    level: v3 note: check built: 2022 process: TSMC n6 (7nm) family: 0x19 (25)
    model-id: 0x21 (33) stepping: 2 microcode: 0xA20120A
  Topology: cpus: 1x cores: 6 tpc: 2 threads: 12 smt: enabled cache:
    L1: 384 KiB desc: d-6x32 KiB; i-6x32 KiB L2: 3 MiB desc: 6x512 KiB
    L3: 32 MiB desc: 1x32 MiB
  Speed (MHz): avg: 2534 high: 4215 min/max: 2200/5279 boost: disabled
    scaling: driver: acpi-cpufreq governor: schedutil cores: 1: 2200 2: 2200
    3: 2200 4: 4215 5: 4198 6: 2200 7: 2200 8: 2200 9: 2200 10: 2200 11: 2200
    12: 2200 bogomips: 100837
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
  Vulnerabilities:
  Type: gather_data_sampling status: Not affected
  Type: itlb_multihit status: Not affected
  Type: l1tf status: Not affected
  Type: mds status: Not affected
  Type: meltdown status: Not affected
  Type: mmio_stale_data status: Not affected
  Type: reg_file_data_sampling status: Not affected
  Type: retbleed status: Not affected
  Type: spec_rstack_overflow status: Vulnerable: Safe RET, no microcode
  Type: spec_store_bypass mitigation: Speculative Store Bypass disabled via
    prctl
  Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer
    sanitization
  Type: spectre_v2 mitigation: Retpolines; IBPB: conditional; IBRS_FW;
    STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not
    affected
  Type: srbds status: Not affected
  Type: tsx_async_abort status: Not affected
Graphics:
  Device-1: Intel DG2 [Arc A770] driver: xe v: kernel alternate: i915
    arch: Gen-12.7 code: Alchemist process: TSMC n6 (7nm) built: 2022+ pcie:
    gen: 1 speed: 2.5 GT/s lanes: 1 ports: active: DP-1,HDMI-A-2 empty: DP-2,
    DP-3, DP-4, HDMI-A-1, HDMI-A-3 bus-ID: 0b:00.0 chip-ID: 8086:56a0
    class-ID: 0300
  Display: x11 server: X.Org v: 21.1.12 with: Xwayland v: 24.1.1
    compositor: kwin_x11 driver: X: loaded: modesetting dri: iris gpu: xe
    display-ID: :0 screens: 1
  Screen-1: 0 s-res: 3360x1080 s-dpi: 96 s-size: 889x285mm (35.00x11.22")
    s-diag: 934mm (36.75")
  Monitor-1: DP-1 pos: primary,left model: HP 22cwa serial: <filter>
    built: 2018 res: 1920x1080 hz: 60 dpi: 102 gamma: 1.2
    size: 476x268mm (18.74x10.55") diag: 546mm (21.5") ratio: 16:9 modes:
    max: 1920x1080 min: 720x400
  Monitor-2: HDMI-A-2 mapped: HDMI-2 pos: right model: Samsung SyncMaster
    serial: <filter> built: 2007 res: 1440x900 hz: 60 dpi: 89 gamma: 1.35
    size: 410x257mm (16.14x10.12") diag: 484mm (19.1") ratio: 16:10 modes:
    max: 1440x900 min: 720x400
  API: EGL v: 1.5 hw: drv: intel iris platforms: device: 0 drv: iris
    device: 1 drv: swrast gbm: drv: iris surfaceless: drv: iris x11: drv: iris
    inactive: wayland
  API: OpenGL v: 4.6 compat-v: 4.5 vendor: intel mesa v: 24.1.3 glx-v: 1.4
    direct-render: yes renderer: Mesa Intel Arc A770 Graphics (DG2)
    device-ID: 8086:56a0 memory: 15.53 GiB unified: no
  API: Vulkan v: 1.3.290 layers: 2 device: 0 type: discrete-gpu name: Intel
    Arc A770 Graphics (DG2) driver: N/A device-ID: 8086:56a0
    surfaces: xcb,xlib
Audio:
  Device-1: Intel DG2 Audio driver: snd_hda_intel v: kernel pcie:
    speed: Unknown lanes: 63 link-max: gen: 6 speed: 64 GT/s bus-ID: 0c:00.0
    chip-ID: 8086:4f90 class-ID: 0403
  Device-2: AMD Starship/Matisse HD Audio vendor: ASUSTeK
    driver: snd_hda_intel v: kernel pcie: gen: 4 speed: 16 GT/s lanes: 16
    bus-ID: 0e:00.4 chip-ID: 1022:1487 class-ID: 0403
  Device-3: C-Media Blue Snowball driver: hid-generic,snd-usb-audio,usbhid
    type: USB rev: 1.1 speed: 12 Mb/s lanes: 1 mode: 1.1 bus-ID: 1-7.1:5
    chip-ID: 0d8c:0005 class-ID: 0300 serial: <filter>
  API: ALSA v: k6.10.3-1-default status: kernel-api with: aoss
    type: oss-emulator tools: alsactl,alsamixer,amixer
  Server-1: PipeWire v: 1.2.1 status: active with: 1: pipewire-pulse
    status: active 2: wireplumber status: active 3: pipewire-alsa type: plugin
    4: pw-jack type: plugin tools: pactl,pw-cat,pw-cli,wpctl
Network:
  Device-1: Intel Wi-Fi 6 AX200 driver: iwlwifi v: kernel pcie: gen: 2
    speed: 5 GT/s lanes: 1 bus-ID: 04:00.0 chip-ID: 8086:2723 class-ID: 0280
  IF: wlp4s0 state: down mac: <filter>
  Device-2: Realtek RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet
    vendor: ASUSTeK RTL8111H driver: r8169 v: kernel pcie: gen: 1
    speed: 2.5 GT/s lanes: 1 port: f000 bus-ID: 08:00.0 chip-ID: 10ec:8168
    class-ID: 0200
  IF: enp8s0 state: up speed: 1000 Mbps duplex: full mac: <filter>
  Info: services: NetworkManager,wpa_supplicant
Bluetooth:
  Device-1: Intel AX200 Bluetooth driver: btusb v: 0.8 type: USB rev: 2.0
    speed: 12 Mb/s lanes: 1 mode: 1.1 bus-ID: 1-7.4:6 chip-ID: 8087:0029
    class-ID: e001
  Report: btmgmt ID: hci0 rfk-id: 0 state: up address: <filter> bt-v: 5.2
    lmp-v: 11 status: discoverable: no pairing: no class-ID: 6c0104
Drives:
  Local Storage: total: 5.46 TiB used: 3.29 TiB (60.2%)
  SMART Message: Unable to run smartctl. Root privileges required.
  ID-1: /dev/nvme0n1 maj-min: 259:0 vendor: Samsung model: SSD 980 1TB
    size: 931.51 GiB block-size: physical: 512 B logical: 512 B speed: 31.6 Gb/s
    lanes: 4 tech: SSD serial: <filter> fw-rev: 1B4QFXO7 temp: 38.9 C
    scheme: GPT
  ID-2: /dev/sda maj-min: 8:0 vendor: Seagate model: ST1000DM003-1SB102
    size: 931.51 GiB block-size: physical: 4096 B logical: 512 B speed: 6.0 Gb/s
    tech: HDD rpm: 7200 serial: <filter> fw-rev: HPH4 scheme: GPT
  ID-3: /dev/sdb maj-min: 8:16 vendor: Seagate model: ST4000DM005-2DP166
    size: 3.64 TiB block-size: physical: 4096 B logical: 512 B speed: 6.0 Gb/s
    tech: HDD rpm: 5980 serial: <filter> fw-rev: 0001 scheme: GPT
Partition:
  ID-1: / raw-size: 930.98 GiB size: 930.98 GiB (100.00%)
    used: 24.37 GiB (2.6%) fs: btrfs dev: /dev/nvme0n1p2 maj-min: 259:2
  ID-2: /boot/efi raw-size: 550 MiB size: 548.9 MiB (99.80%)
    used: 236.8 MiB (43.1%) fs: vfat dev: /dev/nvme0n1p1 maj-min: 259:1
  ID-3: /home raw-size: 3.63 TiB size: 3.63 TiB (100.00%)
    used: 3.26 TiB (89.8%) fs: btrfs dev: /dev/sdb2 maj-min: 8:18
  ID-4: /opt raw-size: 930.98 GiB size: 930.98 GiB (100.00%)
    used: 24.37 GiB (2.6%) fs: btrfs dev: /dev/nvme0n1p2 maj-min: 259:2
  ID-5: /var raw-size: 930.98 GiB size: 930.98 GiB (100.00%)
    used: 24.37 GiB (2.6%) fs: btrfs dev: /dev/nvme0n1p2 maj-min: 259:2
Swap:
  Alert: No swap data was found.
Sensors:
  System Temperatures: cpu: 40.9 C mobo: N/A
  Fan Speeds (rpm): N/A
Info:
  Memory: total: 32 GiB available: 31.26 GiB used: 5 GiB (16.0%)
  Processes: 372 Power: uptime: 0h 50m states: freeze,mem,disk suspend: deep
    avail: s2idle wakeups: 0 hibernate: platform avail: shutdown, reboot,
    suspend, test_resume image: 12.49 GiB services: org_kde_powerdevil,
    power-profiles-daemon, upowerd Init: systemd v: 256 default: graphical
    tool: systemctl
  Packages: 148 pm: nix-default pkgs: 51 pm: nix-sys pkgs: 0 pm: nix-usr
    pkgs: 1 pm: rpm pkgs: N/A note: see --rpm tools: yast,zypper pm: flatpak
    pkgs: 45 Compilers: clang: 18.1.8 gcc: 13.3.0 alt: 14 Shell: Bash
    v: 5.2.26 running-in: konsole inxi: 3.3.35
cebtenzzre commented 3 months ago

We blacklist Intel GPUs right now since they are known not to work with our Vulkan backend. The shaders are not sufficiently device-agnostic atm. See #1676