Open jeeftor opened 1 month ago
Following and current have vf showing up in proxmox, but haven't verified functionality. Will update in the next day or two. I have the same CPU (beelink GTi14) and doing completely fresh install.
Here are my current steps that are allowing VFs to show up in the host from a fresh 8.2.2 install:
bash -c "$(wget -qLO - https://github.com/tteck/Proxmox/raw/main/misc/post-pve-install.sh)"
nano /etc/apt/sources.list
#ADD THE FOLLOWING:
#non-free firmwares
deb http://deb.debian.org/debian bookworm non-free-firmware
#non-free drivers and components
deb http://deb.debian.org/debian bookworm non-free
#Install Intel GPU Drivers
apt update && apt install intel-media-va-driver-non-free intel-gpu-tools vainfo -y
apt update && apt install pve-headers-$(uname -r)
apt install git sysfsutils dkms build-* unzip -y
echo "options i915 force_probe=7d55 enable_guc=3" | tee -a /etc/modprobe.d/i915.conf
mkdir -p /lib/firmware/i915
wget https://github.com/intel-gpu/intel-gpu-firmware/raw/main/firmware/mtl_gsc_102.0.0.1511.bin -O /lib/firmware/i915/mtl_gsc_102.0.0.1511.bin
wget https://github.com/intel-gpu/intel-gpu-firmware/raw/main/firmware/mtl_guc_70.6.4.bin -O /lib/firmware/i915/mtl_guc_70.6.4.bin
wget https://github.com/intel-gpu/intel-gpu-firmware/raw/main/firmware/mtl_huc_8.4.3_gsc.bin -O /lib/firmware/i915/mtl_huc_8.4.3_gsc.bin
reboot
git clone https://github.com/strongtz/i915-sriov-dkms.git
cd ~/i915-sriov-dkms
dkms add .
dkms install -m i915-sriov-dkms -v $(cat VERSION) --force
nano /etc/default/grub
# change GRUB_CMDLINE_LINUX_DEFAULT to intel_iommu=on i915.enable_guc=3 i915.max_vfs=7, or add to it if you have other arguments there already.
update-grub
echo "devices/pci0000:00/0000:00:02.0/sriov_numvfs = 7" > /etc/sysfs.conf
reboot
Will continue on my progress after dinner/tomorrow.... Hopefully that gets you pointed in the right direction :)
Did you make any progress with this. I'm currently trying to get an Ultra 5 working? I thought I was making progress using Ubuntu 24.10 with kernel 6.11 but it seems not.
I wasn't able to get the VFs to work properly for the nodes. I gave up and went the LXC route for my needs. I'm sure it will get ironed out in the next couple of months, but nothing I did got me to the point where the vGPU would function properly in the VM. I'm also contemplating just doing a full passthrough to an Ubuntu 24.04 VM and running my containers inside there. Fingers crossed for full 14th gen iGPU support in the future. :)
You think full gpu passthrough would work? I've tried to get it working with Windows 11, but I couldn't get rid of error 43
I got the same error 43.
I got the same error 43.
With full passthough?
@mm2293 yes that's full passthrough. I've not got a VM to boot yet using SRIOV. I just installed the bbaa-bbaa branch to see if it helped with kernel 6.11 but I get errors still.
1.841400] i915: loading out-of-tree module taints kernel.
[ 1.841476] i915: module verification failed: signature and/or required key missing - tainting kernel
[ 2.114336] i915 0000:00:02.0: Force probing unsupported Device ID 7dd5, tainting kernel
[ 2.114390] i915 0000:00:02.0: Running in SR-IOV PF mode
[ 2.114556] i915 0000:00:02.0: [drm] GT0: Incompatible option enable_guc=3 - HuC is not supported!
[ 2.115596] i915 0000:00:02.0: [drm] VT-d active for gfx access
[ 2.115607] i915 0000:00:02.0: vgaarb: deactivate vga console
[ 2.115644] i915 0000:00:02.0: [drm] Using Transparent Hugepages
[ 2.115962] i915 0000:00:02.0: [drm] *ERROR* Unexpected child device config size 40 (expected 39 for VBT version 256)
[ 2.128460] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[ 2.138339] i915 0000:00:02.0: [drm] Finished loading DMC firmware i915/mtl_dmc.bin (v2.23)
[ 2.157480] i915 0000:00:02.0: [drm] GT0: GuC firmware i915/mtl_guc_70.bin version 70.29.2
[ 2.170018] i915 0000:00:02.0: [drm] GT0: GUC: submission enabled
[ 2.170023] i915 0000:00:02.0: [drm] GT0: GUC: SLPC enabled
[ 2.170256] i915 0000:00:02.0: [drm] GT0: GUC: RC enabled
[ 2.176915] mei_gsc_proxy 0000:00:16.0-0f73db04-97ab-4125-b893-e904ad0d5464: bound 0000:00:02.0 (ops i915_gsc_proxy_component_ops [i915])
[ 2.177251] i915 0000:00:02.0: [drm] GT1: GuC firmware i915/mtl_guc_70.bin version 70.29.2
[ 2.177253] i915 0000:00:02.0: [drm] GT1: HuC firmware i915/mtl_huc_gsc.bin version 8.5.4
[ 2.200368] i915 0000:00:02.0: [drm] GT1: HuC: authenticated for clear media
[ 2.200688] i915 0000:00:02.0: [drm] GT1: GUC: submission enabled
[ 2.200689] i915 0000:00:02.0: [drm] GT1: GUC: SLPC enabled
[ 2.200767] i915 0000:00:02.0: [drm] GT1: GUC: RC enabled
[ 2.203403] i915 0000:00:02.0: [drm] Protected Xe Path (PXP) protected content support initialized
[ 2.237552] [drm] Initialized i915 1.6.0 for 0000:00:02.0 on minor 1
[ 2.251708] i915 0000:00:02.0: 7 VFs could be associated with this PF
[ 2.285025] snd_hda_intel 0000:00:1f.3: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])
[ 2.286645] fbcon: i915drmfb (fb1) is primary device
[ 2.348121] i915 0000:00:02.0: [drm] GT1: Loaded GSC firmware i915/mtl_gsc_1.bin (cv1.0, r102.0.10.1878, svn 1)
[ 2.368152] i915 0000:00:02.0: [drm] GT1: HuC: authenticated for all workloads
[ 3.436565] i915 0000:00:02.0: [drm] fb1: i915drmfb frame buffer device
[ 9.409793] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=none:owns=io+mem
[ 9.409875] i915 0000:00:02.1: Force probing unsupported Device ID 7dd5, tainting kernel
[ 9.409885] i915 0000:00:02.1: enabling device (0000 -> 0002)
[ 9.409948] i915 0000:00:02.1: [drm] Cannot read valid display IP version; disabling display.
[ 9.409957] i915 0000:00:02.1: Running in SR-IOV VF mode
[ 9.409958] i915 0000:00:02.1: [drm] preliminary graphics version 12.70 media version 13.00
[ 9.410151] i915 0000:00:02.1: [drm] GT0: Incompatible option enable_guc=3 - HuC is not supported!
[ 9.410295] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4
[ 9.410333] i915 0000:00:02.1: [drm] GT0: GMD_ID 0x311c004 version 12.71 step B0
[ 9.411368] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4
[ 9.411537] i915 0000:00:02.1: [drm] GT1: GMD_ID 0x3400008 version 13.0 step C0
[ 9.412282] i915 0000:00:02.1: [drm] VT-d active for gfx access
[ 9.412332] i915 0000:00:02.1: [drm] Using Transparent Hugepages
[ 9.412940] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4
[ 9.416700] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4
[ 9.417249] i915 0000:00:02.1: GuC firmware PRELOADED version 0.0 submission:SR-IOV VF
[ 9.417252] i915 0000:00:02.1: HuC firmware N/A
[ 9.421001] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4
[ 9.423490] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4
[ 9.423679] i915 0000:00:02.1: GuC firmware PRELOADED version 0.0 submission:SR-IOV VF
[ 9.423681] i915 0000:00:02.1: HuC firmware PRELOADED
[ 9.426713] i915 0000:00:02.1: [drm] PMU not supported for this GPU.
[ 9.426834] [drm] Initialized i915 1.6.0 for 0000:00:02.1 on minor 2
[ 9.427321] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=none,decodes=none:owns=io+mem
[ 9.427325] i915 0000:00:02.1: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=none:owns=none
For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits.
For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits.
I had the same thought until I got the error 43 in Windows 11…
@mm2293 yes that's full passthrough. I've not got a VM to boot yet using SRIOV. I just installed the bbaa-bbaa branch to see if it helped with kernel 6.11 but I get errors still.
1.841400] i915: loading out-of-tree module taints kernel. [ 1.841476] i915: module verification failed: signature and/or required key missing - tainting kernel [ 2.114336] i915 0000:00:02.0: Force probing unsupported Device ID 7dd5, tainting kernel [ 2.114390] i915 0000:00:02.0: Running in SR-IOV PF mode [ 2.114556] i915 0000:00:02.0: [drm] GT0: Incompatible option enable_guc=3 - HuC is not supported! [ 2.115596] i915 0000:00:02.0: [drm] VT-d active for gfx access [ 2.115607] i915 0000:00:02.0: vgaarb: deactivate vga console [ 2.115644] i915 0000:00:02.0: [drm] Using Transparent Hugepages [ 2.115962] i915 0000:00:02.0: [drm] *ERROR* Unexpected child device config size 40 (expected 39 for VBT version 256) [ 2.128460] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem:owns=io+mem [ 2.138339] i915 0000:00:02.0: [drm] Finished loading DMC firmware i915/mtl_dmc.bin (v2.23) [ 2.157480] i915 0000:00:02.0: [drm] GT0: GuC firmware i915/mtl_guc_70.bin version 70.29.2 [ 2.170018] i915 0000:00:02.0: [drm] GT0: GUC: submission enabled [ 2.170023] i915 0000:00:02.0: [drm] GT0: GUC: SLPC enabled [ 2.170256] i915 0000:00:02.0: [drm] GT0: GUC: RC enabled [ 2.176915] mei_gsc_proxy 0000:00:16.0-0f73db04-97ab-4125-b893-e904ad0d5464: bound 0000:00:02.0 (ops i915_gsc_proxy_component_ops [i915]) [ 2.177251] i915 0000:00:02.0: [drm] GT1: GuC firmware i915/mtl_guc_70.bin version 70.29.2 [ 2.177253] i915 0000:00:02.0: [drm] GT1: HuC firmware i915/mtl_huc_gsc.bin version 8.5.4 [ 2.200368] i915 0000:00:02.0: [drm] GT1: HuC: authenticated for clear media [ 2.200688] i915 0000:00:02.0: [drm] GT1: GUC: submission enabled [ 2.200689] i915 0000:00:02.0: [drm] GT1: GUC: SLPC enabled [ 2.200767] i915 0000:00:02.0: [drm] GT1: GUC: RC enabled [ 2.203403] i915 0000:00:02.0: [drm] Protected Xe Path (PXP) protected content support initialized [ 2.237552] [drm] Initialized i915 1.6.0 for 0000:00:02.0 on minor 1 [ 2.251708] i915 0000:00:02.0: 7 VFs could be associated with this PF [ 2.285025] snd_hda_intel 0000:00:1f.3: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915]) [ 2.286645] fbcon: i915drmfb (fb1) is primary device [ 2.348121] i915 0000:00:02.0: [drm] GT1: Loaded GSC firmware i915/mtl_gsc_1.bin (cv1.0, r102.0.10.1878, svn 1) [ 2.368152] i915 0000:00:02.0: [drm] GT1: HuC: authenticated for all workloads [ 3.436565] i915 0000:00:02.0: [drm] fb1: i915drmfb frame buffer device [ 9.409793] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=none:owns=io+mem [ 9.409875] i915 0000:00:02.1: Force probing unsupported Device ID 7dd5, tainting kernel [ 9.409885] i915 0000:00:02.1: enabling device (0000 -> 0002) [ 9.409948] i915 0000:00:02.1: [drm] Cannot read valid display IP version; disabling display. [ 9.409957] i915 0000:00:02.1: Running in SR-IOV VF mode [ 9.409958] i915 0000:00:02.1: [drm] preliminary graphics version 12.70 media version 13.00 [ 9.410151] i915 0000:00:02.1: [drm] GT0: Incompatible option enable_guc=3 - HuC is not supported! [ 9.410295] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4 [ 9.410333] i915 0000:00:02.1: [drm] GT0: GMD_ID 0x311c004 version 12.71 step B0 [ 9.411368] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4 [ 9.411537] i915 0000:00:02.1: [drm] GT1: GMD_ID 0x3400008 version 13.0 step C0 [ 9.412282] i915 0000:00:02.1: [drm] VT-d active for gfx access [ 9.412332] i915 0000:00:02.1: [drm] Using Transparent Hugepages [ 9.412940] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4 [ 9.416700] i915 0000:00:02.1: [drm] GT0: GUC: interface version 0.1.13.4 [ 9.417249] i915 0000:00:02.1: GuC firmware PRELOADED version 0.0 submission:SR-IOV VF [ 9.417252] i915 0000:00:02.1: HuC firmware N/A [ 9.421001] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4 [ 9.423490] i915 0000:00:02.1: [drm] GT1: GUC: interface version 0.1.13.4 [ 9.423679] i915 0000:00:02.1: GuC firmware PRELOADED version 0.0 submission:SR-IOV VF [ 9.423681] i915 0000:00:02.1: HuC firmware PRELOADED [ 9.426713] i915 0000:00:02.1: [drm] PMU not supported for this GPU. [ 9.426834] [drm] Initialized i915 1.6.0 for 0000:00:02.1 on minor 2 [ 9.427321] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=none,decodes=none:owns=io+mem [ 9.427325] i915 0000:00:02.1: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=none:owns=none
I think we have to wait for the xe driver to Support SRIOV :/
Are the xe
drivers something attached to a kernel release - or we have to just wait on them to be written and they can be back-fit into an existing kernel?
The Xe driver is the current generation of Intel iGPU driver. It’s been in development for quite a while now, and as of Kernel 6.12 became the default in-kernel driver, replacing the i915 kernel driver.
iGPU (and A-series dGPU?) SR-IOV support was kind of shoe-horned into i915 based on the work done to get SR-IOV working in Xe, from my understanding. However, while the Xe driver should have more stable and featureful SR-IOV support than i915 going forward, the version of the Xe driver in the current 6.12 kernel does not enable SR-IOV support for iGPUs.
Given the latest dev notes, a lot of us are guessing we might not see SR-IOV enabled in Xe for iGPUs until at least 6.13.
John T Davis
On Oct 23, 2024, at 11:23 AM, Jeef @.***> wrote:
Are the xe drivers something attached to a kernel release - or we have to just wait on them to be written and they can be back-fit into an existing kernel?
— Reply to this email directly, view it on GitHub https://github.com/strongtz/i915-sriov-dkms/issues/210#issuecomment-2432783465, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGI5CYXXHGZSEU4CINF5ZI3Z47EPTAVCNFSM6AAAAABQCPAGFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZSG44DGNBWGU. You are receiving this because you are subscribed to this thread.
For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits.
Have you tried the full passthrough?
Indeed, and I managed to get it to work properly to passthrough to Ubuntu server 24.04. If I remember correctly, I installed drivers in both host and node.
On Sun, Oct 27, 2024, 12:33 AM mm2293 @.***> wrote:
For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits.
Have you tried the full passthrough?
— Reply to this email directly, view it on GitHub https://github.com/strongtz/i915-sriov-dkms/issues/210#issuecomment-2439890401, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFUFBEH7U7C3IBA3XA2E23Z5SCK7AVCNFSM6AAAAABQCPAGFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZZHA4TANBQGE . You are receiving this because you are subscribed to this thread.Message ID: @.***>
Indeed, and I managed to get it to work properly to passthrough to Ubuntu server 24.04. If I remember correctly, I installed drivers in both host and node. … On Sun, Oct 27, 2024, 12:33 AM mm2293 @.> wrote: For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits. Have you tried the full passthrough? — Reply to this email directly, view it on GitHub <#210 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFUFBEH7U7C3IBA3XA2E23Z5SCK7AVCNFSM6AAAAABQCPAGFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZZHA4TANBQGE . You are receiving this because you are subscribed to this thread.Message ID: @.>
Okay, hmm, what the hell is the problem with Windows then 😫
Indeed, and I managed to get it to work properly to passthrough to Ubuntu server 24.04. If I remember correctly, I installed drivers in both host and node. … On Sun, Oct 27, 2024, 12:33 AM mm2293 @.> wrote: For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits. Have you tried the full passthrough? — Reply to this email directly, view it on GitHub <#210 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFUFBEH7U7C3IBA3XA2E23Z5SCK7AVCNFSM6AAAAABQCPAGFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZZHA4TANBQGE . You are receiving this because you are subscribed to this thread.Message ID: @.>
Could you please share your configs?
Indeed, and I managed to get it to work properly to passthrough to Ubuntu server 24.04. If I remember correctly, I installed drivers in both host and node.
On Sun, Oct 27, 2024, 12:33 AM mm2293 @.***> wrote: For full GPU passthrough I imagine you just need to clean install latest proxmox, spin up a VM and pass through the GPU. I don't think there's anything else to it than that? I don't even think you need to install the drivers on the host or do any other kernel/boot edits. Have you tried the full passthrough?
Could you please share your configs?
I am also interested how to do it exactely, which drivers to install?
Hey guys, sorry for the delay. I think if I recall I added the kernel parameters for iommu and passthrough and then just passed it through. I don't recall doing anything special. If all else fails, using LXC passthrough works great as well. Unfortunately, I've moved on to using LXC exclusively for my use case and am not fully passing through the GPU
EPisKiNG, thanks for the response, but I'am rather a beginner in this stuff. And the server is already running different real time scripts, so I also want to minimize the testing phase...)
Add the following lines to your /etc/default/grub
file:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=o
update-grub and reboot
then adding a line to de vfio.conf file (xxx:xxx is the ID that can be found with lspci -nn | grep -i vga) echo "options vfio-pci ids=xxxx:xxxx" > /etc/modprobe.d/vfio.conf update-initramfs -u reboot.
I do not need to install the intel drivers on the host?
I believe the drivers should be installed, but if you're using modern PVE, you should already have them in the system. Technically, it shouldn't matter I don't think? Since we're passing through the GPU device in a "raw" manner rather than utilizing the vGPU functions.
Good luck!
Proxmox 8.3 released with option for 6.11 kernel. Wonder if that makes things any easier?
For the life of me I can't seem to get this thing to install on Kernel 6.8.12 with an 155H processor. Can somebody confirm whether its supposed to be supported at this juncture.
I haven't been able to get past this error
Kernel:
6.8.12-2-pve
LSPCI