Closed Whackjob closed 3 months ago
So given you have Intel Extension for Pytorch (IPEX) involved here, albeit using CPU rather than GPU which I am more experienced with, I feel the need to chime in on what can be the fault. First off, IPEX CPU is not supported on ComfyUI and I have not tried it to see if it works. The code with IPEX (contributed in part by me) was written to explicitly detect for GPU and if you don't have an Intel Arc GPU, it is most probably will get confused and not work. I have encountered something similar to your issue before and it is usually the fact that you have installed an IPEX version with an incompatible version of Intel's oneAPI basekit. Make sure if you are installing IPEX correctly via the installation guide provided by the project and check that it works via the sanity test stated in there before proceeding with doing whatever you want testing ComfyUI or etc., if you really want to go ahead with it,.
So given you have Intel Extension for Pytorch (IPEX) involved here, albeit using CPU rather than GPU which I am more experienced with, I feel the need to chime in on what can be the fault. First off, IPEX CPU is not supported on ComfyUI and I have not tried it to see if it works. The code with IPEX (contributed in part by me) was written to explicitly detect for GPU and if you don't have an Intel Arc GPU, it is most probably will get confused and not work. I have encountered something similar to your issue before and it is usually the fact that you have installed an IPEX version with an incompatible version of Intel's oneAPI basekit. Make sure if you are installing IPEX correctly via the installation guide provided by the project and check that it works via the sanity test stated in there before proceeding with doing whatever you want testing ComfyUI or etc., if you really want to go ahead with it,.
Huh. Well, that could be the problem. I don't want to use CPU, I've got a GPU. A770. I'll try to reinstall that, thank you
@Whackjob Any updates on this? I do also want to let you know that upon looking closer at your command to run ComfyUI, you are invoking ipexrun
to run ComfyUI which is why you are getting CPU IPEX in the first place. ipexrun
only supports CPU IPEX so it will force that on you. Just use python3
and IPEX GPU should just work as intended.
Thanks for checking back. I've tried removing and redoing it all. I'm sure it's just me, but something always seems to go wrong. I've been googling and troubleshooting as best as I can. I just don't seem to get there. I saw your comment and I figured, oh, there's the problem. So I tried it with just python3. Weirdly, I'm getting the same bloody error. I have to be missing a prerequisite, or have the wrong version of something. But man, I just can't work it out.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py --use-pytorch-cross-attention --highvram
Traceback (most recent call last):
File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in
It looks like it's still trying to call the CPU to me, but I haven't installed anything CPU instead of GPU. I've been careful about that. I'm sure the error is on my side. I just don't know where.
What does the sanity check in the install guide give you when you try and run the command, which is the following:
python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.__version__); print(ipex.__version__); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];"
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" 2.1.0.post2+cxx11.abi 2.1.30+xpu whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$
Your GPU isn't being detected, you should get a list of the devices on your system after the 2nd line. Here's my output for instance.
2.1.0.post2+cxx11.abi
2.1.30+xpu
[0]: _DeviceProperties(name='Intel(R) Arc(TM) A770 Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu', driver_version='1.3.29138', has_fp64=1, total_memory=16288MB, max_compute_units=512, gpu_eu_count=512)
You need to as I said in my first post, reinstall Intel's oneAPI basekit 2024.1 and unfortunately, there is no easy way of telling what version you have installed so I have no clue what is wrong on that front. If you have the correct version, the sanity test should show up correctly with the output I posted above.
I seem to have that.
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ sudo apt install intel-basekit Reading package lists... Done Building dependency tree... Done Reading state information... Done intel-basekit is already the newest version (2024.1.0-589). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Now, I went through all the steps on that page, and I see this:
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ sudo apt update
sudo apt install -y gpg-agent wget
[sudo] password for whackjob:
Get:1 file:/usr/lib/expressvpn/repo_mirror.list Mirrorlist [117 B]
Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease
Ign:5 http://packages.linuxmint.com virginia InRelease
Hit:6 https://apt.repos.intel.com/oneapi all InRelease
Hit:7 http://packages.linuxmint.com virginia Release
Get:2 https://repo.expressvpn.com/public/deb/debian any-version InRelease [4,580 B]
Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease
Err:11 https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease
403 Forbidden [IP: 13.224.214.26 443]
Hit:12 https://repositories.intel.com/graphics/ubuntu focal InRelease
Reading package lists... Done
E: Failed to fetch https://repositories.intel.com/gpu/ubuntu/dists//lts/2350/InRelease 403 Forbidden [IP: 13.224.214.26 443]
E: The repository 'https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
wget is already the newest version (1.21.2-2ubuntu1).
gpg-agent is already the newest version (2.2.27-3ubuntu2.1).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Looking around, it seems I need to try from other places via VPN? I gave that a shot, no luck. In the end, when I go to install the basekit, it gives me that version, which is right, isn't it?
Well for one, your GPG key isn't good for the Intel graphics APT repository. Can you redo the import?
wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \
gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg
You do have the oneAPI repository properly installed so that shouldn't be the issue. I would think the graphics APT repository shouldn't be at fault but it could very well be given you have to install intel-opencl-icd
, intel-level-zero-gpu
, level-zero
and level-zero-dev
packages for IPEX to work properly.
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \ gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg File '/usr/share/keyrings/intel-graphics.gpg' exists. Overwrite? (y/N) y gpg: can't create '/usr/share/keyrings/intel-graphics.gpg': Permission denied gpg: no valid OpenPGP data found. gpg: dearmoring failed: Permission denied
I tell ya, I am cursed.
You might have to run the gpg
command as sudo. Try the following.
wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \
sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg
I appreciate all the help. No luck yet, it seems.
whackjob@WhackjobONE:~$ wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg
File '/usr/share/keyrings/intel-graphics.gpg' exists. Overwrite? (y/N) y
whackjob@WhackjobONE:~$ sudo apt-get update
Get:1 file:/usr/lib/expressvpn/repo_mirror.list Mirrorlist [117 B]
Ign:3 http://packages.linuxmint.com virginia InRelease
Hit:4 http://packages.linuxmint.com virginia Release
Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:7 http://mirror.cogentco.com/pub/linux/ubuntu jammy InRelease
Hit:8 http://mirror.cogentco.com/pub/linux/ubuntu jammy-updates InRelease
Hit:9 http://mirror.cogentco.com/pub/linux/ubuntu jammy-backports InRelease
Hit:10 https://apt.repos.intel.com/oneapi all InRelease
Get:2 https://repo.expressvpn.com/public/deb/debian any-version InRelease [4,580 B]
Err:11 https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease
403 Forbidden [IP: 13.224.214.26 443]
Hit:12 https://repositories.intel.com/graphics/ubuntu focal InRelease
Reading package lists... Done
E: Failed to fetch https://repositories.intel.com/gpu/ubuntu/dists//lts/2350/InRelease 403 Forbidden [IP: 13.224.214.26 443]
E: The repository 'https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
What's weird is this is almost a fresh install of linux mint. Literally, a week or two.
It shouldn't be forbidden but it could be from Intel's end. Not much you can do there. Do you have intel-opencl-icd
, intel-level-zero-gpu
, level-zero
and level-zero-dev
packages installed?
Yessir. All four.
whackjob@WhackjobONE:~$ sudo apt install intel-opencl-icd
[sudo] password for whackjob:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
intel-opencl-icd is already the newest version (22.28.23726.1+i419~u20.04).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
whackjob@WhackjobONE:~$ sudo apt install intel-level-zero-gpu
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
intel-level-zero-gpu is already the newest version (1.3.23726.1+i419~u20.04).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
whackjob@WhackjobONE:~$ sudo apt install level-zero
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
level-zero is already the newest version (1.8.1+i755~u20.04).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
whackjob@WhackjobONE:~$ sudo apt install level-zero-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
level-zero-dev is already the newest version (1.8.1+i755~u20.04).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Sorry, I should've asked earlier. What is the output if you run the following:
source /opt/intel/oneapi/setvars.sh
sycl-ls
You should see something like this, especially the ext_oneapi_level_zero line.
[opencl:cpu:0] Intel(R) OpenCL, AMD Ryzen 9 5950X 16-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000]
[opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 9 5950X 16-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000]
[opencl:gpu:2] Intel(R) OpenCL Graphics, Intel(R) Arc(TM) A770 Graphics OpenCL 3.0 NEO [24.09.28717.17]
[ext_oneapi_level_zero:gpu:0] Intel(R) Level-Zero, Intel(R) Arc(TM) A770 Graphics 1.3 [1.3.28717]
Well, I certainly have a variance! [opencl:acc:0] Intel(R) FPGA Emulation Platform for OpenCL(TM), Intel(R) FPGA Emulation Device OpenCL 1.2 [2024.17.3.0.08_160000] [opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 5 3600 6-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000] [opencl:gpu:2] Intel(R) OpenCL HD Graphics, Intel(R) Graphics [0x56a0] OpenCL 3.0 NEO [22.28.23726.1]
Okay, I think I know what is up. Can you install the latest release of intel-compute-runtime and then run the command again?
Gave it a shot. Seems I already have it.
whackjob@WhackjobONE:~$ sudo apt-get install intel-opencl-icd
[sudo] password for whackjob:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
intel-opencl-icd is already the newest version (22.28.23726.1+i419~u20.04).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
No like actually go to the link, download and install it. You have a slightly older version, the latest is 24.13.29138.7
Followed the link, made the directory, pulled 'em down, installed. It went through clean. Then gave it another shot. Same error, as follows. sycl-ls has different output now though.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python main.py --use-pytorch-cross-attention --highvram
Traceback (most recent call last):
File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in
:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.
usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.
Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:
$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh
The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.
[opencl:acc:0] Intel(R) FPGA Emulation Platform for OpenCL(TM), Intel(R) FPGA Emulation Device OpenCL 1.2 [2024.17.3.0.08_160000] [opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 5 3600 6-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000] [opencl:gpu:2] Intel(R) OpenCL Graphics, Intel(R) Arc(TM) A770 Graphics OpenCL 3.0 NEO [24.13.29138.7] [ext_oneapi_level_zero:gpu:0] Intel(R) Level-Zero, Intel(R) Arc(TM) A770 Graphics 1.3 [1.3.29138] (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$
Yeah so it was the fault of the compute runtime being outdated. I think if you do the sanity test and ComfyUI again, it should work as intended. I do need to sleep now so I can't aid you any further today but I hope everything works.
Nah, I did give it a shot, still get the same iJIT_NotifyEvent. But we can call it a night. I do greatly appreciate the work you've put in and the time you've spent helping. If tomorrow night we can try a bit more, great, if not, it's all good.
The suggestion from https://github.com/pytorch/pytorch/issues/123097 seems to suggest downgrading Intel's MKL but I want to know what versions of those packages you have. Can you execute the following and give me the output?
apt list --installed | grep -i intel-oneapi-mkl
Hey, sure thing. Thanks for taking another swing at this conundrum.
whackjob@WhackjobONE:~$ apt list --installed | grep -i intel-oneapi-mkl
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
intel-oneapi-mkl-classic-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-cluster-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-devel/all,now 2024.1.0-691 amd64 [installed] intel-oneapi-mkl-sycl-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-blas-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-data-fitting-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-sycl-dft-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-lapack-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-rng-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-sparse-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-stats-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-vm-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic]
All the versions match the setup I have, but I am actually now curious, before we try and downgrade the MKL packages, can you give me the output of all the intel packages you have? The output might be too long so if you need to attach it as a text file, that would be fine.
apt list --installed | grep -i intel
whackjob@WhackjobONE:~$ apt list --installed | grep -i intel
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
intel-basekit-env-2024.1/all,now 2024.1.0-589 all [installed,automatic] intel-basekit-getting-started-2024.1/all,now 2024.1.0-589 all [installed,automatic] intel-basekit/all,now 2024.1.0-589 amd64 [installed] intel-igc-cm/unknown,now 1.0.224-821~22.04 amd64 [installed] intel-igc-core/now 1.0.16510.2 amd64 [installed,local] intel-igc-opencl/now 1.0.16510.2 amd64 [installed,local] intel-level-zero-gpu/now 1.3.29138.7 amd64 [installed,local] intel-media-va-driver-non-free/unknown,now 23.4.3-804~22.04 amd64 [installed] intel-microcode/jammy-updates,jammy-security,now 3.20231114.0ubuntu0.22.04.1 amd64 [installed] intel-oneapi-advisor/all,now 2024.1.0-499 amd64 [installed,automatic] intel-oneapi-ccl-2021.12/all,now 2021.12.0-309 amd64 [installed,automatic] intel-oneapi-ccl-devel-2021.12/all,now 2021.12.0-309 amd64 [installed,automatic] intel-oneapi-ccl-devel/all,now 2021.12.0-309 amd64 [installed] intel-oneapi-common-licensing-2024.1/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-licensing/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-oneapi-vars-2024.1/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-oneapi-vars/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-vars/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-compiler-cpp-eclipse-cfg-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-runtime-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-cpp/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-eclipse-cfg-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-shared-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-shared-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-shared-runtime-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-dal-2024.2/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dal-common-2024.2/all,now 2024.2.0-276 all [installed,automatic] intel-oneapi-dal-common-devel-2024.2/all,now 2024.2.0-276 all [installed,automatic] intel-oneapi-dal-devel-2024.2/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dal-devel/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dev-utilities-2024.1/all,now 2024.1.0-340 amd64 [installed,automatic] intel-oneapi-dev-utilities-eclipse-cfg-2024.1/all,now 2024.1.0-340 all [installed,automatic] intel-oneapi-dev-utilities/all,now 2024.1.0-340 amd64 [installed,automatic] intel-oneapi-diagnostics-utility-2024.1/all,now 2024.1.0-256 amd64 [installed,automatic] intel-oneapi-diagnostics-utility/all,now 2024.1.0-256 amd64 [installed,automatic] intel-oneapi-dnnl-2024.1/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl-devel-2024.1/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl-devel/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dpcpp-cpp-2024.1/all,now 2024.1.0-963 amd64 [installed] intel-oneapi-dpcpp-ct-2024.1/all,now 2024.1.0-374 amd64 [installed,automatic] intel-oneapi-dpcpp-ct-eclipse-cfg-2024.1/all,now 2024.1.0-374 all [installed,automatic] intel-oneapi-dpcpp-ct/all,now 2024.1.0-374 amd64 [installed,automatic] intel-oneapi-dpcpp-debugger-2024.1/all,now 2024.1.0-435 amd64 [installed,automatic] intel-oneapi-icc-eclipse-plugin-cpp-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-ipp-2021.11/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ipp-common-2021.11/all,now 2021.11.0-528 all [installed,automatic] intel-oneapi-ipp-common-devel-2021.11/all,now 2021.11.0-528 all [installed,automatic] intel-oneapi-ipp-devel-2021.11/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ipp-devel/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ippcp-2021.11/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-ippcp-common-2021.11/all,now 2021.11.0-33 all [installed,automatic] intel-oneapi-ippcp-common-devel-2021.11/all,now 2021.11.0-33 all [installed,automatic] intel-oneapi-ippcp-devel-2021.11/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-ippcp-devel/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-libdpstd-devel-2022.5/all,now 2022.5.0-215 amd64 [installed,automatic] intel-oneapi-mkl-classic-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-cluster-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-devel/all,now 2024.1.0-691 amd64 [installed] intel-oneapi-mkl-sycl-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-blas-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-data-fitting-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-sycl-dft-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-lapack-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-rng-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-sparse-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-stats-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-vm-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mpi-2021.12/all,now 2021.12.1-5 amd64 [installed,automatic] intel-oneapi-mpi-devel-2021.12/all,now 2021.12.1-5 amd64 [installed,automatic] intel-oneapi-openmp-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-openmp-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-tbb-2021.12/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tbb-common-2021.12/all,now 2021.12.0-495 all [installed,automatic] intel-oneapi-tbb-common-devel-2021.12/all,now 2021.12.0-495 all [installed,automatic] intel-oneapi-tbb-devel-2021.12/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tbb-devel/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tcm-1.0/all,now 1.0.1-175 amd64 [installed,automatic] intel-oneapi-tlt-2024.1/all,now 2024.1.0-447 amd64 [installed,automatic] intel-oneapi-tlt/all,now 2024.1.0-447 amd64 [installed,automatic] intel-oneapi-vtune/all,now 2024.1.0-515 amd64 [installed,automatic] intel-opencl-icd/now 24.13.29138.7 amd64 [installed,local] libdrm-intel1/unknown,now 2.4.119-2101~22.04 amd64 [installed] libdrm-intel1/unknown,now 2.4.119-2101~22.04 i386 [installed,auto-removable] xserver-xorg-video-intel/jammy,now 2:2.99.917+git20210115-1 amd64 [installed]
Sorry for the delay but I think I found the issue. You are missing the runtime for MKL SYCL. Can you do the following install command and then try again and see if you are still getting the iJIT_NotifyEvent
undefined issue?
sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691
I think we've found the issue. Not quite sure how to fix this, though.
whackjob@WhackjobONE:~$ sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691
[sudo] password for whackjob:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
You might want to run 'apt --fix-broken install' to correct these.
The following packages have unmet dependencies:
intel-oneapi-runtime-mkl : Depends: intel-oneapi-runtime-mkl-2024 but it is not going to be installed
libegl1 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
Breaks: libegl1:i386 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libegl1:i386 : Depends: libglvnd0:i386 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
Breaks: libegl1 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
libgl-dev : Depends: libgl1 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libgl1 : Depends: libglx0 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
Breaks: libgl1:i386 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
libgl1:i386 : Depends: libglx0:i386 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
Breaks: libgl1 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libgles1 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libgles2 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libglvnd-dev : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libglvnd0 : Breaks: libglvnd0:i386 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
libglvnd0:i386 : Breaks: libglvnd0 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libglx0 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
Breaks: libglx0:i386 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
libglx0:i386 : Depends: libglvnd0:i386 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
Breaks: libglx0 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed
libopengl0 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed
E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).
whackjob@WhackjobONE:~$ sudo apt --fix-broken install Reading package lists... Done Building dependency tree... Done Reading state information... Done Correcting dependencies... Done The following packages were automatically installed and are no longer required: libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386 Use 'sudo apt autoremove' to remove them. The following additional packages will be installed: libegl1:i386 libgl1 libglvnd0 libglx0:i386 The following packages will be upgraded: libegl1:i386 libgl1 libglvnd0 libglx0:i386 4 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 14 not fully installed or removed. Need to get 0 B/280 kB of archives. After this operation, 4,096 B of additional disk space will be used. Do you want to continue? [Y/n] y (Reading database ... 645058 files and directories currently installed.) Preparing to unpack .../libglx0_1.7.0-2101~22.04_i386.deb ... Unpacking libglx0:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libglx0_1.7.0-2101~22.04_i386.deb (--unpack): trying to overwrite shared '/usr/share/doc/libglx0/changelog.Debian.gz', which is different from other instances of package libglx0:i386 Preparing to unpack .../libgl1_1.7.0-2101~22.04_amd64.deb ... Unpacking libgl1:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libgl1_1.7.0-2101~22.04_amd64.deb (--unpack): trying to overwrite shared '/usr/share/doc/libgl1/changelog.Debian.gz', which is different from other instances of package libgl1:amd64 Preparing to unpack .../libegl1_1.7.0-2101~22.04_i386.deb ... Unpacking libegl1:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libegl1_1.7.0-2101~22.04_i386.deb (--unpack): trying to overwrite shared '/usr/share/doc/libegl1/changelog.Debian.gz', which is different from other instances of package libegl1:i386 Preparing to unpack .../libglvnd0_1.7.0-2101~22.04_amd64.deb ... Unpacking libglvnd0:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libglvnd0_1.7.0-2101~22.04_amd64.deb (--unpack): trying to overwrite shared '/usr/share/doc/libglvnd0/changelog.Debian.gz', which is different from other instances of package libglvnd0:amd64 Errors were encountered while processing: /var/cache/apt/archives/libglx0_1.7.0-2101~22.04_i386.deb /var/cache/apt/archives/libgl1_1.7.0-2101~22.04_amd64.deb /var/cache/apt/archives/libegl1_1.7.0-2101~22.04_i386.deb /var/cache/apt/archives/libglvnd0_1.7.0-2101~22.04_amd64.deb E: Sub-process /usr/bin/dpkg returned an error code (1)
You need to delete those files, I would presume, according to this Ubuntu forum post detailing the same issue. You can accomplish that with the following:
sudo rm '/usr/share/doc/libglx0/changelog.Debian.gz' '/usr/share/doc/libgl1/changelog.Debian.gz' '/usr/share/doc/libegl1/changelog.Debian.gz' '/usr/share/doc/libglvnd0/changelog.Debian.gz'
Do that and try repairing your install and installing the runtime.
whackjob@WhackjobONE:~$ sudo rm '/usr/share/doc/libglx0/changelog.Debian.gz' '/usr/share/doc/libgl1/changelog.Debian.gz' '/usr/share/doc/libegl1/changelog.Debian.gz' '/usr/share/doc/libglvnd0/changelog.Debian.gz'
[sudo] password for whackjob:
whackjob@WhackjobONE:~$ sudo apt --fix-broken install
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Correcting dependencies... Done
The following packages were automatically installed and are no longer required:
libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
libegl1:i386 libgl1 libglvnd0 libglx0:i386
The following packages will be upgraded:
libegl1:i386 libgl1 libglvnd0 libglx0:i386
4 upgraded, 0 newly installed, 0 to remove and 1 not upgraded.
14 not fully installed or removed.
Need to get 0 B/280 kB of archives.
After this operation, 4,096 B of additional disk space will be used.
Do you want to continue? [Y/n] y
(Reading database ... 645058 files and directories currently installed.)
Preparing to unpack .../libglx0_1.7.0-2101~22.04_i386.deb ...
Unpacking libglx0:i386 (1.7.0-2101~22.04) over (1.4.0-1) ...
Preparing to unpack .../libgl1_1.7.0-2101~22.04_amd64.deb ...
Unpacking libgl1:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ...
Preparing to unpack .../libegl1_1.7.0-2101~22.04_i386.deb ...
Unpacking libegl1:i386 (1.7.0-2101~22.04) over (1.4.0-1) ...
Preparing to unpack .../libglvnd0_1.7.0-2101~22.04_amd64.deb ...
Unpacking libglvnd0:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ...
Setting up libglvnd0:amd64 (1.7.0-2101~22.04) ...
Setting up libglvnd0:i386 (1.7.0-2101~22.04) ...
Setting up libopengl0:amd64 (1.7.0-2101~22.04) ...
Setting up libgles2:amd64 (1.7.0-2101~22.04) ...
Setting up libgles1:amd64 (1.7.0-2101~22.04) ...
Setting up libegl1:amd64 (1.7.0-2101~22.04) ...
Setting up libegl1:i386 (1.7.0-2101~22.04) ...
Setting up libopengl-dev:amd64 (1.7.0-2101~22.04) ...
Setting up libglx0:amd64 (1.7.0-2101~22.04) ...
Setting up libglx0:i386 (1.7.0-2101~22.04) ...
Setting up libgl1:amd64 (1.7.0-2101~22.04) ...
Setting up libgl1:i386 (1.7.0-2101~22.04) ...
Setting up libgl1-mesa-glx:i386 (24.1.0-devel.dg2-20240118-2102~22.04) ...
Setting up libglx-dev:amd64 (1.7.0-2101~22.04) ...
Setting up libgl-dev:amd64 (1.7.0-2101~22.04) ...
Setting up libegl-dev:amd64 (1.7.0-2101~22.04) ...
Setting up libgles-dev:amd64 (1.7.0-2101~22.04) ...
Setting up libglvnd-dev:amd64 (1.7.0-2101~22.04) ...
Processing triggers for libc-bin (2.35-0ubuntu3.7) ...
whackjob@WhackjobONE:~$ sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
intel-oneapi-runtime-compilers-2024 intel-oneapi-runtime-compilers-common-2024 intel-oneapi-runtime-dpcpp-cpp-2024 intel-oneapi-runtime-dpcpp-cpp-common-2024 intel-oneapi-runtime-dpcpp-sycl-core-2024
intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 intel-oneapi-runtime-dpcpp-sycl-rt-2024 intel-oneapi-runtime-mkl-2024
intel-oneapi-runtime-mkl-common-2024 intel-oneapi-runtime-opencl-2024 intel-oneapi-runtime-openmp-2024 intel-oneapi-runtime-openmp-opencl-shared-2024 intel-oneapi-runtime-tbb-2021 intel-oneapi-runtime-tbb-common-2021
intel-oneapi-runtime-tcm-1
The following NEW packages will be installed:
intel-oneapi-runtime-compilers-2024 intel-oneapi-runtime-compilers-common-2024 intel-oneapi-runtime-dpcpp-cpp-2024 intel-oneapi-runtime-dpcpp-cpp-common-2024 intel-oneapi-runtime-dpcpp-sycl-core-2024
intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 intel-oneapi-runtime-dpcpp-sycl-rt-2024 intel-oneapi-runtime-mkl intel-oneapi-runtime-mkl-2024
intel-oneapi-runtime-mkl-common-2024 intel-oneapi-runtime-opencl-2024 intel-oneapi-runtime-openmp-2024 intel-oneapi-runtime-openmp-opencl-shared-2024 intel-oneapi-runtime-tbb-2021 intel-oneapi-runtime-tbb-common-2021
intel-oneapi-runtime-tcm-1
0 upgraded, 18 newly installed, 0 to remove and 1 not upgraded.
Need to get 307 MB of archives.
After this operation, 2,086 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-tcm-1 amd64 1.0.1-175 [1,168 kB]
Get:2 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-openmp-opencl-shared-2024 amd64 2024.1.0-963 [3,954 kB]
Get:3 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-openmp-2024 amd64 2024.1.0-963 [14.0 MB]
Get:4 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-compilers-common-2024 all 2024.1.0-963 [10.3 kB]
Get:5 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-compilers-2024 amd64 2024.1.0-963 [28.0 MB]
Get:6 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-tbb-common-2021 all 2021.12.0-495 [7,288 B]
Get:7 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-tbb-2021 amd64 2021.12.0-495 [969 kB]
Get:8 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-cpp-common-2024 all 2024.1.0-963 [20.3 kB]
Get:9 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 amd64 2024.1.0-963 [90.4 MB]
Get:10 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-opencl-2024 amd64 2024.1.0-963 [49.7 kB]
Get:11 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-core-2024 all 2024.1.0-963 [2,444 kB]
Get:12 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 all 2024.1.0-963 [1,768 B]
Get:13 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-rt-2024 all 2024.1.0-963 [1,760 B]
Get:14 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 all 2024.1.0-963 [5,584 B]
Get:15 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-dpcpp-cpp-2024 amd64 2024.1.0-963 [2,952 B]
Get:16 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-mkl-common-2024 all 2024.1.0-691 [22.9 kB]
Get:17 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-mkl-2024 amd64 2024.1.0-691 [166 MB]
Get:18 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-mkl amd64 2024.1.0-691 [1,732 B]
Fetched 307 MB in 7s (46.4 MB/s)
Selecting previously unselected package intel-oneapi-runtime-tcm-1.
(Reading database ... 645058 files and directories currently installed.)
Preparing to unpack .../00-intel-oneapi-runtime-tcm-1_1.0.1-175_amd64.deb ...
Unpacking intel-oneapi-runtime-tcm-1 (1.0.1-175) ...
Selecting previously unselected package intel-oneapi-runtime-openmp-opencl-shared-2024.
Preparing to unpack .../01-intel-oneapi-runtime-openmp-opencl-shared-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-openmp-opencl-shared-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-openmp-2024.
Preparing to unpack .../02-intel-oneapi-runtime-openmp-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-openmp-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-compilers-common-2024.
Preparing to unpack .../03-intel-oneapi-runtime-compilers-common-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-compilers-common-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-compilers-2024.
Preparing to unpack .../04-intel-oneapi-runtime-compilers-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-compilers-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-tbb-common-2021.
Preparing to unpack .../05-intel-oneapi-runtime-tbb-common-2021_2021.12.0-495_all.deb ...
Unpacking intel-oneapi-runtime-tbb-common-2021 (2021.12.0-495) ...
Selecting previously unselected package intel-oneapi-runtime-tbb-2021.
Preparing to unpack .../06-intel-oneapi-runtime-tbb-2021_2021.12.0-495_amd64.deb ...
Unpacking intel-oneapi-runtime-tbb-2021 (2021.12.0-495) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-cpp-common-2024.
Preparing to unpack .../07-intel-oneapi-runtime-dpcpp-cpp-common-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-dpcpp-cpp-common-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024.
Preparing to unpack .../08-intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-opencl-2024.
Preparing to unpack .../09-intel-oneapi-runtime-opencl-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-opencl-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-core-2024.
Preparing to unpack .../10-intel-oneapi-runtime-dpcpp-sycl-core-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-dpcpp-sycl-core-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024.
Preparing to unpack .../11-intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-rt-2024.
Preparing to unpack .../12-intel-oneapi-runtime-dpcpp-sycl-rt-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-dpcpp-sycl-rt-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024.
Preparing to unpack .../13-intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024_2024.1.0-963_all.deb ...
Unpacking intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-dpcpp-cpp-2024.
Preparing to unpack .../14-intel-oneapi-runtime-dpcpp-cpp-2024_2024.1.0-963_amd64.deb ...
Unpacking intel-oneapi-runtime-dpcpp-cpp-2024 (2024.1.0-963) ...
Selecting previously unselected package intel-oneapi-runtime-mkl-common-2024.
Preparing to unpack .../15-intel-oneapi-runtime-mkl-common-2024_2024.1.0-691_all.deb ...
Unpacking intel-oneapi-runtime-mkl-common-2024 (2024.1.0-691) ...
Selecting previously unselected package intel-oneapi-runtime-mkl-2024.
Preparing to unpack .../16-intel-oneapi-runtime-mkl-2024_2024.1.0-691_amd64.deb ...
Unpacking intel-oneapi-runtime-mkl-2024 (2024.1.0-691) ...
Selecting previously unselected package intel-oneapi-runtime-mkl.
Preparing to unpack .../17-intel-oneapi-runtime-mkl_2024.1.0-691_amd64.deb ...
Unpacking intel-oneapi-runtime-mkl (2024.1.0-691) ...
Setting up intel-oneapi-runtime-tcm-1 (1.0.1-175) ...
Setting up intel-oneapi-runtime-tbb-common-2021 (2021.12.0-495) ...
Setting up intel-oneapi-runtime-tbb-2021 (2021.12.0-495) ...
Setting up intel-oneapi-runtime-compilers-common-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-openmp-opencl-shared-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-dpcpp-cpp-common-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-mkl-common-2024 (2024.1.0-691) ...
Setting up intel-oneapi-runtime-dpcpp-sycl-core-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-openmp-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-compilers-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-dpcpp-sycl-rt-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-opencl-2024 (2024.1.0-963) ...
update-alternatives: using /opt/intel/oneapi/redist/lib/libOpenCL.so to provide /usr/lib/x86_64-linux-gnu/libOpenCL.so (opencl-libOpenCL.so) in auto mode
update-alternatives: using /opt/intel/oneapi/redist to provide /opt/intel/opencl (opencl-intel-runtime) in auto mode
Setting up intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 (2024.1.0-963) ...
Setting up intel-oneapi-runtime-dpcpp-cpp-2024 (2024.1.0-963) ...
update-alternatives: using /opt/intel/oneapi/redist/etc/Intel_FPGA_SSG_Emulator.icd to provide /etc/OpenCL/vendors/intel64-fpgaemu.icd (Intel_FPGA_SSG_Emulator.icd) in auto mode
Setting up intel-oneapi-runtime-mkl-2024 (2024.1.0-691) ...
Setting up intel-oneapi-runtime-mkl (2024.1.0-691) ...
Processing triggers for libc-bin (2.35-0ubuntu3.7) ...
whackjob@WhackjobONE:~$
All of that installed OK now. I'll give it another shot, now.
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source venv/bin/activate (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh
:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.
usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.
Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:
$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh
The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh --force
:: initializing oneAPI environment ... bash: BASH_VERSION = 5.1.16(1)-release args: Using "$@" for setvars.sh arguments: --force :: advisor -- latest :: ccl -- latest :: compiler -- latest :: dal -- latest :: debugger -- latest :: dev-utilities -- latest :: dnnl -- latest :: dpcpp-ct -- latest :: dpl -- latest :: ipp -- latest :: ippcp -- latest :: mkl -- latest :: mpi -- latest :: tbb -- latest :: vtune -- latest :: oneAPI environment initialized ::
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python main.py --use-pytorch-cross-attention --highvram
Traceback (most recent call last):
File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in
TL;DR, it seems to have all installed OK, now. But the same bloody error!
Can you rerun the sanity test from https://github.com/comfyanonymous/ComfyUI/issues/3513#issuecomment-2119565104?
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" 2.1.0.post2+cxx11.abi 2.1.30+xpu [0]: _DeviceProperties(name='Intel(R) Arc(TM) A770 Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu', driver_version='1.3.29138', has_fp64=0, total_memory=15473MB, max_compute_units=512, gpu_eu_count=512)
Everything should be then working because the sanity test directly pulls from IPEX. Your IPEX is now using GPU so it's a matter of your version of ComfyUI not working. Are you using the latest? If so, can you try and run IPEX without any arguments? So just run python3 main.py
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py
Traceback (most recent call last):
File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in
I notice I'm on Python 3.10 and not 3.11. Could that be a factor? Or at least, it's defaulting to that
That only matters if you installed IPEX using the wrong packages for a different Python version but that should all work given the sanity check worked but if you can clarify, were you running the VENV when you ran the sanity check? It doesn't jive that the sanity test gives you the right versions with detecting IPEX but then ComfyUI doesn't run correctly with those versions detected correctly.
Yeah, deactivated the environment, fired it up again, sourced oneapi, then ran the sanity check. This is what I get:
whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source venv/bin/activate (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh
:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.
usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.
Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:
$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh
The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];"
Traceback (most recent call last):
File "
So you have the correct IPEX install outside of your VENV but not inside your VENV, which is what I am concluding. Can you source inside your VENV and reinstall IPEX and then test if it works? I believe you had other problems given you didn't get the correct output until very recently and you were missing the MKL packages but I think if you reinstall correctly, things should just work then.
I'll give it a shot in the morning, I think. I'm falling asleep at my desk. I should call it before I make some errors.
Thanks for the help, again. I feel like we're right on the cusp. I'll post tomorrow.
Who am I kidding, I won't sleep right. So I gave it a shot and just hoped I wouldn't fuck it up:
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30+xpu oneccl_bind_pt==2.1.300+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Looking in indexes: https://pypi.org/simple, https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Collecting torch==2.1.0.post2 Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./torch-2.1.0.post2%2Bcxx11.abi-cp310-cp310-linux_x86_64.whl (191.2 MB) Collecting torchvision==0.16.0.post2 Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./torchvision-0.16.0.post2%2Bcxx11.abi-cp310-cp310-linux_x86_64.whl (918 kB) Requirement already satisfied: torchaudio==2.1.0.post2 in ./venv/lib/python3.10/site-packages (2.1.0.post2+cxx11.abi) Collecting intel-extension-for-pytorch==2.1.30+xpu Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./intel_extension_for_pytorch-2.1.30%2Bxpu-cp310-cp310-linux_x86_64.whl (587.3 MB) Requirement already satisfied: oneccl_bind_pt==2.1.300+xpu in ./venv/lib/python3.10/site-packages (2.1.300+xpu) Requirement already satisfied: jinja2 in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.1.3) Requirement already satisfied: typing-extensions in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (4.11.0) Requirement already satisfied: filelock in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.14.0) Requirement already satisfied: fsspec in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (2024.3.1) Requirement already satisfied: sympy in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (1.12) Requirement already satisfied: networkx in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.3) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (10.3.0) Requirement already satisfied: numpy in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (1.26.4) Requirement already satisfied: requests in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (2.31.0) Requirement already satisfied: packaging in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (24.0) Requirement already satisfied: psutil in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (5.9.8) Requirement already satisfied: pydantic in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (2.7.1) Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2->torch==2.1.0.post2) (2.1.5) Requirement already satisfied: pydantic-core==2.18.2 in ./venv/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30+xpu) (2.18.2) Requirement already satisfied: annotated-types>=0.4.0 in ./venv/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30+xpu) (0.6.0) Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (3.7) Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (2.2.1) Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (3.3.2) Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (2024.2.2) Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.10/site-packages (from sympy->torch==2.1.0.post2) (1.3.0) Installing collected packages: torch, torchvision, intel-extension-for-pytorch Attempting uninstall: torch Found existing installation: torch 2.0.1a0+cxx11.abi Uninstalling torch-2.0.1a0+cxx11.abi: Successfully uninstalled torch-2.0.1a0+cxx11.abi Attempting uninstall: torchvision Found existing installation: torchvision 0.15.2a0+cxx11.abi Uninstalling torchvision-0.15.2a0+cxx11.abi: Successfully uninstalled torchvision-0.15.2a0+cxx11.abi Attempting uninstall: intel-extension-for-pytorch Found existing installation: intel-extension-for-pytorch 2.0.120+xpu Uninstalling intel-extension-for-pytorch-2.0.120+xpu: Successfully uninstalled intel-extension-for-pytorch-2.0.120+xpu Successfully installed intel-extension-for-pytorch-2.1.30+xpu torch-2.1.0.post2+cxx11.abi torchvision-0.16.0.post2+cxx11.abi (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh
:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.
usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.
Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:
$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh
The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py Total VRAM 15474 MB, total RAM 128711 MB Set vram state to: NORMAL_VRAM Device: xpu VAE dtype: torch.bfloat16 Using pytorch cross attention ** User settings have been changed to be stored on the server instead of browser storage. ** ** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. **
Import times for custom nodes: 0.0 seconds: /media/whackjob/16Tons/AI/ComfyUI/custom_nodes/websocket_image_save.py
Starting server
To see the GUI go to: http://127.0.0.1:8188
Brother, you taught me a lot today. How to troubleshoot this and such. Let me know how I can send you a few bucks for your trouble. You spent a lot of time on this, and I appreciate it.
I'm fine, just hope you can pass it on and help someone else whether regarding this or something else. Please close the issue when you are able to.
Some extra small nuggets of info.
--use-pytorch-cross-attention
argument since it is turned on by default for IPEX.--gpu-only
and offload everything but that is only viable for SD 1.5. You generally want to conserve VRAM and not offload everything when it comes to SDXL.--fp8_e4m3fn-text-enc
and --fp8_e4m3fn-unet
for now, but this can change depending what gets implemented and standardized for FP8 hardware support in the future.I'm using the A770 16GB. Not the greatest, but it's not bad, either. I've been staring down that ATI Radeon with what was it, 42GB of RAM? I remember zLUDA was continued for AMD stuff. A shame they didn't keep it up for intel's stuff! At least, nobody took that torch up yet.
It's probably something stupid and easy to fix, but I've had zero success googling and troubleshooting this error myself. I'm just at a loss. I've tried to redo this several times without luck.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in from intel_extension_for_pytorch.launcher import main File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/init.py", line 3, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent
The reason is that Oneapi don't match ipex version. If you have installed OneAPI 2024.2, you can execute
python -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30.post0 oneccl_bind_pt==2.1.300+xpu --extra-index-url
https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
Good morning!
This is what I get, now.
(venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in
@Whackjob Hi, please install intel oneapi base toolkit 2024.2 : https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit-download.html Then on Linux: $ source /opt/intel/oneapi/setvars.sh (venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram
Interestingly, it acted as though the intel base toolkit wasn't installed. I went through all the instructions, did the "source venv/bin/activate" and "source /opt/intel/oneapi/setvars.sh" and then finally "ipexrun main.py --use-pytorch-cross-attention --highvram"
This is what happens, now:
(venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in
It's probably something stupid and easy to fix, but I've had zero success googling and troubleshooting this error myself. I'm just at a loss. I've tried to redo this several times without luck.
(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in
from intel_extension_for_pytorch.launcher import main
File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/init.py", line 3, in
import torch
File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in
from torch._C import * # noqa: F403
ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent