comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
50.48k stars 5.31k forks source link

undefined symbol: iJIT_NotifyEvent #3513

Closed Whackjob closed 3 months ago

Whackjob commented 3 months ago

It's probably something stupid and easy to fix, but I've had zero success googling and troubleshooting this error myself. I'm just at a loss. I've tried to redo this several times without luck.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in from intel_extension_for_pytorch.launcher import main File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/init.py", line 3, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

simonlui commented 3 months ago

So given you have Intel Extension for Pytorch (IPEX) involved here, albeit using CPU rather than GPU which I am more experienced with, I feel the need to chime in on what can be the fault. First off, IPEX CPU is not supported on ComfyUI and I have not tried it to see if it works. The code with IPEX (contributed in part by me) was written to explicitly detect for GPU and if you don't have an Intel Arc GPU, it is most probably will get confused and not work. I have encountered something similar to your issue before and it is usually the fact that you have installed an IPEX version with an incompatible version of Intel's oneAPI basekit. Make sure if you are installing IPEX correctly via the installation guide provided by the project and check that it works via the sanity test stated in there before proceeding with doing whatever you want testing ComfyUI or etc., if you really want to go ahead with it,.

Whackjob commented 3 months ago

So given you have Intel Extension for Pytorch (IPEX) involved here, albeit using CPU rather than GPU which I am more experienced with, I feel the need to chime in on what can be the fault. First off, IPEX CPU is not supported on ComfyUI and I have not tried it to see if it works. The code with IPEX (contributed in part by me) was written to explicitly detect for GPU and if you don't have an Intel Arc GPU, it is most probably will get confused and not work. I have encountered something similar to your issue before and it is usually the fact that you have installed an IPEX version with an incompatible version of Intel's oneAPI basekit. Make sure if you are installing IPEX correctly via the installation guide provided by the project and check that it works via the sanity test stated in there before proceeding with doing whatever you want testing ComfyUI or etc., if you really want to go ahead with it,.

Huh. Well, that could be the problem. I don't want to use CPU, I've got a GPU. A770. I'll try to reinstall that, thank you

simonlui commented 3 months ago

@Whackjob Any updates on this? I do also want to let you know that upon looking closer at your command to run ComfyUI, you are invoking ipexrun to run ComfyUI which is why you are getting CPU IPEX in the first place. ipexrun only supports CPU IPEX so it will force that on you. Just use python3 and IPEX GPU should just work as intended.

Whackjob commented 3 months ago

Thanks for checking back. I've tried removing and redoing it all. I'm sure it's just me, but something always seems to go wrong. I've been googling and troubleshooting as best as I can. I just don't seem to get there. I saw your comment and I figured, oh, there's the problem. So I tried it with just python3. Weirdly, I'm getting the same bloody error. I have to be missing a prerequisite, or have the wrong version of something. But man, I just can't work it out.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in import comfy.utils File "/media/whackjob/16Tons/AI/ComfyUI/comfy/utils.py", line 1, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

It looks like it's still trying to call the CPU to me, but I haven't installed anything CPU instead of GPU. I've been careful about that. I'm sure the error is on my side. I just don't know where.

simonlui commented 3 months ago

What does the sanity check in the install guide give you when you try and run the command, which is the following:

python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.__version__); print(ipex.__version__); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];"
Whackjob commented 3 months ago

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" 2.1.0.post2+cxx11.abi 2.1.30+xpu whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$

simonlui commented 3 months ago

Your GPU isn't being detected, you should get a list of the devices on your system after the 2nd line. Here's my output for instance.

2.1.0.post2+cxx11.abi
2.1.30+xpu
[0]: _DeviceProperties(name='Intel(R) Arc(TM) A770 Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu', driver_version='1.3.29138', has_fp64=1, total_memory=16288MB, max_compute_units=512, gpu_eu_count=512)

You need to as I said in my first post, reinstall Intel's oneAPI basekit 2024.1 and unfortunately, there is no easy way of telling what version you have installed so I have no clue what is wrong on that front. If you have the correct version, the sanity test should show up correctly with the output I posted above.

Whackjob commented 3 months ago

I seem to have that.

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ sudo apt install intel-basekit Reading package lists... Done Building dependency tree... Done Reading state information... Done intel-basekit is already the newest version (2024.1.0-589). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

Now, I went through all the steps on that page, and I see this:

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ sudo apt update sudo apt install -y gpg-agent wget [sudo] password for whackjob:
Get:1 file:/usr/lib/expressvpn/repo_mirror.list Mirrorlist [117 B] Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease
Ign:5 http://packages.linuxmint.com virginia InRelease
Hit:6 https://apt.repos.intel.com/oneapi all InRelease
Hit:7 http://packages.linuxmint.com virginia Release
Get:2 https://repo.expressvpn.com/public/deb/debian any-version InRelease [4,580 B]
Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease Err:11 https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease 403 Forbidden [IP: 13.224.214.26 443] Hit:12 https://repositories.intel.com/graphics/ubuntu focal InRelease Reading package lists... Done E: Failed to fetch https://repositories.intel.com/gpu/ubuntu/dists//lts/2350/InRelease 403 Forbidden [IP: 13.224.214.26 443] E: The repository 'https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease' is not signed. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details. Reading package lists... Done Building dependency tree... Done Reading state information... Done wget is already the newest version (1.21.2-2ubuntu1). gpg-agent is already the newest version (2.2.27-3ubuntu2.1). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

Looking around, it seems I need to try from other places via VPN? I gave that a shot, no luck. In the end, when I go to install the basekit, it gives me that version, which is right, isn't it?

simonlui commented 3 months ago

Well for one, your GPG key isn't good for the Intel graphics APT repository. Can you redo the import?

wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \
    gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg

You do have the oneAPI repository properly installed so that shouldn't be the issue. I would think the graphics APT repository shouldn't be at fault but it could very well be given you have to install intel-opencl-icd, intel-level-zero-gpu, level-zero and level-zero-dev packages for IPEX to work properly.

Whackjob commented 3 months ago

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \ gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg File '/usr/share/keyrings/intel-graphics.gpg' exists. Overwrite? (y/N) y gpg: can't create '/usr/share/keyrings/intel-graphics.gpg': Permission denied gpg: no valid OpenPGP data found. gpg: dearmoring failed: Permission denied

I tell ya, I am cursed.

simonlui commented 3 months ago

You might have to run the gpg command as sudo. Try the following.

wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | \
    sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg
Whackjob commented 3 months ago

I appreciate all the help. No luck yet, it seems.

whackjob@WhackjobONE:~$ wget --progress=dot:giga -qO - https://repositories.intel.com/graphics/intel-graphics.key | sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg File '/usr/share/keyrings/intel-graphics.gpg' exists. Overwrite? (y/N) y whackjob@WhackjobONE:~$ sudo apt-get update Get:1 file:/usr/lib/expressvpn/repo_mirror.list Mirrorlist [117 B] Ign:3 http://packages.linuxmint.com virginia InRelease Hit:4 http://packages.linuxmint.com virginia Release Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:7 http://mirror.cogentco.com/pub/linux/ubuntu jammy InRelease
Hit:8 http://mirror.cogentco.com/pub/linux/ubuntu jammy-updates InRelease
Hit:9 http://mirror.cogentco.com/pub/linux/ubuntu jammy-backports InRelease
Hit:10 https://apt.repos.intel.com/oneapi all InRelease
Get:2 https://repo.expressvpn.com/public/deb/debian any-version InRelease [4,580 B]
Err:11 https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease
403 Forbidden [IP: 13.224.214.26 443] Hit:12 https://repositories.intel.com/graphics/ubuntu focal InRelease
Reading package lists... Done
E: Failed to fetch https://repositories.intel.com/gpu/ubuntu/dists//lts/2350/InRelease 403 Forbidden [IP: 13.224.214.26 443] E: The repository 'https://repositories.intel.com/gpu/ubuntu /lts/2350 InRelease' is not signed. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details.

What's weird is this is almost a fresh install of linux mint. Literally, a week or two.

simonlui commented 3 months ago

It shouldn't be forbidden but it could be from Intel's end. Not much you can do there. Do you have intel-opencl-icd, intel-level-zero-gpu, level-zero and level-zero-dev packages installed?

Whackjob commented 3 months ago

Yessir. All four.

whackjob@WhackjobONE:~$ sudo apt install intel-opencl-icd [sudo] password for whackjob:
Reading package lists... Done Building dependency tree... Done Reading state information... Done intel-opencl-icd is already the newest version (22.28.23726.1+i419~u20.04). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. whackjob@WhackjobONE:~$ sudo apt install intel-level-zero-gpu Reading package lists... Done Building dependency tree... Done Reading state information... Done intel-level-zero-gpu is already the newest version (1.3.23726.1+i419~u20.04). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. whackjob@WhackjobONE:~$ sudo apt install level-zero Reading package lists... Done Building dependency tree... Done Reading state information... Done level-zero is already the newest version (1.8.1+i755~u20.04). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. whackjob@WhackjobONE:~$ sudo apt install level-zero-dev Reading package lists... Done Building dependency tree... Done Reading state information... Done level-zero-dev is already the newest version (1.8.1+i755~u20.04). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

simonlui commented 3 months ago

Sorry, I should've asked earlier. What is the output if you run the following:

source /opt/intel/oneapi/setvars.sh
sycl-ls

You should see something like this, especially the ext_oneapi_level_zero line.

[opencl:cpu:0] Intel(R) OpenCL, AMD Ryzen 9 5950X 16-Core Processor             OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000]
[opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 9 5950X 16-Core Processor             OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000]
[opencl:gpu:2] Intel(R) OpenCL Graphics, Intel(R) Arc(TM) A770 Graphics OpenCL 3.0 NEO  [24.09.28717.17]
[ext_oneapi_level_zero:gpu:0] Intel(R) Level-Zero, Intel(R) Arc(TM) A770 Graphics 1.3 [1.3.28717]
Whackjob commented 3 months ago

Well, I certainly have a variance! [opencl:acc:0] Intel(R) FPGA Emulation Platform for OpenCL(TM), Intel(R) FPGA Emulation Device OpenCL 1.2 [2024.17.3.0.08_160000] [opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 5 3600 6-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000] [opencl:gpu:2] Intel(R) OpenCL HD Graphics, Intel(R) Graphics [0x56a0] OpenCL 3.0 NEO [22.28.23726.1]

simonlui commented 3 months ago

Okay, I think I know what is up. Can you install the latest release of intel-compute-runtime and then run the command again?

Whackjob commented 3 months ago

Gave it a shot. Seems I already have it.

whackjob@WhackjobONE:~$ sudo apt-get install intel-opencl-icd [sudo] password for whackjob:
Reading package lists... Done Building dependency tree... Done Reading state information... Done intel-opencl-icd is already the newest version (22.28.23726.1+i419~u20.04). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

simonlui commented 3 months ago

No like actually go to the link, download and install it. You have a slightly older version, the latest is 24.13.29138.7

Whackjob commented 3 months ago

Followed the link, made the directory, pulled 'em down, installed. It went through clean. Then gave it another shot. Same error, as follows. sycl-ls has different output now though.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in import comfy.utils File "/media/whackjob/16Tons/AI/ComfyUI/comfy/utils.py", line 1, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh sycl-ls

:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.

usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.

Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:

$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh

The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.

[opencl:acc:0] Intel(R) FPGA Emulation Platform for OpenCL(TM), Intel(R) FPGA Emulation Device OpenCL 1.2 [2024.17.3.0.08_160000] [opencl:cpu:1] Intel(R) OpenCL, AMD Ryzen 5 3600 6-Core Processor OpenCL 3.0 (Build 0) [2024.17.3.0.08_160000] [opencl:gpu:2] Intel(R) OpenCL Graphics, Intel(R) Arc(TM) A770 Graphics OpenCL 3.0 NEO [24.13.29138.7] [ext_oneapi_level_zero:gpu:0] Intel(R) Level-Zero, Intel(R) Arc(TM) A770 Graphics 1.3 [1.3.29138] (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$

simonlui commented 3 months ago

Yeah so it was the fault of the compute runtime being outdated. I think if you do the sanity test and ComfyUI again, it should work as intended. I do need to sleep now so I can't aid you any further today but I hope everything works.

Whackjob commented 3 months ago

Nah, I did give it a shot, still get the same iJIT_NotifyEvent. But we can call it a night. I do greatly appreciate the work you've put in and the time you've spent helping. If tomorrow night we can try a bit more, great, if not, it's all good.

simonlui commented 3 months ago

The suggestion from https://github.com/pytorch/pytorch/issues/123097 seems to suggest downgrading Intel's MKL but I want to know what versions of those packages you have. Can you execute the following and give me the output?

apt list --installed | grep -i intel-oneapi-mkl
Whackjob commented 3 months ago

Hey, sure thing. Thanks for taking another swing at this conundrum.

whackjob@WhackjobONE:~$ apt list --installed | grep -i intel-oneapi-mkl

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

intel-oneapi-mkl-classic-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-cluster-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-devel/all,now 2024.1.0-691 amd64 [installed] intel-oneapi-mkl-sycl-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-blas-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-data-fitting-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-sycl-dft-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-lapack-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-rng-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-sparse-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-stats-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-vm-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic]

simonlui commented 3 months ago

All the versions match the setup I have, but I am actually now curious, before we try and downgrade the MKL packages, can you give me the output of all the intel packages you have? The output might be too long so if you need to attach it as a text file, that would be fine.

apt list --installed | grep -i intel
Whackjob commented 3 months ago

whackjob@WhackjobONE:~$ apt list --installed | grep -i intel

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

intel-basekit-env-2024.1/all,now 2024.1.0-589 all [installed,automatic] intel-basekit-getting-started-2024.1/all,now 2024.1.0-589 all [installed,automatic] intel-basekit/all,now 2024.1.0-589 amd64 [installed] intel-igc-cm/unknown,now 1.0.224-821~22.04 amd64 [installed] intel-igc-core/now 1.0.16510.2 amd64 [installed,local] intel-igc-opencl/now 1.0.16510.2 amd64 [installed,local] intel-level-zero-gpu/now 1.3.29138.7 amd64 [installed,local] intel-media-va-driver-non-free/unknown,now 23.4.3-804~22.04 amd64 [installed] intel-microcode/jammy-updates,jammy-security,now 3.20231114.0ubuntu0.22.04.1 amd64 [installed] intel-oneapi-advisor/all,now 2024.1.0-499 amd64 [installed,automatic] intel-oneapi-ccl-2021.12/all,now 2021.12.0-309 amd64 [installed,automatic] intel-oneapi-ccl-devel-2021.12/all,now 2021.12.0-309 amd64 [installed,automatic] intel-oneapi-ccl-devel/all,now 2021.12.0-309 amd64 [installed] intel-oneapi-common-licensing-2024.1/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-licensing/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-oneapi-vars-2024.1/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-oneapi-vars/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-common-vars/all,now 2024.1.0-579 all [installed,automatic] intel-oneapi-compiler-cpp-eclipse-cfg-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-dpcpp-cpp-runtime-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-cpp/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-dpcpp-eclipse-cfg-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-shared-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-compiler-shared-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-compiler-shared-runtime-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-dal-2024.2/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dal-common-2024.2/all,now 2024.2.0-276 all [installed,automatic] intel-oneapi-dal-common-devel-2024.2/all,now 2024.2.0-276 all [installed,automatic] intel-oneapi-dal-devel-2024.2/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dal-devel/all,now 2024.2.0-276 amd64 [installed,automatic] intel-oneapi-dev-utilities-2024.1/all,now 2024.1.0-340 amd64 [installed,automatic] intel-oneapi-dev-utilities-eclipse-cfg-2024.1/all,now 2024.1.0-340 all [installed,automatic] intel-oneapi-dev-utilities/all,now 2024.1.0-340 amd64 [installed,automatic] intel-oneapi-diagnostics-utility-2024.1/all,now 2024.1.0-256 amd64 [installed,automatic] intel-oneapi-diagnostics-utility/all,now 2024.1.0-256 amd64 [installed,automatic] intel-oneapi-dnnl-2024.1/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl-devel-2024.1/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl-devel/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dnnl/all,now 2024.1.1-13 amd64 [installed,automatic] intel-oneapi-dpcpp-cpp-2024.1/all,now 2024.1.0-963 amd64 [installed] intel-oneapi-dpcpp-ct-2024.1/all,now 2024.1.0-374 amd64 [installed,automatic] intel-oneapi-dpcpp-ct-eclipse-cfg-2024.1/all,now 2024.1.0-374 all [installed,automatic] intel-oneapi-dpcpp-ct/all,now 2024.1.0-374 amd64 [installed,automatic] intel-oneapi-dpcpp-debugger-2024.1/all,now 2024.1.0-435 amd64 [installed,automatic] intel-oneapi-icc-eclipse-plugin-cpp-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-ipp-2021.11/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ipp-common-2021.11/all,now 2021.11.0-528 all [installed,automatic] intel-oneapi-ipp-common-devel-2021.11/all,now 2021.11.0-528 all [installed,automatic] intel-oneapi-ipp-devel-2021.11/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ipp-devel/all,now 2021.11.0-528 amd64 [installed,automatic] intel-oneapi-ippcp-2021.11/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-ippcp-common-2021.11/all,now 2021.11.0-33 all [installed,automatic] intel-oneapi-ippcp-common-devel-2021.11/all,now 2021.11.0-33 all [installed,automatic] intel-oneapi-ippcp-devel-2021.11/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-ippcp-devel/all,now 2021.11.0-33 amd64 [installed,automatic] intel-oneapi-libdpstd-devel-2022.5/all,now 2022.5.0-215 amd64 [installed,automatic] intel-oneapi-mkl-classic-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-classic-include-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-cluster-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-cluster-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-core-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-core-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-devel/all,now 2024.1.0-691 amd64 [installed] intel-oneapi-mkl-sycl-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-blas-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-data-fitting-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-devel-common-2024.1/all,now 2024.1.0-691 all [installed,automatic] intel-oneapi-mkl-sycl-dft-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-include-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-lapack-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-rng-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-sparse-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-stats-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mkl-sycl-vm-2024.1/all,now 2024.1.0-691 amd64 [installed,automatic] intel-oneapi-mpi-2021.12/all,now 2021.12.1-5 amd64 [installed,automatic] intel-oneapi-mpi-devel-2021.12/all,now 2021.12.1-5 amd64 [installed,automatic] intel-oneapi-openmp-2024.1/all,now 2024.1.0-963 amd64 [installed,automatic] intel-oneapi-openmp-common-2024.1/all,now 2024.1.0-963 all [installed,automatic] intel-oneapi-tbb-2021.12/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tbb-common-2021.12/all,now 2021.12.0-495 all [installed,automatic] intel-oneapi-tbb-common-devel-2021.12/all,now 2021.12.0-495 all [installed,automatic] intel-oneapi-tbb-devel-2021.12/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tbb-devel/all,now 2021.12.0-495 amd64 [installed,automatic] intel-oneapi-tcm-1.0/all,now 1.0.1-175 amd64 [installed,automatic] intel-oneapi-tlt-2024.1/all,now 2024.1.0-447 amd64 [installed,automatic] intel-oneapi-tlt/all,now 2024.1.0-447 amd64 [installed,automatic] intel-oneapi-vtune/all,now 2024.1.0-515 amd64 [installed,automatic] intel-opencl-icd/now 24.13.29138.7 amd64 [installed,local] libdrm-intel1/unknown,now 2.4.119-2101~22.04 amd64 [installed] libdrm-intel1/unknown,now 2.4.119-2101~22.04 i386 [installed,auto-removable] xserver-xorg-video-intel/jammy,now 2:2.99.917+git20210115-1 amd64 [installed]

simonlui commented 3 months ago

Sorry for the delay but I think I found the issue. You are missing the runtime for MKL SYCL. Can you do the following install command and then try again and see if you are still getting the iJIT_NotifyEvent undefined issue?

sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691
Whackjob commented 3 months ago

I think we've found the issue. Not quite sure how to fix this, though.

whackjob@WhackjobONE:~$ sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691 [sudo] password for whackjob:
Reading package lists... Done Building dependency tree... Done Reading state information... Done You might want to run 'apt --fix-broken install' to correct these. The following packages have unmet dependencies: intel-oneapi-runtime-mkl : Depends: intel-oneapi-runtime-mkl-2024 but it is not going to be installed libegl1 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed Breaks: libegl1:i386 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libegl1:i386 : Depends: libglvnd0:i386 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed Breaks: libegl1 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed libgl-dev : Depends: libgl1 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libgl1 : Depends: libglx0 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed Breaks: libgl1:i386 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed libgl1:i386 : Depends: libglx0:i386 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed Breaks: libgl1 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libgles1 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libgles2 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libglvnd-dev : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libglvnd0 : Breaks: libglvnd0:i386 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed libglvnd0:i386 : Breaks: libglvnd0 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libglx0 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed Breaks: libglx0:i386 (!= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed libglx0:i386 : Depends: libglvnd0:i386 (= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed Breaks: libglx0 (!= 1.4.0-1) but 1.7.0-2101~22.04 is to be installed libopengl0 : Depends: libglvnd0 (= 1.7.0-2101~22.04) but 1.4.0-1 is to be installed E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).

whackjob@WhackjobONE:~$ sudo apt --fix-broken install Reading package lists... Done Building dependency tree... Done Reading state information... Done Correcting dependencies... Done The following packages were automatically installed and are no longer required: libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386 Use 'sudo apt autoremove' to remove them. The following additional packages will be installed: libegl1:i386 libgl1 libglvnd0 libglx0:i386 The following packages will be upgraded: libegl1:i386 libgl1 libglvnd0 libglx0:i386 4 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 14 not fully installed or removed. Need to get 0 B/280 kB of archives. After this operation, 4,096 B of additional disk space will be used. Do you want to continue? [Y/n] y (Reading database ... 645058 files and directories currently installed.) Preparing to unpack .../libglx0_1.7.0-2101~22.04_i386.deb ... Unpacking libglx0:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libglx0_1.7.0-2101~22.04_i386.deb (--unpack): trying to overwrite shared '/usr/share/doc/libglx0/changelog.Debian.gz', which is different from other instances of package libglx0:i386 Preparing to unpack .../libgl1_1.7.0-2101~22.04_amd64.deb ... Unpacking libgl1:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libgl1_1.7.0-2101~22.04_amd64.deb (--unpack): trying to overwrite shared '/usr/share/doc/libgl1/changelog.Debian.gz', which is different from other instances of package libgl1:amd64 Preparing to unpack .../libegl1_1.7.0-2101~22.04_i386.deb ... Unpacking libegl1:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libegl1_1.7.0-2101~22.04_i386.deb (--unpack): trying to overwrite shared '/usr/share/doc/libegl1/changelog.Debian.gz', which is different from other instances of package libegl1:i386 Preparing to unpack .../libglvnd0_1.7.0-2101~22.04_amd64.deb ... Unpacking libglvnd0:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... dpkg: error processing archive /var/cache/apt/archives/libglvnd0_1.7.0-2101~22.04_amd64.deb (--unpack): trying to overwrite shared '/usr/share/doc/libglvnd0/changelog.Debian.gz', which is different from other instances of package libglvnd0:amd64 Errors were encountered while processing: /var/cache/apt/archives/libglx0_1.7.0-2101~22.04_i386.deb /var/cache/apt/archives/libgl1_1.7.0-2101~22.04_amd64.deb /var/cache/apt/archives/libegl1_1.7.0-2101~22.04_i386.deb /var/cache/apt/archives/libglvnd0_1.7.0-2101~22.04_amd64.deb E: Sub-process /usr/bin/dpkg returned an error code (1)

simonlui commented 3 months ago

You need to delete those files, I would presume, according to this Ubuntu forum post detailing the same issue. You can accomplish that with the following:

sudo rm '/usr/share/doc/libglx0/changelog.Debian.gz' '/usr/share/doc/libgl1/changelog.Debian.gz' '/usr/share/doc/libegl1/changelog.Debian.gz' '/usr/share/doc/libglvnd0/changelog.Debian.gz'

Do that and try repairing your install and installing the runtime.

Whackjob commented 3 months ago

whackjob@WhackjobONE:~$ sudo rm '/usr/share/doc/libglx0/changelog.Debian.gz' '/usr/share/doc/libgl1/changelog.Debian.gz' '/usr/share/doc/libegl1/changelog.Debian.gz' '/usr/share/doc/libglvnd0/changelog.Debian.gz' [sudo] password for whackjob:
whackjob@WhackjobONE:~$ sudo apt --fix-broken install Reading package lists... Done Building dependency tree... Done Reading state information... Done Correcting dependencies... Done The following packages were automatically installed and are no longer required: libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386 Use 'sudo apt autoremove' to remove them. The following additional packages will be installed: libegl1:i386 libgl1 libglvnd0 libglx0:i386 The following packages will be upgraded: libegl1:i386 libgl1 libglvnd0 libglx0:i386 4 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 14 not fully installed or removed. Need to get 0 B/280 kB of archives. After this operation, 4,096 B of additional disk space will be used. Do you want to continue? [Y/n] y (Reading database ... 645058 files and directories currently installed.) Preparing to unpack .../libglx0_1.7.0-2101~22.04_i386.deb ... Unpacking libglx0:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... Preparing to unpack .../libgl1_1.7.0-2101~22.04_amd64.deb ... Unpacking libgl1:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... Preparing to unpack .../libegl1_1.7.0-2101~22.04_i386.deb ... Unpacking libegl1:i386 (1.7.0-2101~22.04) over (1.4.0-1) ... Preparing to unpack .../libglvnd0_1.7.0-2101~22.04_amd64.deb ... Unpacking libglvnd0:amd64 (1.7.0-2101~22.04) over (1.4.0-1) ... Setting up libglvnd0:amd64 (1.7.0-2101~22.04) ... Setting up libglvnd0:i386 (1.7.0-2101~22.04) ... Setting up libopengl0:amd64 (1.7.0-2101~22.04) ... Setting up libgles2:amd64 (1.7.0-2101~22.04) ... Setting up libgles1:amd64 (1.7.0-2101~22.04) ... Setting up libegl1:amd64 (1.7.0-2101~22.04) ... Setting up libegl1:i386 (1.7.0-2101~22.04) ... Setting up libopengl-dev:amd64 (1.7.0-2101~22.04) ... Setting up libglx0:amd64 (1.7.0-2101~22.04) ... Setting up libglx0:i386 (1.7.0-2101~22.04) ... Setting up libgl1:amd64 (1.7.0-2101~22.04) ... Setting up libgl1:i386 (1.7.0-2101~22.04) ... Setting up libgl1-mesa-glx:i386 (24.1.0-devel.dg2-20240118-2102~22.04) ... Setting up libglx-dev:amd64 (1.7.0-2101~22.04) ... Setting up libgl-dev:amd64 (1.7.0-2101~22.04) ... Setting up libegl-dev:amd64 (1.7.0-2101~22.04) ... Setting up libgles-dev:amd64 (1.7.0-2101~22.04) ... Setting up libglvnd-dev:amd64 (1.7.0-2101~22.04) ... Processing triggers for libc-bin (2.35-0ubuntu3.7) ...

Whackjob commented 3 months ago

whackjob@WhackjobONE:~$ sudo apt install intel-oneapi-runtime-mkl=2024.1.0-691 Reading package lists... Done Building dependency tree... Done Reading state information... Done The following packages were automatically installed and are no longer required: libdrm-dev:i386 libdrm-intel1:i386 libpciaccess-dev:i386 libpciaccess0:i386 libpthread-stubs0-dev:i386 libx11-dev:i386 libxau-dev:i386 libxcb1-dev:i386 libxdmcp-dev:i386 Use 'sudo apt autoremove' to remove them. The following additional packages will be installed: intel-oneapi-runtime-compilers-2024 intel-oneapi-runtime-compilers-common-2024 intel-oneapi-runtime-dpcpp-cpp-2024 intel-oneapi-runtime-dpcpp-cpp-common-2024 intel-oneapi-runtime-dpcpp-sycl-core-2024 intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 intel-oneapi-runtime-dpcpp-sycl-rt-2024 intel-oneapi-runtime-mkl-2024 intel-oneapi-runtime-mkl-common-2024 intel-oneapi-runtime-opencl-2024 intel-oneapi-runtime-openmp-2024 intel-oneapi-runtime-openmp-opencl-shared-2024 intel-oneapi-runtime-tbb-2021 intel-oneapi-runtime-tbb-common-2021 intel-oneapi-runtime-tcm-1 The following NEW packages will be installed: intel-oneapi-runtime-compilers-2024 intel-oneapi-runtime-compilers-common-2024 intel-oneapi-runtime-dpcpp-cpp-2024 intel-oneapi-runtime-dpcpp-cpp-common-2024 intel-oneapi-runtime-dpcpp-sycl-core-2024 intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 intel-oneapi-runtime-dpcpp-sycl-rt-2024 intel-oneapi-runtime-mkl intel-oneapi-runtime-mkl-2024 intel-oneapi-runtime-mkl-common-2024 intel-oneapi-runtime-opencl-2024 intel-oneapi-runtime-openmp-2024 intel-oneapi-runtime-openmp-opencl-shared-2024 intel-oneapi-runtime-tbb-2021 intel-oneapi-runtime-tbb-common-2021 intel-oneapi-runtime-tcm-1 0 upgraded, 18 newly installed, 0 to remove and 1 not upgraded. Need to get 307 MB of archives. After this operation, 2,086 MB of additional disk space will be used. Do you want to continue? [Y/n] y Get:1 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-tcm-1 amd64 1.0.1-175 [1,168 kB] Get:2 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-openmp-opencl-shared-2024 amd64 2024.1.0-963 [3,954 kB] Get:3 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-openmp-2024 amd64 2024.1.0-963 [14.0 MB] Get:4 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-compilers-common-2024 all 2024.1.0-963 [10.3 kB] Get:5 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-compilers-2024 amd64 2024.1.0-963 [28.0 MB] Get:6 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-tbb-common-2021 all 2021.12.0-495 [7,288 B] Get:7 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-tbb-2021 amd64 2021.12.0-495 [969 kB] Get:8 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-cpp-common-2024 all 2024.1.0-963 [20.3 kB] Get:9 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 amd64 2024.1.0-963 [90.4 MB] Get:10 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-opencl-2024 amd64 2024.1.0-963 [49.7 kB] Get:11 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-core-2024 all 2024.1.0-963 [2,444 kB] Get:12 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 all 2024.1.0-963 [1,768 B] Get:13 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-rt-2024 all 2024.1.0-963 [1,760 B] Get:14 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 all 2024.1.0-963 [5,584 B] Get:15 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-dpcpp-cpp-2024 amd64 2024.1.0-963 [2,952 B] Get:16 https://apt.repos.intel.com/oneapi all/main all intel-oneapi-runtime-mkl-common-2024 all 2024.1.0-691 [22.9 kB] Get:17 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-mkl-2024 amd64 2024.1.0-691 [166 MB] Get:18 https://apt.repos.intel.com/oneapi all/main amd64 intel-oneapi-runtime-mkl amd64 2024.1.0-691 [1,732 B]
Fetched 307 MB in 7s (46.4 MB/s)
Selecting previously unselected package intel-oneapi-runtime-tcm-1. (Reading database ... 645058 files and directories currently installed.) Preparing to unpack .../00-intel-oneapi-runtime-tcm-1_1.0.1-175_amd64.deb ... Unpacking intel-oneapi-runtime-tcm-1 (1.0.1-175) ... Selecting previously unselected package intel-oneapi-runtime-openmp-opencl-shared-2024. Preparing to unpack .../01-intel-oneapi-runtime-openmp-opencl-shared-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-openmp-opencl-shared-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-openmp-2024. Preparing to unpack .../02-intel-oneapi-runtime-openmp-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-openmp-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-compilers-common-2024. Preparing to unpack .../03-intel-oneapi-runtime-compilers-common-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-compilers-common-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-compilers-2024. Preparing to unpack .../04-intel-oneapi-runtime-compilers-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-compilers-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-tbb-common-2021. Preparing to unpack .../05-intel-oneapi-runtime-tbb-common-2021_2021.12.0-495_all.deb ... Unpacking intel-oneapi-runtime-tbb-common-2021 (2021.12.0-495) ... Selecting previously unselected package intel-oneapi-runtime-tbb-2021. Preparing to unpack .../06-intel-oneapi-runtime-tbb-2021_2021.12.0-495_amd64.deb ... Unpacking intel-oneapi-runtime-tbb-2021 (2021.12.0-495) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-cpp-common-2024. Preparing to unpack .../07-intel-oneapi-runtime-dpcpp-cpp-common-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-dpcpp-cpp-common-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024. Preparing to unpack .../08-intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-opencl-2024. Preparing to unpack .../09-intel-oneapi-runtime-opencl-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-opencl-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-core-2024. Preparing to unpack .../10-intel-oneapi-runtime-dpcpp-sycl-core-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-dpcpp-sycl-core-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024. Preparing to unpack .../11-intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-rt-2024. Preparing to unpack .../12-intel-oneapi-runtime-dpcpp-sycl-rt-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-dpcpp-sycl-rt-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024. Preparing to unpack .../13-intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024_2024.1.0-963_all.deb ... Unpacking intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-dpcpp-cpp-2024. Preparing to unpack .../14-intel-oneapi-runtime-dpcpp-cpp-2024_2024.1.0-963_amd64.deb ... Unpacking intel-oneapi-runtime-dpcpp-cpp-2024 (2024.1.0-963) ... Selecting previously unselected package intel-oneapi-runtime-mkl-common-2024. Preparing to unpack .../15-intel-oneapi-runtime-mkl-common-2024_2024.1.0-691_all.deb ... Unpacking intel-oneapi-runtime-mkl-common-2024 (2024.1.0-691) ... Selecting previously unselected package intel-oneapi-runtime-mkl-2024. Preparing to unpack .../16-intel-oneapi-runtime-mkl-2024_2024.1.0-691_amd64.deb ... Unpacking intel-oneapi-runtime-mkl-2024 (2024.1.0-691) ... Selecting previously unselected package intel-oneapi-runtime-mkl. Preparing to unpack .../17-intel-oneapi-runtime-mkl_2024.1.0-691_amd64.deb ... Unpacking intel-oneapi-runtime-mkl (2024.1.0-691) ... Setting up intel-oneapi-runtime-tcm-1 (1.0.1-175) ... Setting up intel-oneapi-runtime-tbb-common-2021 (2021.12.0-495) ... Setting up intel-oneapi-runtime-tbb-2021 (2021.12.0-495) ... Setting up intel-oneapi-runtime-compilers-common-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-openmp-opencl-shared-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-dpcpp-sycl-opencl-cpu-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-dpcpp-cpp-common-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-mkl-common-2024 (2024.1.0-691) ... Setting up intel-oneapi-runtime-dpcpp-sycl-core-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-openmp-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-dpcpp-sycl-cpu-rt-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-compilers-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-dpcpp-sycl-rt-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-opencl-2024 (2024.1.0-963) ... update-alternatives: using /opt/intel/oneapi/redist/lib/libOpenCL.so to provide /usr/lib/x86_64-linux-gnu/libOpenCL.so (opencl-libOpenCL.so) in auto mode update-alternatives: using /opt/intel/oneapi/redist to provide /opt/intel/opencl (opencl-intel-runtime) in auto mode Setting up intel-oneapi-runtime-dpcpp-sycl-fpga-emul-2024 (2024.1.0-963) ... Setting up intel-oneapi-runtime-dpcpp-cpp-2024 (2024.1.0-963) ... update-alternatives: using /opt/intel/oneapi/redist/etc/Intel_FPGA_SSG_Emulator.icd to provide /etc/OpenCL/vendors/intel64-fpgaemu.icd (Intel_FPGA_SSG_Emulator.icd) in auto mode Setting up intel-oneapi-runtime-mkl-2024 (2024.1.0-691) ... Setting up intel-oneapi-runtime-mkl (2024.1.0-691) ... Processing triggers for libc-bin (2.35-0ubuntu3.7) ... whackjob@WhackjobONE:~$

Whackjob commented 3 months ago

All of that installed OK now. I'll give it another shot, now.

Whackjob commented 3 months ago

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source venv/bin/activate (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh

:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.

usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.

Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:

$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh

The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh --force

:: initializing oneAPI environment ... bash: BASH_VERSION = 5.1.16(1)-release args: Using "$@" for setvars.sh arguments: --force :: advisor -- latest :: ccl -- latest :: compiler -- latest :: dal -- latest :: debugger -- latest :: dev-utilities -- latest :: dnnl -- latest :: dpcpp-ct -- latest :: dpl -- latest :: ipp -- latest :: ippcp -- latest :: mkl -- latest :: mpi -- latest :: tbb -- latest :: vtune -- latest :: oneAPI environment initialized ::

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in import comfy.utils File "/media/whackjob/16Tons/AI/ComfyUI/comfy/utils.py", line 1, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$

Whackjob commented 3 months ago

TL;DR, it seems to have all installed OK, now. But the same bloody error!

simonlui commented 3 months ago

Can you rerun the sanity test from https://github.com/comfyanonymous/ComfyUI/issues/3513#issuecomment-2119565104?

Whackjob commented 3 months ago

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" 2.1.0.post2+cxx11.abi 2.1.30+xpu [0]: _DeviceProperties(name='Intel(R) Arc(TM) A770 Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu', driver_version='1.3.29138', has_fp64=0, total_memory=15473MB, max_compute_units=512, gpu_eu_count=512)

simonlui commented 3 months ago

Everything should be then working because the sanity test directly pulls from IPEX. Your IPEX is now using GPU so it's a matter of your version of ComfyUI not working. Are you using the latest? If so, can you try and run IPEX without any arguments? So just run python3 main.py

Whackjob commented 3 months ago

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/main.py", line 73, in import comfy.utils File "/media/whackjob/16Tons/AI/ComfyUI/comfy/utils.py", line 1, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

I notice I'm on Python 3.10 and not 3.11. Could that be a factor? Or at least, it's defaulting to that

simonlui commented 3 months ago

That only matters if you installed IPEX using the wrong packages for a different Python version but that should all work given the sanity check worked but if you can clarify, were you running the VENV when you ran the sanity check? It doesn't jive that the sanity test gives you the right versions with detecting IPEX but then ComfyUI doesn't run correctly with those versions detected correctly.

Whackjob commented 3 months ago

Yeah, deactivated the environment, fired it up again, sourced oneapi, then ran the sanity check. This is what I get:

whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source venv/bin/activate (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh

:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.

usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.

Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:

$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh

The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" Traceback (most recent call last): File "", line 1, in File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

simonlui commented 3 months ago

So you have the correct IPEX install outside of your VENV but not inside your VENV, which is what I am concluding. Can you source inside your VENV and reinstall IPEX and then test if it works? I believe you had other problems given you didn't get the correct output until very recently and you were missing the MKL packages but I think if you reinstall correctly, things should just work then.

Whackjob commented 3 months ago

I'll give it a shot in the morning, I think. I'm falling asleep at my desk. I should call it before I make some errors.

Thanks for the help, again. I feel like we're right on the cusp. I'll post tomorrow.

Whackjob commented 3 months ago

Who am I kidding, I won't sleep right. So I gave it a shot and just hoped I wouldn't fuck it up:

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30+xpu oneccl_bind_pt==2.1.300+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Looking in indexes: https://pypi.org/simple, https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Collecting torch==2.1.0.post2 Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./torch-2.1.0.post2%2Bcxx11.abi-cp310-cp310-linux_x86_64.whl (191.2 MB) Collecting torchvision==0.16.0.post2 Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./torchvision-0.16.0.post2%2Bcxx11.abi-cp310-cp310-linux_x86_64.whl (918 kB) Requirement already satisfied: torchaudio==2.1.0.post2 in ./venv/lib/python3.10/site-packages (2.1.0.post2+cxx11.abi) Collecting intel-extension-for-pytorch==2.1.30+xpu Using cached https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/./intel_extension_for_pytorch-2.1.30%2Bxpu-cp310-cp310-linux_x86_64.whl (587.3 MB) Requirement already satisfied: oneccl_bind_pt==2.1.300+xpu in ./venv/lib/python3.10/site-packages (2.1.300+xpu) Requirement already satisfied: jinja2 in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.1.3) Requirement already satisfied: typing-extensions in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (4.11.0) Requirement already satisfied: filelock in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.14.0) Requirement already satisfied: fsspec in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (2024.3.1) Requirement already satisfied: sympy in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (1.12) Requirement already satisfied: networkx in ./venv/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.3) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (10.3.0) Requirement already satisfied: numpy in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (1.26.4) Requirement already satisfied: requests in ./venv/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (2.31.0) Requirement already satisfied: packaging in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (24.0) Requirement already satisfied: psutil in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (5.9.8) Requirement already satisfied: pydantic in ./venv/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30+xpu) (2.7.1) Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2->torch==2.1.0.post2) (2.1.5) Requirement already satisfied: pydantic-core==2.18.2 in ./venv/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30+xpu) (2.18.2) Requirement already satisfied: annotated-types>=0.4.0 in ./venv/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30+xpu) (0.6.0) Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (3.7) Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (2.2.1) Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (3.3.2) Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests->torchvision==0.16.0.post2) (2024.2.2) Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.10/site-packages (from sympy->torch==2.1.0.post2) (1.3.0) Installing collected packages: torch, torchvision, intel-extension-for-pytorch Attempting uninstall: torch Found existing installation: torch 2.0.1a0+cxx11.abi Uninstalling torch-2.0.1a0+cxx11.abi: Successfully uninstalled torch-2.0.1a0+cxx11.abi Attempting uninstall: torchvision Found existing installation: torchvision 0.15.2a0+cxx11.abi Uninstalling torchvision-0.15.2a0+cxx11.abi: Successfully uninstalled torchvision-0.15.2a0+cxx11.abi Attempting uninstall: intel-extension-for-pytorch Found existing installation: intel-extension-for-pytorch 2.0.120+xpu Uninstalling intel-extension-for-pytorch-2.0.120+xpu: Successfully uninstalled intel-extension-for-pytorch-2.0.120+xpu Successfully installed intel-extension-for-pytorch-2.1.30+xpu torch-2.1.0.post2+cxx11.abi torchvision-0.16.0.post2+cxx11.abi (venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ source /opt/intel/oneapi/setvars.sh

:: WARNING: setvars.sh has already been run. Skipping re-execution. To force a re-execution of setvars.sh, use the '--force' option. Using '--force' can result in excessive use of your environment variables.

usage: source setvars.sh [--force] [--config=file] [--help] [...] --force Force setvars.sh to re-run, doing so may overload environment. --config=file Customize env vars using a setvars.sh configuration file. --help Display this help message and exit. ... Additional args are passed to individual env/vars.sh scripts and should follow this script's arguments.

Some POSIX shells do not accept command-line options. In that case, you can pass command-line options via the SETVARS_ARGS environment variable. For example:

$ SETVARS_ARGS="ia32 --config=config.txt" ; export SETVARS_ARGS $ . path/to/setvars.sh

The SETVARS_ARGS environment variable is cleared on exiting setvars.sh.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ python3 main.py Total VRAM 15474 MB, total RAM 128711 MB Set vram state to: NORMAL_VRAM Device: xpu VAE dtype: torch.bfloat16 Using pytorch cross attention ** User settings have been changed to be stored on the server instead of browser storage. ** ** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. **

Import times for custom nodes: 0.0 seconds: /media/whackjob/16Tons/AI/ComfyUI/custom_nodes/websocket_image_save.py

Starting server

To see the GUI go to: http://127.0.0.1:8188

Whackjob commented 3 months ago

Brother, you taught me a lot today. How to troubleshoot this and such. Let me know how I can send you a few bucks for your trouble. You spent a lot of time on this, and I appreciate it.

simonlui commented 3 months ago

I'm fine, just hope you can pass it on and help someone else whether regarding this or something else. Please close the issue when you are able to.

Some extra small nuggets of info.

Whackjob commented 3 months ago

I'm using the A770 16GB. Not the greatest, but it's not bad, either. I've been staring down that ATI Radeon with what was it, 42GB of RAM? I remember zLUDA was continued for AMD stuff. A shame they didn't keep it up for intel's stuff! At least, nobody took that torch up yet.

KiwiHana commented 1 month ago

It's probably something stupid and easy to fix, but I've had zero success googling and troubleshooting this error myself. I'm just at a loss. I've tried to redo this several times without luck.

(venv) whackjob@WhackjobONE:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in from intel_extension_for_pytorch.launcher import main File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/init.py", line 3, in import torch File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/init.py", line 229, in from torch._C import * # noqa: F403 ImportError: /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

The reason is that Oneapi don't match ipex version. If you have installed OneAPI 2024.2, you can execute

python -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30.post0 oneccl_bind_pt==2.1.300+xpu --extra-index-url 
https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
Whackjob commented 1 month ago

Good morning!

This is what I get, now.

(venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in

from intel_extension_for_pytorch.launcher import main File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/__init__.py", line 95, in from .utils._proxy_module import * File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/utils/_proxy_module.py", line 2, in import intel_extension_for_pytorch._C ImportError: /opt/intel/oneapi/mkl/2024.2/lib/libmkl_sycl_data_fitting.so.4: undefined symbol: _ZN4sycl3_V17handler22setKernelIsCooperativeEb If I try your command, I get this: ***@***.***:/media/whackjob/16Tons/AI/ComfyUI$ python3 -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30.post0 oneccl_bind_pt==2.1.300+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Defaulting to user installation because normal site-packages is not writeable Looking in indexes: https://pypi.org/simple, https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ Requirement already satisfied: torch==2.1.0.post2 in /home/whackjob/.local/lib/python3.10/site-packages (2.1.0.post2+cxx11.abi) Requirement already satisfied: torchvision==0.16.0.post2 in /home/whackjob/.local/lib/python3.10/site-packages (0.16.0.post2+cxx11.abi) Requirement already satisfied: torchaudio==2.1.0.post2 in /home/whackjob/.local/lib/python3.10/site-packages (2.1.0.post2+cxx11.abi) Requirement already satisfied: intel-extension-for-pytorch==2.1.30.post0 in /home/whackjob/.local/lib/python3.10/site-packages (2.1.30.post0) Requirement already satisfied: oneccl_bind_pt==2.1.300+xpu in /home/whackjob/.local/lib/python3.10/site-packages (2.1.300+xpu) Requirement already satisfied: jinja2 in /home/whackjob/.local/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.1.3) Requirement already satisfied: fsspec in /home/whackjob/.local/lib/python3.10/site-packages (from torch==2.1.0.post2) (2024.6.1) Requirement already satisfied: sympy in /home/whackjob/.local/lib/python3.10/site-packages (from torch==2.1.0.post2) (1.12) Requirement already satisfied: typing-extensions in /home/whackjob/.local/lib/python3.10/site-packages (from torch==2.1.0.post2) (4.12.2) Requirement already satisfied: filelock in /usr/lib/python3/dist-packages (from torch==2.1.0.post2) (3.6.0) Requirement already satisfied: networkx in /home/whackjob/.local/lib/python3.10/site-packages (from torch==2.1.0.post2) (3.3) Requirement already satisfied: numpy in /home/whackjob/.local/lib/python3.10/site-packages (from torchvision==0.16.0.post2) (1.26.4) Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from torchvision==0.16.0.post2) (2.25.1) Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /usr/lib/python3/dist-packages (from torchvision==0.16.0.post2) (9.0.1) Requirement already satisfied: packaging in /usr/lib/python3/dist-packages (from intel-extension-for-pytorch==2.1.30.post0) (21.3) Requirement already satisfied: psutil in /usr/lib/python3/dist-packages (from intel-extension-for-pytorch==2.1.30.post0) (5.9.0) Requirement already satisfied: pydantic in /home/whackjob/.local/lib/python3.10/site-packages (from intel-extension-for-pytorch==2.1.30.post0) (2.7.1) Requirement already satisfied: MarkupSafe>=2.0 in /usr/lib/python3/dist-packages (from jinja2->torch==2.1.0.post2) (2.0.1) Requirement already satisfied: pydantic-core==2.18.2 in /home/whackjob/.local/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30.post0) (2.18.2) Requirement already satisfied: annotated-types>=0.4.0 in /home/whackjob/.local/lib/python3.10/site-packages (from pydantic->intel-extension-for-pytorch==2.1.30.post0) (0.6.0) Requirement already satisfied: mpmath>=0.19 in /home/whackjob/.local/lib/python3.10/site-packages (from sympy->torch==2.1.0.post2) (1.3.0) On Thu, Jul 18, 2024 at 11:13 PM KiwiHana ***@***.***> wrote: > It's probably something stupid and easy to fix, but I've had zero success > googling and troubleshooting this error myself. I'm just at a loss. I've > tried to redo this several times without luck. > > (venv) ***@***.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun > main.py --use-pytorch-cross-attention --highvram Traceback (most recent > call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line > 5, in from intel_extension_for_pytorch.launcher import main File > "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/ > *init*.py", line 3, in import torch File > "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/ > *init*.py", line 229, in from torch._C import * # noqa: F403 ImportError: > /media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/torch/lib/libtorch_cpu.so: > undefined symbol: iJIT_NotifyEvent > > The reason is that Oneapi and ipex version don't match. > If you have installed OneAPI 2024.2, you can execute > > python -m pip install torch==2.1.0.post2 torchvision==0.16.0.post2 torchaudio==2.1.0.post2 intel-extension-for-pytorch==2.1.30.post0 oneccl_bind_pt==2.1.300+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ > > — > Reply to this email directly, view it on GitHub > , > or unsubscribe > > . > You are receiving this because you modified the open/close state.Message > ID: ***@***.***> >
KiwiHana commented 1 month ago

@Whackjob Hi, please install intel oneapi base toolkit 2024.2 : https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit-download.html Then on Linux: $ source /opt/intel/oneapi/setvars.sh (venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram

Whackjob commented 1 month ago

Interestingly, it acted as though the intel base toolkit wasn't installed. I went through all the instructions, did the "source venv/bin/activate" and "source /opt/intel/oneapi/setvars.sh" and then finally "ipexrun main.py --use-pytorch-cross-attention --highvram"

This is what happens, now:

(venv) @.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun main.py --use-pytorch-cross-attention --highvram Traceback (most recent call last): File "/media/whackjob/16Tons/AI/ComfyUI/venv/bin/ipexrun", line 5, in

from intel_extension_for_pytorch.launcher import main File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/__init__.py", line 95, in from .utils._proxy_module import * File "/media/whackjob/16Tons/AI/ComfyUI/venv/lib/python3.10/site-packages/intel_extension_for_pytorch/utils/_proxy_module.py", line 2, in import intel_extension_for_pytorch._C ImportError: /opt/intel/oneapi/mkl/2024.2/lib/libmkl_sycl_data_fitting.so.4: undefined symbol: _ZN4sycl3_V17handler22setKernelIsCooperativeEb main.py: command not found On Sun, Jul 21, 2024 at 9:14 PM KiwiHana ***@***.***> wrote: > @Whackjob Hi, please install intel oneapi > base toolkit 2024.2 : > https://www.intel.com/content/www/us/en/developer/tools/oneapi/base-toolkit-download.html > Then on Linux: > $ source /opt/intel/oneapi/setvars.sh > (venv) *@*.***:/media/whackjob/16Tons/AI/ComfyUI$ ipexrun > main.py --use-pytorch-cross-attention --highvram > > — > Reply to this email directly, view it on GitHub > , > or unsubscribe > > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >