Open grandxin opened 2 months ago
Sorry that we haven't tried Pyinstaller on XPU yet. Will notify you if we have verified this.
I encounter the same issue with pyinstaller compiled executable. The program exited within AutoModelForCausalLM without any error. I can observed that the progress bar of loading the weight is complete.
self.model = AutoModelForCausalLM.from_pretrained(
model_path, trust_remote_code=True
).to(self.device)
There is also this error when launching the intel_extension_for_pytorch
.
intel_extension_for_pytorch\xpu\lazy_init.py
when loading extension _C._initExtension()
is causing the following error. _C
is _C.cp310-win_amd64.pyd
intel_extension_for_pytorch\xpu\lazy_init.py:80: UserWarning: XPU Device count is zero! (Triggered internally at C:/Users/arc/ruijie/2.1_RC3/python310/frameworks.ai.pytorch.ipex-gpu/csrc/gpu/runtime/Device.cpp:127.)
_C._initExtension()
Can be found at https://github.com/intel/intel-extension-for-pytorch/issues/674#issuecomment-2228114289
when I use Pyinstaller to package and run the Python demo code, The .exe process exit when
model = model.to('xpu')
There is no problem running the demo directly using Python.
anyone know how to do?