search

microsoft / Phi3-Chat-WinUI3-Sample

MIT License
31 stars 7 forks source link

Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: The driver's state is probably suspect #2

Closed s7023369667 closed 2 months ago

s7023369667 commented 2 months ago

Hi, I try to run the sample of this. I believe that the "dml" in provider_options would use the GPU to compute. However, I get this error while entry the prompt: Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: 887A0020 An internal issue prevented the driver from carrying out the specified operation. The driver's state is probably suspect

By the way, I have testified that without the "dml" in provider_options, everything work fine and super slow.

Other question: How do I choose to run the computation on my NPU?

Environment: Windows 11 Pro 24H2 CPU: Snapdragon(R) X Elite - X1E78100 - Qualcomm(R) Oryon(TM) CPU 3.42 GHz GPU: Snapdragon(R) X Elite - X1E78100 - Qualcomm(R) Adreno(TM) GPU NPU: Snapdragon(R) X Elite - X1E78100 - Qualcomm(R) Hexagon(TM) NPU

I am wondering that the model of phi-3 is currently not support for Qualcomm GPU and NPU  Thanks for any help! :D

azchohfi commented 2 months ago

I don't believe NPU is supported just yet. I would suggest asking this question at the OnnxRuntimeGenAI repo: https://github.com/microsoft/onnxruntime-genai