sample hangs, NPU 0%, GPU 100%

microsoft / Phi3-Chat-WinUI3-Sample

MIT License

26 stars 6 forks source link

sample hangs, NPU 0%, GPU 100% #3

Open IntranetFactory opened 3 weeks ago

IntranetFactory commented 3 weeks ago

Running this on a new Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Oryon(TM) CPU, 4012 Mhz, 12 Core(s), 12 Logical Processor(s)

Form shows, I tried several inputs - but always same result, progress bar shows forever: NPU 0%, GPU 100%

expected: get an answer or error, see NPU usage

should that sample work on a Copilot+ laptop?

MaxAkbar commented 2 weeks ago

I got the same but debugging it I found I had to put the model in the bin\x64\Debug\net6.0-windows10.0.19041.0\AppX\phi3\. Once I got this setup had to set the developer mode on. After that the app launched and got it to work. There is a hard coded 1024 max token limit which means you will have another hang when your tokens reach above that limit.