search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.46k stars 1.37k forks source link

Still experiencing the "Nitro exited with code: 3221225781" problem [Win 11] #2624

Closed essenciary closed 7 months ago

essenciary commented 7 months ago

Describe the bug Jan will not run any model. Log shows: 

2024-04-05T07:02:57.108Z [SPECS]::Version: 0.4.10
2024-04-05T07:02:57.109Z [SPECS]::CPUs: [{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":26453,"nice":0,"sys":71750,"idle":5837593,"irq":3031}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":12203,"nice":0,"sys":40078,"idle":5883125,"irq":3109}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":41734,"nice":0,"sys":78562,"idle":5815109,"irq":4609}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":11328,"nice":0,"sys":25265,"idle":5898781,"irq":1328}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":169109,"nice":0,"sys":653593,"idle":5112671,"irq":12046}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":69421,"nice":0,"sys":252125,"idle":5613859,"irq":6796}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":190609,"nice":0,"sys":667015,"idle":5077750,"irq":15718}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":59828,"nice":0,"sys":192281,"idle":5683234,"irq":3484}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":40500,"nice":0,"sys":61156,"idle":5833687,"irq":2062}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":14156,"nice":0,"sys":23015,"idle":5898203,"irq":765}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":41421,"nice":0,"sys":60406,"idle":5833546,"irq":2265}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":15671,"nice":0,"sys":20812,"idle":5898859,"irq":468}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":89078,"nice":0,"sys":46156,"idle":5800125,"irq":1796}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":64312,"nice":0,"sys":40546,"idle":5830484,"irq":1125}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":47812,"nice":0,"sys":29609,"idle":5857921,"irq":828}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":37156,"nice":0,"sys":25609,"idle":5872578,"irq":687}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":87578,"nice":0,"sys":55328,"idle":5792421,"irq":1718}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":54890,"nice":0,"sys":31843,"idle":5848609,"irq":796}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":35578,"nice":0,"sys":24125,"idle":5875625,"irq":781}},{"model":"12th Gen Intel(R) Core(TM) i9-12900H","speed":2918,"times":{"user":45343,"nice":0,"sys":26421,"idle":5863562,"irq":390}}]
2024-04-05T07:02:57.109Z [SPECS]::Machine: x86_64
2024-04-05T07:02:57.110Z [SPECS]::Parallelism: 20
2024-04-05T07:02:57.110Z [SPECS]::Total Mem: 16857108480
2024-04-05T07:02:57.110Z [SPECS]::Endianness: LE
2024-04-05T07:02:57.111Z [SPECS]::OS Version: Windows 10 Home
2024-04-05T07:02:57.111Z [SPECS]::OS Platform: win32
2024-04-05T07:02:57.110Z [SPECS]::Free Mem: 7441989632
2024-04-05T07:02:57.111Z [SPECS]::OS Release: 10.0.22631
2024-04-05T07:02:59.687Z [SPECS]::0, 4096, NVIDIA GeForce RTX 3050 Ti Laptop GPU

2024-04-05T07:03:57.771Z [NITRO]::CPU informations - 15
2024-04-05T07:03:57.772Z [NITRO]::Debug: Request to kill Nitro
2024-04-05T07:03:57.791Z [NITRO]::Debug: Nitro process is terminated
2024-04-05T07:03:58.297Z [NITRO]::Debug: Spawning Nitro subprocess...
2024-04-05T07:03:58.297Z [NITRO]::Debug: Spawn nitro at path: D:\.stuff\Jan\extensions\@janhq\inference-nitro-extension\dist\bin\win-cuda-12-0\nitro.exe, and args: 1,127.0.0.1,3928
2024-04-05T07:03:58.541Z [NITRO]::Debug: Nitro exited with code: 3221225781
2024-04-05T07:03:58.542Z [NITRO]::Error: child process exited with code 3221225781

Steps to reproduce Install any model and try to chat with it. Jan displays an error that model can't be loaded.

Expected behavior For the model to be loaded and chat to work.

Screenshots If applicable, add screenshots to help explain your issue.

Environment details

Logs If the cause of the error is not clear, kindly provide your usage logs:

Additional context Add any other context or information that could be helpful in diagnosing the problem.

essenciary commented 7 months ago

Figured it out - one of the CUDA dlls was missing so I had to do a full (re)install of CUDA.