search

dezoito / ollama-grid-search

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
MIT License
511 stars 31 forks source link

error:llama runner process no longer running: 1 error:failed to create context with model #17

Closed niyaz006 closed 7 months ago

niyaz006 commented 7 months ago

Facing the below error after I install and try for the first time. Are there are any other pre-requisites?

Windows Models: Mixtral and Openhermes

String error: An error occurred with ollama-rs: {"error":"llama runner process no longer running: 1 error:failed to create context with model 'C:\\Users\\<Username>\\.ollama\\models\\blobs\\sha256-671d85d606174999e3a99eb20534a120d0564ad2db3c38f04b7932beb021a687'"}

dezoito commented 7 months ago

According to the error message, it seems that Ollama was not properly running on your machine.

niyaz006 commented 7 months ago

Ollama works fine on PowerShell. And also through Python code in VSCode

dezoito commented 7 months ago

Was there any change to the server URL config? Does it match the one you have working with Python?

niyaz006 commented 7 months ago

I tried the url in browser and it says ollama is running.

Yes, my code in python still works

dezoito commented 7 months ago

I've searched on the Ollama repository and it seems that it is having issues with Windows (hopefully solved in the next release).

Please see:

https://github.com/ollama/ollama/issues/3774

https://github.com/ollama/ollama/pull/3850