ludvigpujsek
commented
2 weeks ago I am encountering the same issue trying to run llava through ollama. I'd like to add that deleting the TEMP_MEI[...]-directory in appdata (and then overwriting the executable with a new one, just in case) for some reason doesn't fix the issue. I've looked througth %appdata%/Local, LocalLow and Roaming, and none of them seem to contain any trace that some sort of persistent configuration might have been left by the program.
Hammad-Mir
AmberSahdev
I attempted to set up using a local LLM in WSL using Ollama. After entering the configuration details for the local model and restarting the app, I encountered the following error. Now, the app won’t open, and I’m unable to make any further changes.
Traceback (most recent call last): File "app\app.py", line 74, in
File "app\app.py", line 39, in init
File "C:\Users\hamma\AppData\Local\Temp_MEI1082882\core.py", line 22, in init
self.llm = LLM()
^^^^^
File "C:\Users\hamma\AppData\Local\Temp_MEI1082882\llm.py", line 59, in init
self.model = ModelFactory.create_model(self.model_name, base_url, api_key, context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hamma\AppData\Local\Temp_MEI1082882\models\factory.py", line 13, in create_model
raise ValueError(f'Unsupported model type {model_name}. Create entry in app/models/')
ValueError: Unsupported model type llama3.1. Create entry in app/models/