Closed keshavjha1 closed 1 year ago
What are your machines' specs?
Also this might be an error caused by wrongly specified paths. It tries to run a directory.
Might be fixed with new PRs. #72. Testing it now.
Same issue as #71 , should be fixed in #72 . Pull master and retry
Has this been resolved?
I am facing below problem while running startLLM on Linux/Mac machine
(.venv) ke2@t2:~/projects/CASALIOY$ python3 casalioy/startLLM.py found local model at models/sentence-transformers/all-MiniLM-L6-v2 found local model at models/eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin llama.cpp: loading model from models/eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin terminate called after throwing an instance of 'std::runtime_error' what(): read error: Is a directory Aborted (core dumped)