Open Fluxkom opened 1 year ago
Same error after using updated API and latest code.
I have the same problem, I use the M1 chip
Im facing the same issue..the exact error cant be understood
Same problem here.
Anyone have been able to work this out? Thanks!
Same here with same M1 setup
Same issue here with M1 setup
Enter a query: Tell me about Orcas ggml_metal_graph_compute: command buffer 0 failed with status 5 GGML_ASSERT: /private/var/folders/qs/yhqls5xn3c3fdg5tl00tzfnm0000gn/T/pip-install-ulcd5sl7/llama-cpp-python_3c33c62f26e243acb2c2fa6c61e5606d/vendor/llama.cpp/ggml-metal.m:1185: false zsh: abort python run_localGPT.py --device_type mps stefan@MBFVFFG677Q05G localGPT % /Users/stefan/.pyenv/versions/3.10.13/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d '
It seems to try to run the gguf model with ggml settings