Run Llama 2 on your own Mac using LLM and Homebrew - Issues Following Blog Post

simonw / llm-llama-cpp

LLM plugin for running models using llama.cpp

Apache License 2.0

136 stars 19 forks source link

Run Llama 2 on your own Mac using LLM and Homebrew - Issues Following Blog Post #23

Open Olshansk opened 10 months ago

Olshansk commented 10 months ago

I was following the instructions from this post and am unsure why the llama2-13b-chat model isn't working.

I downloaded it succesfully.
The alias exists
The file existsa

It fails via both the CLI and python interface. Would appreciate any guidance on direction!

Screenshot 2023-11-05 at 3 34 34 PM

knowtheory commented 9 months ago

Hey @Olshansk, the instructions in the blogpost don't work for me either. However, if you follow the instructions in the llm repository, they work fine.

@simonw you might wanna stick a note on the top of the post!