search

simonw / llm-replicate

LLM plugin for models hosted on Replicate
Apache License 2.0
59 stars 6 forks source link

"llama_cpp not installed" even after I install it #21

Closed zeke closed 5 months ago

zeke commented 9 months ago

Maybe llm and pip are not installing stuff in the same environment? 🤔 

$ llm --version               
llama_cpp not installed, install with: pip install llama-cpp-python
llm, version 0.12

~/git/zeke/dotfiles main*
$ pip install llama-cpp-python

Requirement already satisfied: llama-cpp-python in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (0.2.20)
Requirement already satisfied: typing-extensions>=4.5.0 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (4.8.0)
Requirement already satisfied: numpy>=1.20.0 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (1.26.1)
Requirement already satisfied: diskcache>=5.6.1 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (5.6.3)

~/git/zeke/dotfiles main*
$ llm --version               
llama_cpp not installed, install with: pip install llama-cpp-python
llm, version 0.12

cc @simonw

zeke commented 8 months ago

Just tried again but still seeing this error.

$ brew upgrade llm
Warning: llm 0.12 already installed

$ llm --version   
llama_cpp not installed, install with: pip install llama-cpp-python
llm, version 0.12

$ which llm
/opt/homebrew/bin/llm

$ pip install llama-cpp-python 
Requirement already satisfied: llama-cpp-python in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (0.2.20)
Requirement already satisfied: typing-extensions>=4.5.0 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (4.8.0)
Requirement already satisfied: numpy>=1.20.0 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (1.26.1)
Requirement already satisfied: diskcache>=5.6.1 in /Users/z/.pyenv/versions/3.10.4/envs/python-3.10.4/lib/python3.10/site-packages (from llama-cpp-python) (5.6.3)
zeke commented 5 months ago

This is working for me now.

$ llm --version
llm, version 0.13.1