search

marcom / Llama.jl

Julia interface to llama.cpp, a C/C++ library for running language models
MIT License
25 stars 2 forks source link

download_model not defined error #13

Closed bjenkinsgit closed 4 months ago

bjenkinsgit commented 4 months ago

trying to follow the instructions. Get stopped at the point of "download_model". Julia says it is not defined.

marcom commented 4 months ago

You have to load the Llama.jl library first with:

using Llama
url = "https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-dpo-GGUF/resolve/main/dolphin-2.6-mistral-7b-dpo.Q4_K_M.gguf"
model = download_model(url)
marcom commented 4 months ago

@bjenkinsgit Let me know if it works for you now