Closed bjenkinsgit closed 4 months ago
You have to load the Llama.jl library first with:
using Llama
url = "https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-dpo-GGUF/resolve/main/dolphin-2.6-mistral-7b-dpo.Q4_K_M.gguf"
model = download_model(url)
@bjenkinsgit Let me know if it works for you now
trying to follow the instructions. Get stopped at the point of "download_model". Julia says it is not defined.