search

marcom / Llama.jl

Julia interface to llama.cpp, a C/C++ library for running language models
MIT License
25 stars 2 forks source link

Regenerate bindings for llama_cpp_jll v0.0.15 #3

Closed marcom closed 9 months ago

marcom commented 9 months ago

Unfortunately this doesn't work yet, there is a missing definition for GGML_TENSOR_LOCALS.

Will try to fix this tomorrow.

svilupp commented 9 months ago

Not sure if it’s relevant, but please note that the constants have evolved quite a bit since 0.12 jll. Eg, they have introduced SOTa 2bit types a few days ago, etc.