search

go-skynet / go-llama.cpp

LLama.cpp golang bindings
MIT License
679 stars 83 forks source link

Add rope setting, use float32, workaround CUDA compat issues #153

Closed mudler closed 1 year ago

mudler commented 1 year ago

See: https://github.com/go-skynet/LocalAI/issues/812