mdrokz / rust-llama.cpp

LLama.cpp rust bindings
https://crates.io/crates/llama_cpp_rs/
MIT License
322 stars 44 forks source link

Multithreading support #21

Closed markcda closed 11 months ago

markcda commented 11 months ago

Added support for multi-threaded running, and fixed the problem with double-freeing memory for the data structure of model parameters.