mdrokz / rust-llama.cpp

LLama.cpp rust bindings

https://crates.io/crates/llama_cpp_rs/

MIT License

290 stars 42 forks source link

Implement options mod #1

Closed mdrokz closed 1 year ago

mdrokz commented 1 year ago

Changes

create new mod for containing options for the model
implement options struct based on this https://github.com/go-skynet/go-llama.cpp/blob/master/options.go