mdrokz / rust-llama.cpp

LLama.cpp rust bindings

https://crates.io/crates/llama_cpp_rs/

MIT License

322 stars 44 forks source link

Transform project as library for publishing to crates.io #3

Closed mdrokz closed 1 year ago

mdrokz commented 1 year ago

Changes

convert the project to a library
add crates.io properties to Cargo.toml for publishing
add LICENSE & README files
add lazy_static for maintaining a global map of callbacks
change callback type in PredictOptions struct
implement rest of the methods to get embeddings from the model
change build system to include os specific flags