mdrokz / rust-llama.cpp

LLama.cpp rust bindings

https://crates.io/crates/llama_cpp_rs/

MIT License

290 stars 42 forks source link

Implement blas support #7

Closed mdrokz closed 10 months ago

mdrokz commented 10 months ago

Changes

support opencl,openBLAS,blis & cuda through feature flags
rework the build system and make it cleaner
add proper examples with dockerfile & documentation for running the examples
update task list in readme
bump cargo to new version