search

LLukas22 / llm-rs-python

Unofficial python bindings for the rust llm library. 🐍❤️🦀
MIT License
71 stars 4 forks source link

Cublas/CLBlast/Metal Support #24

Closed LLukas22 closed 1 year ago

LLukas22 commented 1 year ago

Closes https://github.com/LLukas22/llm-rs-python/issues/19

Add GPU acceleration for LLama based architectures and CI for precompiled wheels