search

sobelio / llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
https://llm-chain.xyz
MIT License
1.3k stars 128 forks source link

feat: enable GPU acceleration through CUDA using cuBLAS #162

Closed troyedwardsjr closed 1 year ago

troyedwardsjr commented 1 year ago

https://github.com/ggerganov/llama.cpp#cublas

Gated by Rust feature.

Juzov commented 1 year ago

Can you please check the error

troyedwardsjr commented 1 year ago

Can you please check the error

@Juzov Whoops! Should be good now.

troyedwardsjr commented 1 year ago 
$ cargo build --example stream
    Finished dev [unoptimized + debuginfo] target(s) in 0.09s
Juzov commented 1 year ago

Format the code and we should be golden :)

troyedwardsjr commented 1 year ago

Format the code and we should be golden :)

@Juzov Done. :)