Question: GPU support - Githubissues

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

https://docs.rs/llm/latest/llm/

Apache License 2.0

6.06k stars 350 forks source link

Open toastxc opened 2 months ago

toastxc commented 2 months ago

Does llm have CUDA support, if so are there any examples of getting it working?