Merge dev branch - Githubissues

turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

MIT License

3.53k stars 272 forks source link

Closed turboderp closed 5 months ago