search

turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs
MIT License
3.19k stars 234 forks source link

custom bos for cat #436

Closed Kerushii closed 1 month ago

Anthonyg5005 commented 1 month ago

cat