turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs
MIT License
3.28k stars 243 forks source link

Fix encoder in MMLU benchmark #231

Closed dvdtoth closed 7 months ago

dvdtoth commented 7 months ago

Fix encoder in MMLU benchmark