search

turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs
MIT License
3.28k stars 243 forks source link

Added DeepSeek Coder Instruct to chat example #192

Closed SinanAkkoyun closed 7 months ago

SinanAkkoyun commented 7 months ago

Added DeepSeek Coder Instruct prompt format