Add: DeepseekCoder v2 chat format

Maximilian-Winter / llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

Other

445 stars 38 forks source link

Add: DeepseekCoder v2 chat format #74

Closed pabl-o-ce closed 1 week ago

pabl-o-ce commented 2 weeks ago

Based on the main repo and Bartowski https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct/blob/main/tokenizer_config.json https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF

woheller69 commented 2 weeks ago

I would suggest to name it DEEP_SEEK_CODER_2 The previous version of DEEP_SEEK_CODER has a different prompt format

pabl-o-ce commented 2 weeks ago

said no more good idea