huggingface / llm-vscode

LLM powered development for VSCode
Apache License 2.0
1.24k stars 133 forks source link

Support Code Llama #58

Closed mishig25 closed 1 year ago

mishig25 commented 1 year ago

TLDR: support Code LLama models.

Currently running 13B version that is also used on https://huggingface.co/spaces/codellama/codellama-playground

Since Code Llama uses different tokens (regarding start, end, fill in middle) compared to StarCoder, some changes were needed to make creation of prompts more general. See Files changed tab for more details