carlrobertoh / CodeGPT

JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Claude 3, Code Llama, and others, all for free
https://codegpt.ee
Apache License 2.0
885 stars 184 forks source link

Draft: feat: Support Codestral 22B 32K #587

Closed reneleonhardt closed 1 month ago

reneleonhardt commented 1 month ago

https://mistral.ai/news/codestral/ https://huggingface.co/bartowski/Codestral-22B-v0.1-GGUF https://huggingface.co/lmstudio-community/Codestral-22B-v0.1-GGUF https://ollama.com/library/codestral

Still downloading... can you try if prompt and FIM work? As always the hardest part is figuring out the templates and (stop) tokens, every source says something different... Would be too easy if there would be standardized model cards containing the info needed to run and use the model, guess we need much more AI to figure that out 🤦

The license is "for research and testing purposes", is it possible to merge?