Codestral (Mistral code suggestion)

zed-industries / zed

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

https://zed.dev

Other

42.2k stars 2.22k forks source link

Codestral (Mistral code suggestion) #12519

Open Solido opened 1 month ago

Solido commented 1 month ago

Check for existing issues

[X] Completed

Describe the feature

Support codestral from MistralAI as an equivalent of OpenAI.

Codestral support infill and VsCode plugins are already available.

https://mistral.ai/news/codestral/

Thanks!

If applicable, add mockups / screenshots to help present your vision of the feature

No response

universalmind303 commented 2 weeks ago

Additionally, It'd be amazing if we could use this for inline_completions.

NightMachinery commented 2 weeks ago

Don't be too excited. Codestral is terrible at doing FIM. I have switched to asking Sonnet 3.5 to just fill in the marked part, and it does the job 10x better, even though it is a chat model and not tuned for FIM at all. Codestral can't even match the parentheses right.

neofob commented 1 week ago

I could use Codestral model with private-gpt (fork from zylon-ai's private-gpt) in chat mode running in Docker with NVIDIA GPU support. So it would be cool if we could get it to work with zed locally.