smallcloudai / refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
https://refact.ai
BSD 3-Clause "New" or "Revised" License
1.5k stars 100 forks source link

Supporting the code model Codestral-22B-v0.1 #435

Open 596192804 opened 1 month ago

596192804 commented 1 month ago

MistralAI has unleashed a code model that sets a new benchmark in the performance-to-latency tradeoff for code generation, outperforming previous models commonly employed for coding. mistralai/Codestral-22B-v0.1 image However, the model is currently not compatible for deployment with Refact. Could you provide support for integrating it with Refact?