Codellama deprecation - Githubissues

smallcloudai / refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

https://refact.ai

BSD 3-Clause "New" or "Revised" License

1.6k stars 109 forks source link

Closed mitya52 closed 6 months ago

mitya52 commented 6 months ago

We will not support codellama/7b model later:

there are a lot of problems with codellama/7b implementation: bad FIM caps (possibly because of prompting), OOMs and errors while training process
codellama/7b could be replaced with starcoder2 due to it's better performance