the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
491 stars 27 forks source link

Evaluate CodeGemma family #181

Closed the-crypt-keeper closed 2 months ago

the-crypt-keeper commented 3 months ago

https://huggingface.co/blog/codegemma

the-crypt-keeper commented 2 months ago

7B Instruction eval complete

2B and 7B completion and FIM objectives pending