the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
516 stars 29 forks source link

Evaluate microsoft/Orca-2-13b #117

Closed the-crypt-keeper closed 9 months ago

the-crypt-keeper commented 9 months ago

Wow this model is terrible - it can NOT code.

Not going to bother with the 7b just avoid these things.