search

the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
525 stars 30 forks source link

Evaluate Bud code millenials #138

Closed dittops closed 9 months ago

dittops commented 9 months ago

https://huggingface.co/budecosystem/code-millenials-13b https://huggingface.co/budecosystem/code-millenials-34b

the-crypt-keeper commented 9 months ago

@dittops competed. the 34b model is fairly solid while the 13b model shows some signs of overfitting; it could no longer tell me batman's real name

dittops commented 9 months ago

Thanks for evaluating and sharing the feedback.