search

the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
491 stars 27 forks source link

Evaluate DeepSeek-Coder-V2 #206

Closed the-crypt-keeper closed 1 month ago

the-crypt-keeper commented 1 month ago

Lite model likely the only one within my reach.

the-crypt-keeper commented 1 month ago

Evals completed, instruct seems quite sensitive to 4-bit quantization.