search

the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
524 stars 30 forks source link

Evaluate phi3 family #185

Closed the-crypt-keeper closed 5 months ago

the-crypt-keeper commented 5 months ago

GGUF performance, even at fp16, seems to be unusually weak here might be something up. Transformers fp16 performs well.