the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
491 stars 27 forks source link

Evaluate facebook/llm-compiler-13b #210

Closed the-crypt-keeper closed 3 weeks ago

the-crypt-keeper commented 3 weeks ago

Looks like this model is hyper-specialized and only understands LLVM IR and ASM.