the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
491 stars 27 forks source link

Replace home-grown language parser with py-tree-sitter #205

Open the-crypt-keeper opened 1 month ago

the-crypt-keeper commented 1 month ago

https://github.com/tree-sitter/py-tree-sitter

We need to know entry points because LLMs often misnamed the functions we ask for. Currently there is a home baked parser for JS and Python, which has its own problem.

This would enable adding more languages.