search

unit-mesh / auto-dev

🧙‍AutoDev: The AI-powered coding wizard（AI 驱动编程助手） with multilingual support 🌐, auto code generation 🏗️, and a helpful bug-slaying assistant 🐞! Customizable prompts 🎨 and a magic Auto Dev/Testing/Document/Agent feature 🧪 included! 🚀
https://ide.unitmesh.cc/
Mozilla Public License 2.0
2.72k stars 314 forks source link

Evaluate against the SWE-bench benchmark #113

Closed kripper closed 5 months ago

kripper commented 5 months ago

Evaluate against the SWE-bench benchmark: https://github.com/princeton-nlp/SWE-bench

phodal commented 5 months ago

？？ our AutoDev is a IDE plugin, why need to run a LLM benchmark. See also #111

kripper commented 5 months ago

Right, wrong repo.