search

projectmesa / mesa-frames

Extension of mesa for performance and scalability
https://projectmesa.github.io/mesa-frames
Apache License 2.0
12 stars 4 forks source link

Experimental use of LLMs for completing issues #87

Open adamamer20 opened 2 weeks ago

adamamer20 commented 2 weeks ago

I believe with a good CI suite in place and a good template for issues (eg. current behavior, expected behavior...) we could use a local LLM like DeepSeek-Coder to solve the easiest issues and simply review the changes. This would aid development greatly because it would allow to focus only on the most difficult issues and less on actual mantainance. Look at this repo: https://github.com/princeton-nlp/SWE-agent?tab=readme-ov-file

rht commented 2 weeks ago

According to OpenAI's modification of SWE-bench, Aider performs better than SWE-Agent, while Agentless is the best performing one.

adamamer20 commented 2 weeks ago

According to OpenAI's modification of SWE-bench, Aider performs better than SWE-Agent, while Agentless is the best performing one.

Thanks @rht! Always on top :). I took a look at Agentless and right now the documentation is fairly lacking (it shows how to reproduce the SWE-Bench result but that's it). We can try using Aider, it seems well documented and easy to setup!