cyberkaida / reverse-engineering-assistant

An AI assistant for reverse engineering tasks 👩‍💻
Apache License 2.0
165 stars 15 forks source link

Provide default local models #35

Closed cyberkaida closed 1 month ago

cyberkaida commented 3 months ago

Good performance has been seen with the following models:

ChatGPT still provides the best performance, but at the cost of running in the cloud.

Mixtral works well for reasoning, but sometimes calls functions wrong. I get good performance locally on my MacBook, but it requires powerful hardware.

Gemma is very promising, it is easy to run on less powerful hardware, but its reasoning is not as good. It does seem better at calling functions than other models.