search

cyberkaida / reverse-engineering-assistant

An AI assistant for reverse engineering tasks 👩‍💻
Apache License 2.0
165 stars 15 forks source link

😣Don't display a scary message when the model does not obey the schema #31

Closed cyberkaida closed 1 month ago

cyberkaida commented 4 months ago

See issue #29

Models below 70b parameters have problems following the schema. When a schema error appears it should be captured and displayed with a message encouraging the user to try again.

We should catch the exception and output the stack trace only in debug logging. Display to the user a hint to try a bigger model or to try again. A hint to adjust temperature might be required after repeated attempts.

cyberkaida commented 4 months ago

We should also document how to select a model.