In prompts, "I should perform command2" in CoT but then "command1" is used

entropy-research / Devon

Devon: An open-source pair programmer

GNU Affero General Public License v3.0

2.36k stars 172 forks source link

In prompts, "I should perform command2" in CoT but then "command1" is used #57

Closed mgsloan closed 1 month ago

mgsloan commented 1 month ago

https://github.com/entropy-research/Devon/blob/87b0461bc37d045a53acdda5470bcc29a6a72991/devon_agent/prompt.py#L150C1-L158C13

  CORRECT:
  <THOUGHT>
  ...thought 1 ...
  ...thought 2 ...
  I should perform command2 in the next step
  </THOUGHT>
  <COMMAND>
  command1 arg1
  </COMMAND>

Note command2 vs command1. While the model gets the gist of it, probably less confusing to it to make this consistent. This occurs twice in prompts.py

akiradev0x commented 1 month ago

Oh awesome thank you!!

akiradev0x commented 1 month ago

Will take care of this within the next two days. Closing out on a bunch of other tasks right now. @mgsloan

akiradev0x commented 1 month ago

This should be fixed now. That prompt file is no longer used and the new ones do not contain the error.