Updates to fast profile

OpenInterpreter / open-interpreter

A natural language interface for computers

http://openinterpreter.com/

GNU Affero General Public License v3.0

50.58k stars 4.41k forks source link

Updates to fast profile #1246

Closed jasonkneen closed 1 month ago

jasonkneen commented 2 months ago

Describe the changes you have made:

Updated this to:

support gpt-4-turbo which should be super fast enough
improve prompt to avoid confusion with 'Task is done'
subtle prompt changes
version number update to avoid messages

Reference any relevant issues (e.g. "Fixes #000"):

Pre-Submission Checklist (optional but appreciated):

[x] I have included relevant documentation updates (stored in /docs)
[x ] I have read docs/CONTRIBUTING.md
[x ] I have read docs/ROADMAP.md

OS Tests (optional but appreciated):

[ ] Tested on Windows
[x] Tested on MacOS
[ ] Tested on Linux

KillianLucas commented 1 month ago

Hi Jason! I think 3.5 is still the best option for speed, the default is 4.5-turbo now so I think --fast should be faster. (Tbh I think if the user has a Groq API Key then --fast should even use Groq)

I also am not sure I understand "If the user has set you a task and it's done has been completed, say 'Ready to code.'".

If you have experimented, and you experience better results with this system message (I don't use fast mode very much) then I'll merge. Let me know what you think about switching back to 3.5 and perhaps removing that line! 👍

jasonkneen commented 1 month ago

ahh ok slight mistake on that line it should be

If the user has set you a task and you have completed it and they are finished say 'OK, Ready to code.'

Essentially I found it a bit confusing when it kept saying "The task is done." when I was testing it with "hello" etc, which of course makes sense if it's been told not to chit-chat so whs trying to make it clearer to OI and the user what was going on. Just thought it was a bit friendlier and re-focus user.

Re 3.5 sure I'll revert it and leave as-is.