reworkd / AgentGPT

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
https://agentgpt.reworkd.ai
GNU General Public License v3.0
31.69k stars 9.23k forks source link

Goals are not reached #208

Closed doxav closed 1 year ago

doxav commented 1 year ago

I set different goals or asked different questions: there is no final answer, summary, action plan or clear progression to goal. It seems like a good infinite brainstorming rather than a goal oriented problem solver or question answering or goal optimizer. How should such a goal-oriented agent be used? Can AgentGPT uncover different metrics to achieve the goal and measure distance to goal, to be able to continuously optimize it, or an exit strategy and final output format so that goals aren't run endlessly and provide expected goal ?

MPLScyberguy commented 1 year ago

100% agreed! I've attempted multiple scenarios and different prompts to achieve a goal, with the same result. Continuous loops of research or saying it's completed something with no actual output or conclusion. I just asked it to start an online brokerage account (for instance) and it claimed it did, did not provide me any information about it, nor the login info so I could deposit funds, but said it had created a secure payment method and I should provide it my banking information. All while not stopping to allow me to do it if I were silly enough to do it. I feel like I may be providing them with my credits for OpenAI for them to test, not me to get a working product...

doxav commented 1 year ago

At least, does any metric exist in AgentGPT to measure distance to goal ? Then we could define an exit strategy and an output format to deliver something in line with goal.

ThalliumFrog commented 1 year ago

100% agreed! I've attempted multiple scenarios and different prompts to achieve a goal, with the same result. Continuous loops of research or saying it's completed something with no actual output or conclusion. I just asked it to start an online brokerage account (for instance) and it claimed it did, did not provide me any information about it, nor the login info so I could deposit funds, but said it had created a secure payment method and I should provide it my banking information. All while not stopping to allow me to do it if I were silly enough to do it. I feel like I may be providing them with my credits for OpenAI for them to test, not me to get a working product...

I’ve found if you add something to the prompt such as “print [what you want it to print] after every step” it will output it.

linghongli commented 1 year ago

At least, does any metric exist in AgentGPT to measure distance to goal ? Then we could define an exit strategy and an output format to deliver something in line with goal.

100% agreed

doxav commented 1 year ago

This approach could cover the need to track status. However the main issue is the lack of "distance to goal" or value function to goal to measure progress and convergence, nor an exit strategy when goal is reached.

jasangill1 commented 1 year ago

Hello @doxav @MPLScyberguy Have you had a chance to try Agentgpt recently after the new updates? If so how these problems been resolved or lessened

I would love to here your feed back!!

jasangill1 commented 1 year ago

Closing due to inactivity please feel free to reopen and message whenever!!