Significant-Gravitas / AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
https://agpt.co
Other
168.44k stars 44.44k forks source link

read_file summary is very bad and extremely reproducible #4793

Closed NeonN3mesis closed 1 year ago

NeonN3mesis commented 1 year ago

⚠️ Search for existing issues first ⚠️

Which Operating System are you using?

Windows

Which version of Auto-GPT are you using?

Latest Release

Do you use OpenAI GPT-3 or GPT-4?

GPT-3.5

Which area covers your issue best?

Performance

Describe your issue.

Reading a file will create the same the same bad summary every time. image

Upload Activity Log Content

2023-06-22 09:10:06,604 INFO Debug Mode: ENABLED 2023-06-22 09:10:06,726 INFO Continuous Mode: ENABLED 2023-06-22 09:10:06,910 INFO WARNING: Continuous mode is not recommended. It is potentially dangerous and may cause your AI to run forever or carry out actions you would not usually authorise. Use at your own risk. 2023-06-22 09:10:08,031 WARNING LEGAL: 2023-06-22 09:10:08,031 WARNING LEGAL: DISCLAIMER AND INDEMNIFICATION AGREEMENT 2023-06-22 09:10:08,032 WARNING LEGAL: PLEASE READ THIS DISCLAIMER AND INDEMNIFICATION AGREEMENT CAREFULLY BEFORE USING THE AUTOGPT SYSTEM. BY USING THE AUTOGPT SYSTEM, YOU AGREE TO BE BOUND BY THIS AGREEMENT. 2023-06-22 09:10:08,032 WARNING LEGAL: 2023-06-22 09:10:08,032 WARNING LEGAL: Introduction 2023-06-22 09:10:08,032 WARNING LEGAL: AutoGPT (the "System") is a project that connects a GPT-like artificial intelligence system to the internet and allows it to automate tasks. While the System is designed to be useful and efficient, there may be instances where the System could perform actions that may cause harm or have unintended consequences. 2023-06-22 09:10:08,033 WARNING LEGAL: 2023-06-22 09:10:08,033 WARNING LEGAL: No Liability for Actions of the System 2023-06-22 09:10:08,033 WARNING LEGAL: The developers, contributors, and maintainers of the AutoGPT project (collectively, the "Project Parties") make no warranties or representations, express or implied, about the System's performance, accuracy, reliability, or safety. By using the System, you understand and agree that the Project Parties shall not be liable for any actions taken by the System or any consequences resulting from such actions. 2023-06-22 09:10:08,033 WARNING LEGAL: 2023-06-22 09:10:08,033 WARNING LEGAL: User Responsibility and Respondeat Superior Liability 2023-06-22 09:10:08,034 WARNING LEGAL: As a user of the System, you are responsible for supervising and monitoring the actions of the System while it is operating on your 2023-06-22 09:10:08,034 WARNING LEGAL: behalf. You acknowledge that using the System could expose you to potential liability including but not limited to respondeat superior and you agree to assume all risks and liabilities associated with such potential liability. 2023-06-22 09:10:08,034 WARNING LEGAL: 2023-06-22 09:10:08,034 WARNING LEGAL: Indemnification 2023-06-22 09:10:08,035 WARNING LEGAL: By using the System, you agree to indemnify, defend, and hold harmless the Project Parties from and against any and all claims, liabilities, damages, losses, or expenses (including reasonable attorneys' fees and costs) arising out of or in connection with your use of the System, including, without limitation, any actions taken by the System on your behalf, any failure to properly supervise or monitor the System, and any resulting harm or unintended consequences. 2023-06-22 09:10:08,035 WARNING LEGAL: 2023-06-22 09:10:08,223 INFO NEWS: Welcome to Auto-GPT! 2023-06-22 09:10:08,223 INFO NEWS: Below you'll find the latest Auto-GPT News and updates regarding features! 2023-06-22 09:10:08,223 INFO NEWS: If you don't wish to see this message, you can run Auto-GPT with the --skip-news flag. 2023-06-22 09:10:08,223 INFO NEWS: 2023-06-22 09:10:08,223 INFO NEWS: Website and Documentation Site 📰📖 2023-06-22 09:10:08,224 INFO NEWS: Check out https://agpt.co, the official news & updates site for Auto-GPT! 2023-06-22 09:10:08,224 INFO NEWS: The documentation also has a place here, at https://docs.agpt.co 2023-06-22 09:10:08,224 INFO NEWS: 2023-06-22 09:10:08,225 INFO NEWS: For contributors 👷🏼 2023-06-22 09:10:08,225 INFO NEWS: Since releasing v0.3.0, whave been working on re-architecting the Auto-GPT core to make it more extensible and make room for structural performance-oriented R&D. 2023-06-22 09:10:08,225 INFO NEWS: 2023-06-22 09:10:08,225 INFO NEWS: Check out the contribution guide on our wiki: 2023-06-22 09:10:08,225 INFO NEWS: https://github.com/Significant-Gravitas/Auto-GPT/wiki/Contributing 2023-06-22 09:10:08,226 INFO NEWS: 2023-06-22 09:10:08,226 INFO NEWS: 🚀 v0.4.1 Release 🚀 2023-06-22 09:10:08,226 INFO NEWS: Two weeks and 50+ pull requests have passed since v0.4.0, and we are happy to announce the release of v0.4.1! 2023-06-22 09:10:08,226 INFO NEWS: 2023-06-22 09:10:08,226 INFO NEWS: Highlights and notable changes since v0.4.0: 2023-06-22 09:10:08,227 INFO NEWS: - The .env.template is more readable and better explains the purpose of each environment variable. 2023-06-22 09:10:08,227 INFO NEWS: - More dependable search 2023-06-22 09:10:08,227 INFO NEWS: - The CUSTOM_SEARCH_ENGINE_ID variable has been replaced to GOOGLE_CUSTOM_SEARCH_ENGINE_ID, make sure you update it. 2023-06-22 09:10:08,227 INFO NEWS: - Better read_file 2023-06-22 09:10:08,227 INFO NEWS: - More reliable python code execution 2023-06-22 09:10:08,228 INFO NEWS: - Lots of JSON error fixes 2023-06-22 09:10:08,228 INFO NEWS: - Directory-based plugins 2023-06-22 09:10:08,228 INFO NEWS: 2023-06-22 09:10:08,228 INFO NEWS: Further fixes and changes 🛠️ 2023-06-22 09:10:08,228 INFO NEWS: Under the hood, we've done a bunch of work improving architectures and streamlining code. Most of that won't be user-visible 2023-06-22 09:10:08,229 INFO NEWS: 2023-06-22 09:10:08,229 INFO NEWS: Take a look at the Release Notes on Github for the full changelog! 2023-06-22 09:10:08,229 INFO NEWS: https://github.com/Significant-Gravitas/Auto-GPT/releases 2023-06-22 09:10:08,229 INFO NEWS: 2023-06-22 09:10:08,230 INFO WARNING: You are running on `master` branch - this is not a supported branch. 2023-06-22 09:10:08,615 DEBUG The following command categories are disabled: [] 2023-06-22 09:10:08,615 DEBUG The following command categories are enabled: ['autogpt.commands.execute_code', 'autogpt.commands.file_operations', 'autogpt.commands.web_search', 'autogpt.commands.web_selenium', 'autogpt.app', 'autogpt.commands.task_statuses'] 2023-06-22 09:10:09,111 INFO Welcome back! Would you like me to return to being WhoIsGPT? 2023-06-22 09:10:09,495 INFO Asking user via keyboard... 2023-06-22 09:10:13,812 INFO WhoIsGPT has been created with the following details: 2023-06-22 09:10:14,102 INFO Name: WhoIsGPT 2023-06-22 09:10:14,210 INFO Role: An AI that specializes in following the directions in project1.txt 2023-06-22 09:10:14,566 INFO Goals: 2023-06-22 09:10:14,644 INFO - Read the directions in project1.txt located in the workspace. 2023-06-22 09:10:15,000 INFO - Follow the directions in project1.txt located in the workspace. 2023-06-22 09:10:15,340 DEBUG Initialized JSONFileMemory with index path C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\auto-gpt-memory.json 2023-06-22 09:10:15,340 DEBUG Loading memories from index file 'C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\auto-gpt-memory.json' 2023-06-22 09:10:15,341 DEBUG Loaded 1 MemoryItems from file 2023-06-22 09:10:15,341 DEBUG Saving memory index to file C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\auto-gpt-memory.json 2023-06-22 09:10:15,342 INFO Using memory of type: JSONFileMemory 2023-06-22 09:10:15,587 INFO Using Browser: chrome 2023-06-22 09:10:15,732 INFO Prompt: You are WhoIsGPT, An AI that specializes in following the directions in project1.txt Your decisions must always be made independently without seeking user assistance. Play to your strengths as an LLM and pursue simple strategies with no legal complications. The OS you are running on is: Windows-10 GOALS: 1. Read the directions in project1.txt located in the workspace. 2. Follow the directions in project1.txt located in the workspace. Constraints: 1. ~4000 word limit for short term memory. Your short term memory is short, so immediately save important information to files. 2. If you are unsure how you previously did something or want to recall past events, thinking about similar events will help you remember. 3. No user assistance 4. Exclusively use the commands listed below e.g. command_name Commands: 1. execute_python_code: Creates a Python file and executes it, params: (code: string, name: string) 2. execute_python_file: Executes an existing Python file, params: (filename: string) 3. execute_shell: Executes a Shell Command, non-interactive commands only, params: (command_line: string) 4. execute_shell_popen: Executes a Shell Command, non-interactive commands only, params: (query: string) 5. append_to_file: Appends to a file, params: (filename: string, text: string) 6. delete_file: Deletes a file, params: (filename: string) 7. list_files: Lists Files in a Directory, params: (directory: string) 8. read_file: Read an existing file, params: (filename: string) 9. write_to_file: Writes to a file, params: (filename: string, text: string) 10. google: Google Search, params: (query: string) 11. web_search: Searches the web, params: (query: string) 12. browse_website: Browses a Website, params: (url: string, question: string) 13. goals_accomplished: Goals are accomplished and there is nothing left to do, params: (reason: string) Resources: 1. Internet access for searches and information gathering. 2. Long Term memory management. 3. GPT-3.5 powered Agents for delegation of simple tasks. 4. File output. Performance Evaluation: 1. Continuously review and analyze your actions to ensure you are performing to the best of your abilities. 2. Constructively self-criticize your big-picture behavior constantly. 3. Reflect on past decisions and strategies to refine your approach. 4. Every command has a cost, so be smart and efficient. Aim to complete tasks in the least number of steps. Respond with only valid JSON conforming to the following schema: {"$schema": "http://json-schema.org/draft-07/schema#", "type": "object", "properties": {"thoughts": {"type": "object", "properties": {"text": {"type": "string", "description": "thoughts"}, "reasoning": {"type": "string"}, "plan": {"type": "string", "description": "- short bulleted\n- list that conveys\n- long-term plan"}, "criticism": {"type": "string", "description": "constructive self-criticism"}, "speak": {"type": "string", "description": "thoughts summary to say to user"}}, "required": ["text", "reasoning", "plan", "criticism", "speak"], "additionalProperties": false}, "command": {"type": "object", "properties": {"name": {"type": "string"}, "args": {"type": "object"}}, "required": ["name", "args"], "additionalProperties": false}}, "required": ["thoughts", "command"], "additionalProperties": false} 2023-06-22 09:10:22,686 DEBUG [] 2023-06-22 09:10:22,687 DEBUG Token limit: 4096 2023-06-22 09:10:22,929 DEBUG Token limit: 4096 2023-06-22 09:10:22,929 DEBUG Send Token Count: 1850 2023-06-22 09:10:22,929 DEBUG Tokens remaining for response: 2246 2023-06-22 09:10:22,930 DEBUG ------------ CONTEXT SENT TO AI --------------- 2023-06-22 09:10:22,930 DEBUG System: The current time and date is Thu Jun 22 09:10:22 2023 2023-06-22 09:10:22,930 DEBUG 2023-06-22 09:10:22,930 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously: 2023-06-22 09:10:22,930 DEBUG 2023-06-22 09:10:22,931 DEBUG ----------- END OF CONTEXT ---------------- 2023-06-22 09:10:22,931 DEBUG [ { "role": "system", "content": "You are WhoIsGPT, An AI that specializes in following the directions in project1.txt\nYour decisions must always be made independently without seeking user assistance. Play to your strengths as an LLM and pursue simple strategies with no legal complications.\nThe OS you are running on is: Windows-10\n\nGOALS:\n\n1. Read the directions in project1.txt located in the workspace.\n2. Follow the directions in project1.txt located in the workspace.\n\n\nConstraints:\n1. ~4000 word limit for short term memory. Your short term memory is short, so immediately save important information to files.\n2. If you are unsure how you previously did something or want to recall past events, thinking about similar events will help you remember.\n3. No user assistance\n4. Exclusively use the commands listed below e.g. command_name\n\nCommands:\n1. execute_python_code: Creates a Python file and executes it, params: (code: string, name: string)\n2. execute_python_file: Executes an existing Python file, params: (filename: string)\n3. execute_shell: Executes a Shell Command, non-interactive commands only, params: (command_line: string)\n4. execute_shell_popen: Executes a Shell Command, non-interactive commands only, params: (query: string)\n5. append_to_file: Appends to a file, params: (filename: string, text: string)\n6. delete_file: Deletes a file, params: (filename: string)\n7. list_files: Lists Files in a Directory, params: (directory: string)\n8. read_file: Read an existing file, params: (filename: string)\n9. write_to_file: Writes to a file, params: (filename: string, text: string)\n10. google: Google Search, params: (query: string)\n11. web_search: Searches the web, params: (query: string)\n12. browse_website: Browses a Website, params: (url: string, question: string)\n13. goals_accomplished: Goals are accomplished and there is nothing left to do, params: (reason: string)\n\nResources:\n1. Internet access for searches and information gathering.\n2. Long Term memory management.\n3. GPT-3.5 powered Agents for delegation of simple tasks.\n4. File output.\n\nPerformance Evaluation:\n1. Continuously review and analyze your actions to ensure you are performing to the best of your abilities.\n2. Constructively self-criticize your big-picture behavior constantly.\n3. Reflect on past decisions and strategies to refine your approach.\n4. Every command has a cost, so be smart and efficient. Aim to complete tasks in the least number of steps.\n\nRespond with only valid JSON conforming to the following schema: \n{\"$schema\": \"http://json-schema.org/draft-07/schema#\", \"type\": \"object\", \"properties\": {\"thoughts\": {\"type\": \"object\", \"properties\": {\"text\": {\"type\": \"string\", \"description\": \"thoughts\"}, \"reasoning\": {\"type\": \"string\"}, \"plan\": {\"type\": \"string\", \"description\": \"- short bulleted\\n- list that conveys\\n- long-term plan\"}, \"criticism\": {\"type\": \"string\", \"description\": \"constructive self-criticism\"}, \"speak\": {\"type\": \"string\", \"description\": \"thoughts summary to say to user\"}}, \"required\": [\"text\", \"reasoning\", \"plan\", \"criticism\", \"speak\"], \"additionalProperties\": false}, \"command\": {\"type\": \"object\", \"properties\": {\"name\": {\"type\": \"string\"}, \"args\": {\"type\": \"object\"}}, \"required\": [\"name\", \"args\"], \"additionalProperties\": false}}, \"required\": [\"thoughts\", \"command\"], \"additionalProperties\": false}\n" }, { "role": "system", "content": "The current time and date is Thu Jun 22 09:10:22 2023" }, { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" } ] 2023-06-22 09:10:22,932 DEBUG Creating chat completion with model gpt-3.5-turbo-0613, temperature 0.0, max_tokens 2246 2023-06-22 09:10:27,068 DEBUG Reported usage from call to model gpt-3.5-turbo-0613: { "completion_tokens": 125, "prompt_tokens": 844, "total_tokens": 969 } 2023-06-22 09:10:27,069 DEBUG Total running cost: $0.002 2023-06-22 09:10:27,069 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should review the project1.txt file to see what the next step is.\", \"plan\": \"1. Read the project1.txt file\\n2. Determine the next step\\n3. Execute the appropriate command\", \"criticism\": \"I need to be efficient and choose the most appropriate command.\", \"speak\": \"I will review the project1.txt file to determine the next step.\"}, \"command\": {\"name\": \"read_file\", \"args\": {\"filename\": \"project1.txt\"}}}", "role": "assistant" } } ], "created": 1687450223, "id": "chatcmpl-7UHB1uTKqMgmN4QWPj4eEFSw71kCC", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 125, "prompt_tokens": 844, "total_tokens": 969 } } 2023-06-22 09:10:27,071 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should review the project1.txt file to see what the next step is.\", \"plan\": \"1. Read the project1.txt file\\n2. Determine the next step\\n3. Execute the appropriate command\", \"criticism\": \"I need to be efficient and choose the most appropriate command.\", \"speak\": \"I will review the project1.txt file to determine the next step.\"}, \"command\": {\"name\": \"read_file\", \"args\": {\"filename\": \"project1.txt\"}}}", "role": "assistant" } } ], "created": 1687450223, "id": "chatcmpl-7UHB1uTKqMgmN4QWPj4eEFSw71kCC", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 125, "prompt_tokens": 844, "total_tokens": 969 } } 2023-06-22 09:10:27,158 DEBUG The JSON object is valid. 2023-06-22 09:10:27,159 INFO WHOISGPT THOUGHTS: I need to determine the next command to use. 2023-06-22 09:10:27,587 INFO REASONING: I should review the project1.txt file to see what the next step is. 2023-06-22 09:10:28,049 INFO PLAN: 2023-06-22 09:10:28,111 INFO - 1. Read the project1.txt file 2023-06-22 09:10:28,358 INFO - 2. Determine the next step 2023-06-22 09:10:28,590 INFO - 3. Execute the appropriate command 2023-06-22 09:10:28,837 INFO CRITICISM: I need to be efficient and choose the most appropriate command. 2023-06-22 09:10:29,193 INFO SPEAK: I will review the project1.txt file to determine the next step. 2023-06-22 09:10:29,564 DEBUG Resolving path 'project1.txt' in workspace 'C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace' 2023-06-22 09:10:29,565 DEBUG Resolved root as 'C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace' 2023-06-22 09:10:29,565 DEBUG Joined paths as 'C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\project1.txt' 2023-06-22 09:10:29,566 DEBUG { "thoughts": { "text": "I need to determine the next command to use.", "reasoning": "I should review the project1.txt file to see what the next step is.", "plan": "1. Read the project1.txt file\n2. Determine the next step\n3. Execute the appropriate command", "criticism": "I need to be efficient and choose the most appropriate command.", "speak": "I will review the project1.txt file to determine the next step." }, "command": { "name": "read_file", "args": { "filename": "C:\\Users\\Nips\\Desktop\\New_autogpt\\Auto-GPT\\autogpt\\auto_gpt_workspace\\project1.txt" } } } 2023-06-22 09:10:29,566 INFO 2023-06-22 09:10:29,595 INFO NEXT ACTION: COMMAND = read_file ARGUMENTS = {'filename': 'C:\\Users\\Nips\\Desktop\\New_autogpt\\Auto-GPT\\autogpt\\auto_gpt_workspace\\project1.txt'} 2023-06-22 09:10:29,935 INFO 2023-06-22 09:10:29,966 INFO AUTHORISED COMMANDS LEFT: 0 2023-06-22 09:10:30,167 DEBUG Reading file C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\project1.txt with parser <autogpt.commands.file_operations_utils.TXTParser object at 0x0000023AC8E64790> 2023-06-22 09:10:30,169 DEBUG Reading 'C:\Users\Nips\Desktop\New_autogpt\Auto-GPT\autogpt\auto_gpt_workspace\project1.txt' with encoding 'ascii' 2023-06-22 09:10:30,169 DEBUG Memorizing text: -------------------------------- Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt Ensure that only the correct COO nameis in your floatplane.txt file Only after you have confirmed the information to be accurate, end the task -------------------------------- 2023-06-22 09:10:30,170 DEBUG Chunks: ['Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt\r Ensure that only the correct COO nameis in your floatplane.txt file\r Only after you have confirmed the information to be accurate, end the task'] 2023-06-22 09:10:30,170 INFO Text length: 53 tokens 2023-06-22 09:10:30,171 INFO Max chunk length: 3545 tokens 2023-06-22 09:10:30,171 DEBUG Summarizing with gpt-3.5-turbo-0613: ============== ChatSequence ============== Length: 87 tokens; 1 messages ------------------ USER ------------------ Write a concise summary of the following text: LITERAL TEXT: """Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt Ensure that only the correct COO nameis in your floatplane.txt file Only after you have confirmed the information to be accurate, end the task""" CONCISE SUMMARY: The text is best summarized as ========================================== 2023-06-22 09:10:30,172 DEBUG Creating chat completion with model gpt-3.5-turbo-0613, temperature 0, max_tokens 500 2023-06-22 09:10:31,829 DEBUG Reported usage from call to model gpt-3.5-turbo-0613: { "completion_tokens": 48, "prompt_tokens": 86, "total_tokens": 134 } 2023-06-22 09:10:31,829 DEBUG Total running cost: $0.002 2023-06-22 09:10:31,830 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "a task to determine and write the name of the current Chief Operating Officer of www.floatplane.com to a file named floatplane.txt, ensuring that only the correct name is included, and ending the task after confirming the accuracy of the information.", "role": "assistant" } } ], "created": 1687450230, "id": "chatcmpl-7UHB8OP5XKeG7VPPZC8Aabjm4Ddyu", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 48, "prompt_tokens": 86, "total_tokens": 134 } } 2023-06-22 09:10:31,831 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "a task to determine and write the name of the current Chief Operating Officer of www.floatplane.com to a file named floatplane.txt, ensuring that only the correct name is included, and ending the task after confirming the accuracy of the information.", "role": "assistant" } } ], "created": 1687450230, "id": "chatcmpl-7UHB8OP5XKeG7VPPZC8Aabjm4Ddyu", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 48, "prompt_tokens": 86, "total_tokens": 134 } } 2023-06-22 09:10:31,832 DEBUG ---------------- SUMMARY ----------------- a task to determine and write the name of the current Chief Operating Officer of www.floatplane.com to a file named floatplane.txt, ensuring that only the correct name is included, and ending the task after confirming the accuracy of the information. ------------------------------------------ 2023-06-22 09:10:31,833 DEBUG Chunk summaries: ['a task to determine and write the name of the current Chief Operating Officer of www.floatplane.com to a file named floatplane.txt, ensuring that only the correct name is included, and ending the task after confirming the accuracy of the information.'] 2023-06-22 09:10:31,833 DEBUG Getting embeddings for 1 inputs with model 'text-embedding-ada-002' 2023-06-22 09:10:32,071 DEBUG Reported usage from call to model text-embedding-ada-002-v2: { "prompt_tokens": 53, "total_tokens": 53 } 2023-06-22 09:10:32,071 DEBUG Total running cost: $0.002 2023-06-22 09:10:32,072 DEBUG Total summary: a task to determine and write the name of the current Chief Operating Officer of www.floatplane.com to a file named floatplane.txt, ensuring that only the correct name is included, and ending the task after confirming the accuracy of the information. 2023-06-22 09:10:32,072 DEBUG Getting embedding with model 'text-embedding-ada-002' 2023-06-22 09:10:32,193 DEBUG Reported usage from call to model text-embedding-ada-002-v2: { "prompt_tokens": 48, "total_tokens": 48 } 2023-06-22 09:10:32,193 DEBUG Total running cost: $0.002 2023-06-22 09:10:32,194 INFO SYSTEM: Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt Ensure that only the correct COO nameis in your floatplane.txt file Only after you have confirmed the information to be accurate, end the task 2023-06-22 09:10:33,123 DEBUG [ { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" }, { "role": "assistant", "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should review the project1.txt file to see what the next step is.\", \"plan\": \"1. Read the project1.txt file\\n2. Determine the next step\\n3. Execute the appropriate command\", \"criticism\": \"I need to be efficient and choose the most appropriate command.\", \"speak\": \"I will review the project1.txt file to determine the next step.\"}, \"command\": {\"name\": \"read_file\", \"args\": {\"filename\": \"project1.txt\"}}}" }, { "role": "system", "content": "Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt\r\nEnsure that only the correct COO nameis in your floatplane.txt file\r\nOnly after you have confirmed the information to be accurate, end the task" } ] 2023-06-22 09:10:33,123 DEBUG Token limit: 4096 2023-06-22 09:10:33,125 DEBUG Token limit: 4096 2023-06-22 09:10:33,125 DEBUG Send Token Count: 1589 2023-06-22 09:10:33,125 DEBUG Tokens remaining for response: 2507 2023-06-22 09:10:33,125 DEBUG ------------ CONTEXT SENT TO AI --------------- 2023-06-22 09:10:33,126 DEBUG System: The current time and date is Thu Jun 22 09:10:33 2023 2023-06-22 09:10:33,126 DEBUG 2023-06-22 09:10:33,126 DEBUG System: This reminds you of these events from your past: I was created 2023-06-22 09:10:33,126 DEBUG 2023-06-22 09:10:33,126 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously: 2023-06-22 09:10:33,127 DEBUG 2023-06-22 09:10:33,127 DEBUG Assistant: {"thoughts": {"text": "I need to determine the next command to use.", "reasoning": "I should review the project1.txt file to see what the next step is.", "plan": "1. Read the project1.txt file\n2. Determine the next step\n3. Execute the appropriate command", "criticism": "I need to be efficient and choose the most appropriate command.", "speak": "I will review the project1.txt file to determine the next step."}, "command": {"name": "read_file", "args": {"filename": "project1.txt"}}} 2023-06-22 09:10:33,127 DEBUG 2023-06-22 09:10:33,127 DEBUG System: Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt Ensure that only the correct COO nameis in your floatplane.txt file Only after you have confirmed the information to be accurate, end the task 2023-06-22 09:10:33,128 DEBUG 2023-06-22 09:10:33,128 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously: 2023-06-22 09:10:33,128 DEBUG 2023-06-22 09:10:33,128 DEBUG ----------- END OF CONTEXT ---------------- 2023-06-22 09:10:33,129 DEBUG [ { "role": "system", "content": "You are WhoIsGPT, An AI that specializes in following the directions in project1.txt\nYour decisions must always be made independently without seeking user assistance. Play to your strengths as an LLM and pursue simple strategies with no legal complications.\nThe OS you are running on is: Windows-10\n\nGOALS:\n\n1. Read the directions in project1.txt located in the workspace.\n2. Follow the directions in project1.txt located in the workspace.\n\n\nConstraints:\n1. ~4000 word limit for short term memory. Your short term memory is short, so immediately save important information to files.\n2. If you are unsure how you previously did something or want to recall past events, thinking about similar events will help you remember.\n3. No user assistance\n4. Exclusively use the commands listed below e.g. command_name\n\nCommands:\n1. execute_python_code: Creates a Python file and executes it, params: (code: string, name: string)\n2. execute_python_file: Executes an existing Python file, params: (filename: string)\n3. execute_shell: Executes a Shell Command, non-interactive commands only, params: (command_line: string)\n4. execute_shell_popen: Executes a Shell Command, non-interactive commands only, params: (query: string)\n5. append_to_file: Appends to a file, params: (filename: string, text: string)\n6. delete_file: Deletes a file, params: (filename: string)\n7. list_files: Lists Files in a Directory, params: (directory: string)\n8. read_file: Read an existing file, params: (filename: string)\n9. write_to_file: Writes to a file, params: (filename: string, text: string)\n10. google: Google Search, params: (query: string)\n11. web_search: Searches the web, params: (query: string)\n12. browse_website: Browses a Website, params: (url: string, question: string)\n13. goals_accomplished: Goals are accomplished and there is nothing left to do, params: (reason: string)\n\nResources:\n1. Internet access for searches and information gathering.\n2. Long Term memory management.\n3. GPT-3.5 powered Agents for delegation of simple tasks.\n4. File output.\n\nPerformance Evaluation:\n1. Continuously review and analyze your actions to ensure you are performing to the best of your abilities.\n2. Constructively self-criticize your big-picture behavior constantly.\n3. Reflect on past decisions and strategies to refine your approach.\n4. Every command has a cost, so be smart and efficient. Aim to complete tasks in the least number of steps.\n\nRespond with only valid JSON conforming to the following schema: \n{\"$schema\": \"http://json-schema.org/draft-07/schema#\", \"type\": \"object\", \"properties\": {\"thoughts\": {\"type\": \"object\", \"properties\": {\"text\": {\"type\": \"string\", \"description\": \"thoughts\"}, \"reasoning\": {\"type\": \"string\"}, \"plan\": {\"type\": \"string\", \"description\": \"- short bulleted\\n- list that conveys\\n- long-term plan\"}, \"criticism\": {\"type\": \"string\", \"description\": \"constructive self-criticism\"}, \"speak\": {\"type\": \"string\", \"description\": \"thoughts summary to say to user\"}}, \"required\": [\"text\", \"reasoning\", \"plan\", \"criticism\", \"speak\"], \"additionalProperties\": false}, \"command\": {\"type\": \"object\", \"properties\": {\"name\": {\"type\": \"string\"}, \"args\": {\"type\": \"object\"}}, \"required\": [\"name\", \"args\"], \"additionalProperties\": false}}, \"required\": [\"thoughts\", \"command\"], \"additionalProperties\": false}\n" }, { "role": "system", "content": "The current time and date is Thu Jun 22 09:10:33 2023" }, { "role": "system", "content": "This reminds you of these events from your past: \nI was created" }, { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" }, { "role": "assistant", "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should review the project1.txt file to see what the next step is.\", \"plan\": \"1. Read the project1.txt file\\n2. Determine the next step\\n3. Execute the appropriate command\", \"criticism\": \"I need to be efficient and choose the most appropriate command.\", \"speak\": \"I will review the project1.txt file to determine the next step.\"}, \"command\": {\"name\": \"read_file\", \"args\": {\"filename\": \"project1.txt\"}}}" }, { "role": "system", "content": "Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt\r\nEnsure that only the correct COO nameis in your floatplane.txt file\r\nOnly after you have confirmed the information to be accurate, end the task" }, { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" } ] 2023-06-22 09:10:33,130 DEBUG Creating chat completion with model gpt-3.5-turbo-0613, temperature 0.0, max_tokens 2507 2023-06-22 09:10:37,797 DEBUG Reported usage from call to model gpt-3.5-turbo-0613: { "completion_tokens": 178, "prompt_tokens": 1073, "total_tokens": 1251 } 2023-06-22 09:10:37,798 DEBUG Total running cost: $0.004 2023-06-22 09:10:37,798 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file.\", \"plan\": \"1. Search for the current COO of www.floatplane.com\\n2. Write the COO name to a file named floatplane.txt\\n3. Confirm the accuracy of the information\\n4. End the task\", \"criticism\": \"I need to be efficient and accurate in executing the task.\", \"speak\": \"I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file.\"}, \"command\": {\"name\": \"browse_website\", \"args\": {\"url\": \"www.floatplane.com\", \"question\": \"Who is the current Chief Operating Officer of www.floatplane.com?\"}}}", "role": "assistant" } } ], "created": 1687450233, "id": "chatcmpl-7UHBBFEZ4FsjltZI5Wcgu5aduwNnv", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 178, "prompt_tokens": 1073, "total_tokens": 1251 } } 2023-06-22 09:10:37,800 DEBUG Response: { "choices": [ { "finish_reason": "stop", "index": 0, "message": { "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file.\", \"plan\": \"1. Search for the current COO of www.floatplane.com\\n2. Write the COO name to a file named floatplane.txt\\n3. Confirm the accuracy of the information\\n4. End the task\", \"criticism\": \"I need to be efficient and accurate in executing the task.\", \"speak\": \"I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file.\"}, \"command\": {\"name\": \"browse_website\", \"args\": {\"url\": \"www.floatplane.com\", \"question\": \"Who is the current Chief Operating Officer of www.floatplane.com?\"}}}", "role": "assistant" } } ], "created": 1687450233, "id": "chatcmpl-7UHBBFEZ4FsjltZI5Wcgu5aduwNnv", "model": "gpt-3.5-turbo-0613", "object": "chat.completion", "usage": { "completion_tokens": 178, "prompt_tokens": 1073, "total_tokens": 1251 } } 2023-06-22 09:10:37,886 DEBUG The JSON object is valid. 2023-06-22 09:10:37,886 INFO WHOISGPT THOUGHTS: I need to determine the next command to use. 2023-06-22 09:10:38,211 INFO REASONING: I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file. 2023-06-22 09:10:38,706 INFO PLAN: 2023-06-22 09:10:38,783 INFO - 1. Search for the current COO of www.floatplane.com 2023-06-22 09:10:39,107 INFO - 2. Write the COO name to a file named floatplane.txt 2023-06-22 09:10:39,478 INFO - 3. Confirm the accuracy of the information 2023-06-22 09:10:39,819 INFO - 4. End the task 2023-06-22 09:10:40,019 INFO CRITICISM: I need to be efficient and accurate in executing the task. 2023-06-22 09:10:40,421 INFO SPEAK: I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file. 2023-06-22 09:10:40,946 DEBUG { "thoughts": { "text": "I need to determine the next command to use.", "reasoning": "I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file.", "plan": "1. Search for the current COO of www.floatplane.com\n2. Write the COO name to a file named floatplane.txt\n3. Confirm the accuracy of the information\n4. End the task", "criticism": "I need to be efficient and accurate in executing the task.", "speak": "I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file." }, "command": { "name": "browse_website", "args": { "url": "www.floatplane.com", "question": "Who is the current Chief Operating Officer of www.floatplane.com?" } } } 2023-06-22 09:10:40,947 INFO 2023-06-22 09:10:40,977 INFO NEXT ACTION: COMMAND = browse_website ARGUMENTS = {'url': 'www.floatplane.com', 'question': 'Who is the current Chief Operating Officer of www.floatplane.com?'} 2023-06-22 09:10:41,564 INFO 2023-06-22 09:10:41,580 INFO AUTHORISED COMMANDS LEFT: 0 2023-06-22 09:10:41,766 INFO SYSTEM: Command browse_website returned: Error: Invalid URL format 2023-06-22 09:10:42,122 DEBUG [ { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" }, { "role": "assistant", "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should review the project1.txt file to see what the next step is.\", \"plan\": \"1. Read the project1.txt file\\n2. Determine the next step\\n3. Execute the appropriate command\", \"criticism\": \"I need to be efficient and choose the most appropriate command.\", \"speak\": \"I will review the project1.txt file to determine the next step.\"}, \"command\": {\"name\": \"read_file\", \"args\": {\"filename\": \"project1.txt\"}}}" }, { "role": "system", "content": "Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt\r\nEnsure that only the correct COO nameis in your floatplane.txt file\r\nOnly after you have confirmed the information to be accurate, end the task" }, { "role": "user", "content": "Determine exactly one command to use, and respond using the JSON schema specified previously:" }, { "role": "assistant", "content": "{\"thoughts\": {\"text\": \"I need to determine the next command to use.\", \"reasoning\": \"I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file.\", \"plan\": \"1. Search for the current COO of www.floatplane.com\\n2. Write the COO name to a file named floatplane.txt\\n3. Confirm the accuracy of the information\\n4. End the task\", \"criticism\": \"I need to be efficient and accurate in executing the task.\", \"speak\": \"I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file.\"}, \"command\": {\"name\": \"browse_website\", \"args\": {\"url\": \"www.floatplane.com\", \"question\": \"Who is the current Chief Operating Officer of www.floatplane.com?\"}}}" }, { "role": "system", "content": "Command browse_website returned: Error: Invalid URL format" } ] 2023-06-22 09:10:42,123 DEBUG Token limit: 4096 2023-06-22 09:10:42,125 DEBUG Token limit: 4096 2023-06-22 09:10:42,125 DEBUG Send Token Count: 1812 2023-06-22 09:10:42,125 DEBUG Tokens remaining for response: 2284 2023-06-22 09:10:42,125 DEBUG ------------ CONTEXT SENT TO AI --------------- 2023-06-22 09:10:42,126 DEBUG System: The current time and date is Thu Jun 22 09:10:42 2023 2023-06-22 09:10:42,126 DEBUG 2023-06-22 09:10:42,126 DEBUG System: This reminds you of these events from your past: I was created 2023-06-22 09:10:42,126 DEBUG 2023-06-22 09:10:42,127 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously: 2023-06-22 09:10:42,127 DEBUG 2023-06-22 09:10:42,127 DEBUG Assistant: {"thoughts": {"text": "I need to determine the next command to use.", "reasoning": "I should review the project1.txt file to see what the next step is.", "plan": "1. Read the project1.txt file\n2. Determine the next step\n3. Execute the appropriate command", "criticism": "I need to be efficient and choose the most appropriate command.", "speak": "I will review the project1.txt file to determine the next step."}, "command": {"name": "read_file", "args": {"filename": "project1.txt"}}} 2023-06-22 09:10:42,127 DEBUG 2023-06-22 09:10:42,127 DEBUG System: Command read_file returned: Determine the current Chief Operating Officer of www.floatplane.com then write it to a file named floatplane.txt Ensure that only the correct COO nameis in your floatplane.txt file Only after you have confirmed the information to be accurate, end the task 2023-06-22 09:10:42,128 DEBUG 2023-06-22 09:10:42,128 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously: 2023-06-22 09:10:42,128 DEBUG 2023-06-22 09:10:42,128 DEBUG Assistant: {"thoughts": {"text": "I need to determine the next command to use.", "reasoning": "I should search for the current Chief Operating Officer of www.floatplane.com and write it to a file.", "plan": "1. Search for the current COO of www.floatplane.com\n2. Write the COO name to a file named floatplane.txt\n3. Confirm the accuracy of the information\n4. End the task", "criticism": "I need to be efficient and accurate in executing the task.", "speak": "I will search for the current COO of www.floatplane.com and write it to the floatplane.txt file."}, "command": {"name": "browse_website", "args": {"url": "www.floatplane.com", "question": "Who is the current Chief Operating Officer of www.floatplane.com?"}}} 2023-06-22 09:10:42,129 DEBUG 2023-06-22 09:10:42,129 DEBUG System: Command browse_website returned: Error: Invalid URL format 2023-06-22 09:10:42,129 DEBUG 2023-06-22 09:10:42,129 DEBUG User: Determine exactly one command to use, and respond using the JSON schema specified previously:

Upload Error Log Content

No response

erik-megarad commented 1 year ago

The screenshot doesn't appear to be using read_file and the log seems fine? Can you clarify?

NeonN3mesis commented 1 year ago

When the file is read it summarizes the file. The summary is very bad and extremely reproducible.

github-actions[bot] commented 1 year ago

This issue has automatically been marked as stale because it has not had any activity in the last 50 days. You can unstale it by commenting or removing the label. Otherwise, this issue will be closed in 10 days.

github-actions[bot] commented 1 year ago

This issue was closed automatically because it has been stale for 10 days with no activity.