eureka-research / DrEureka

Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
https://eureka-research.github.io/dr-eureka/
MIT License
819 stars 64 forks source link

Running `python eureka.py env=forward_locomotion` produces `All iterations of code generation failed, aborting...` #4

Open ramkumarkoppu opened 7 months ago

ramkumarkoppu commented 7 months ago

python eureka.py env=forward_locomotion [2024-05-07 05:06:14,160][root][INFO] - Workspace: /media/sda1/repos/DrEureka/eureka/outputs/eureka/2024-05-07_05-06-14 [2024-05-07 05:06:14,160][root][INFO] - Project Root: /media/sda1/repos/DrEureka/eureka [2024-05-07 05:06:14,160][root][INFO] - Using LLM: gpt-4-0125-preview [2024-05-07 05:06:14,160][root][INFO] - Task: Forward Locomotion [2024-05-07 05:06:14,160][root][INFO] - Task description: To make the go1 quadruped run forward with a velocity of exactly 2.0 m/s in the positive x direction of the global coordinate frame. The policy will be trained in simulation and deployed in the real world, so the policy should be as steady and stable as possible with minimal action rate. Specifically, as it's running, the torso should remain near a z position of 0.34, and the orientation should be perpendicular to gravity. Also, the legs should move smoothly and avoid the DOF limits. [2024-05-07 05:06:14,160][root][INFO] - Iteration 0: Generating 16 samples with gpt-4-0125-preview [2024-05-07 05:08:24,559][root][INFO] - Iteration 0: Prompt Tokens: 1869, Completion Tokens: 10106, Total Tokens: 17582 [2024-05-07 05:08:24,560][root][INFO] - Iteration 0: Processing Code Run 0 [2024-05-07 05:08:26,985][root][INFO] - Iteration 0: Code Run 0 execution error! [2024-05-07 05:08:26,985][root][INFO] - Iteration 0: Processing Code Run 1 [2024-05-07 05:08:27,785][root][INFO] - Iteration 0: Code Run 1 execution error! [2024-05-07 05:08:27,785][root][INFO] - Iteration 0: Processing Code Run 2 [2024-05-07 05:08:28,588][root][INFO] - Iteration 0: Code Run 2 execution error! [2024-05-07 05:08:28,588][root][INFO] - Iteration 0: Processing Code Run 3 [2024-05-07 05:08:29,385][root][INFO] - Iteration 0: Code Run 3 execution error! [2024-05-07 05:08:29,385][root][INFO] - Iteration 0: Processing Code Run 4 [2024-05-07 05:08:30,185][root][INFO] - Iteration 0: Code Run 4 execution error! [2024-05-07 05:08:30,185][root][INFO] - Iteration 0: Processing Code Run 5 [2024-05-07 05:08:30,989][root][INFO] - Iteration 0: Code Run 5 execution error! [2024-05-07 05:08:30,990][root][INFO] - Iteration 0: Processing Code Run 6 [2024-05-07 05:08:31,792][root][INFO] - Iteration 0: Code Run 6 execution error! [2024-05-07 05:08:31,792][root][INFO] - Iteration 0: Processing Code Run 7 [2024-05-07 05:08:32,601][root][INFO] - Iteration 0: Code Run 7 execution error! [2024-05-07 05:08:32,601][root][INFO] - Iteration 0: Processing Code Run 8 [2024-05-07 05:08:33,423][root][INFO] - Iteration 0: Code Run 8 execution error! [2024-05-07 05:08:33,424][root][INFO] - Iteration 0: Processing Code Run 9 [2024-05-07 05:08:34,219][root][INFO] - Iteration 0: Code Run 9 execution error! [2024-05-07 05:08:34,220][root][INFO] - Iteration 0: Processing Code Run 10 [2024-05-07 05:08:35,018][root][INFO] - Iteration 0: Code Run 10 execution error! [2024-05-07 05:08:35,018][root][INFO] - Iteration 0: Processing Code Run 11 [2024-05-07 05:08:35,832][root][INFO] - Iteration 0: Code Run 11 execution error! [2024-05-07 05:08:35,832][root][INFO] - Iteration 0: Processing Code Run 12 [2024-05-07 05:08:36,636][root][INFO] - Iteration 0: Code Run 12 execution error! [2024-05-07 05:08:36,636][root][INFO] - Iteration 0: Processing Code Run 13 [2024-05-07 05:08:37,441][root][INFO] - Iteration 0: Code Run 13 execution error! [2024-05-07 05:08:37,441][root][INFO] - Iteration 0: Processing Code Run 14 [2024-05-07 05:08:38,243][root][INFO] - Iteration 0: Code Run 14 execution error! [2024-05-07 05:08:38,243][root][INFO] - Iteration 0: Processing Code Run 15 [2024-05-07 05:08:39,045][root][INFO] - Iteration 0: Code Run 15 execution error! [2024-05-07 05:08:39,088][root][INFO] - All code generation failed! Repeat this iteration from the current message checkpoint! [2024-05-07 05:08:39,088][root][INFO] - Iteration 1: Generating 16 samples with gpt-4-0125-preview [2024-05-07 05:11:03,542][root][INFO] - Iteration 1: Prompt Tokens: 1869, Completion Tokens: 9472, Total Tokens: 16948 [2024-05-07 05:11:03,542][root][INFO] - Iteration 1: Processing Code Run 0 [2024-05-07 05:11:05,938][root][INFO] - Iteration 1: Code Run 0 execution error! [2024-05-07 05:11:05,938][root][INFO] - Iteration 1: Processing Code Run 1 [2024-05-07 05:11:06,721][root][INFO] - Iteration 1: Code Run 1 execution error! [2024-05-07 05:11:06,721][root][INFO] - Iteration 1: Processing Code Run 2 [2024-05-07 05:11:07,509][root][INFO] - Iteration 1: Code Run 2 execution error! [2024-05-07 05:11:07,510][root][INFO] - Iteration 1: Processing Code Run 3 [2024-05-07 05:11:08,297][root][INFO] - Iteration 1: Code Run 3 execution error! [2024-05-07 05:11:08,297][root][INFO] - Iteration 1: Processing Code Run 4 [2024-05-07 05:11:09,083][root][INFO] - Iteration 1: Code Run 4 execution error! [2024-05-07 05:11:09,083][root][INFO] - Iteration 1: Processing Code Run 5 [2024-05-07 05:11:09,873][root][INFO] - Iteration 1: Code Run 5 execution error! [2024-05-07 05:11:09,874][root][INFO] - Iteration 1: Processing Code Run 6 [2024-05-07 05:11:10,661][root][INFO] - Iteration 1: Code Run 6 execution error! [2024-05-07 05:11:10,661][root][INFO] - Iteration 1: Processing Code Run 7 [2024-05-07 05:11:11,453][root][INFO] - Iteration 1: Code Run 7 execution error! [2024-05-07 05:11:11,453][root][INFO] - Iteration 1: Processing Code Run 8 [2024-05-07 05:11:12,239][root][INFO] - Iteration 1: Code Run 8 execution error! [2024-05-07 05:11:12,240][root][INFO] - Iteration 1: Processing Code Run 9 [2024-05-07 05:11:13,033][root][INFO] - Iteration 1: Code Run 9 execution error! [2024-05-07 05:11:13,033][root][INFO] - Iteration 1: Processing Code Run 10 [2024-05-07 05:11:13,821][root][INFO] - Iteration 1: Code Run 10 execution error! [2024-05-07 05:11:13,821][root][INFO] - Iteration 1: Processing Code Run 11 [2024-05-07 05:11:14,599][root][INFO] - Iteration 1: Code Run 11 execution error! [2024-05-07 05:11:14,599][root][INFO] - Iteration 1: Processing Code Run 12 [2024-05-07 05:11:15,391][root][INFO] - Iteration 1: Code Run 12 execution error! [2024-05-07 05:11:15,391][root][INFO] - Iteration 1: Processing Code Run 13 [2024-05-07 05:11:16,172][root][INFO] - Iteration 1: Code Run 13 execution error! [2024-05-07 05:11:16,172][root][INFO] - Iteration 1: Processing Code Run 14 [2024-05-07 05:11:16,953][root][INFO] - Iteration 1: Code Run 14 execution error! [2024-05-07 05:11:16,953][root][INFO] - Iteration 1: Processing Code Run 15 [2024-05-07 05:11:17,751][root][INFO] - Iteration 1: Code Run 15 execution error! [2024-05-07 05:11:17,799][root][INFO] - All code generation failed! Repeat this iteration from the current message checkpoint! [2024-05-07 05:11:17,799][root][INFO] - Iteration 2: Generating 16 samples with gpt-4-0125-preview [2024-05-07 05:13:17,426][root][INFO] - Iteration 2: Prompt Tokens: 1869, Completion Tokens: 9150, Total Tokens: 16626 [2024-05-07 05:13:17,427][root][INFO] - Iteration 2: Processing Code Run 0 [2024-05-07 05:13:19,835][root][INFO] - Iteration 2: Code Run 0 execution error! [2024-05-07 05:13:19,835][root][INFO] - Iteration 2: Processing Code Run 1 [2024-05-07 05:13:20,658][root][INFO] - Iteration 2: Code Run 1 execution error! [2024-05-07 05:13:20,658][root][INFO] - Iteration 2: Processing Code Run 2 [2024-05-07 05:13:21,463][root][INFO] - Iteration 2: Code Run 2 execution error! [2024-05-07 05:13:21,463][root][INFO] - Iteration 2: Processing Code Run 3 [2024-05-07 05:13:22,269][root][INFO] - Iteration 2: Code Run 3 execution error! [2024-05-07 05:13:22,270][root][INFO] - Iteration 2: Processing Code Run 4 [2024-05-07 05:13:23,075][root][INFO] - Iteration 2: Code Run 4 execution error! [2024-05-07 05:13:23,076][root][INFO] - Iteration 2: Processing Code Run 5 [2024-05-07 05:13:23,881][root][INFO] - Iteration 2: Code Run 5 execution error! [2024-05-07 05:13:23,881][root][INFO] - Iteration 2: Processing Code Run 6 [2024-05-07 05:13:24,688][root][INFO] - Iteration 2: Code Run 6 execution error! [2024-05-07 05:13:24,689][root][INFO] - Iteration 2: Processing Code Run 7 [2024-05-07 05:13:25,492][root][INFO] - Iteration 2: Code Run 7 execution error! [2024-05-07 05:13:25,492][root][INFO] - Iteration 2: Processing Code Run 8 [2024-05-07 05:13:26,299][root][INFO] - Iteration 2: Code Run 8 execution error! [2024-05-07 05:13:26,300][root][INFO] - Iteration 2: Processing Code Run 9 [2024-05-07 05:13:27,117][root][INFO] - Iteration 2: Code Run 9 execution error! [2024-05-07 05:13:27,118][root][INFO] - Iteration 2: Processing Code Run 10 [2024-05-07 05:13:27,942][root][INFO] - Iteration 2: Code Run 10 execution error! [2024-05-07 05:13:27,942][root][INFO] - Iteration 2: Processing Code Run 11 [2024-05-07 05:13:28,724][root][INFO] - Iteration 2: Code Run 11 execution error! [2024-05-07 05:13:28,725][root][INFO] - Iteration 2: Processing Code Run 12 [2024-05-07 05:13:29,531][root][INFO] - Iteration 2: Code Run 12 execution error! [2024-05-07 05:13:29,531][root][INFO] - Iteration 2: Processing Code Run 13 [2024-05-07 05:13:30,339][root][INFO] - Iteration 2: Code Run 13 execution error! [2024-05-07 05:13:30,339][root][INFO] - Iteration 2: Processing Code Run 14 [2024-05-07 05:13:31,151][root][INFO] - Iteration 2: Code Run 14 execution error! [2024-05-07 05:13:31,152][root][INFO] - Iteration 2: Processing Code Run 15 [2024-05-07 05:13:31,960][root][INFO] - Iteration 2: Code Run 15 execution error! [2024-05-07 05:13:32,006][root][INFO] - All code generation failed! Repeat this iteration from the current message checkpoint! [2024-05-07 05:13:32,007][root][INFO] - Iteration 3: Generating 16 samples with gpt-4-0125-preview [2024-05-07 05:15:24,831][root][INFO] - Iteration 3: Prompt Tokens: 1869, Completion Tokens: 9374, Total Tokens: 16850 [2024-05-07 05:15:24,831][root][INFO] - Iteration 3: Processing Code Run 0 [2024-05-07 05:15:27,229][root][INFO] - Iteration 3: Code Run 0 execution error! [2024-05-07 05:15:27,229][root][INFO] - Iteration 3: Processing Code Run 1 [2024-05-07 05:15:28,028][root][INFO] - Iteration 3: Code Run 1 execution error! [2024-05-07 05:15:28,029][root][INFO] - Iteration 3: Processing Code Run 2 [2024-05-07 05:15:28,842][root][INFO] - Iteration 3: Code Run 2 execution error! [2024-05-07 05:15:28,842][root][INFO] - Iteration 3: Processing Code Run 3 [2024-05-07 05:15:29,652][root][INFO] - Iteration 3: Code Run 3 execution error! [2024-05-07 05:15:29,653][root][INFO] - Iteration 3: Processing Code Run 4 [2024-05-07 05:15:30,458][root][INFO] - Iteration 3: Code Run 4 execution error! [2024-05-07 05:15:30,458][root][INFO] - Iteration 3: Processing Code Run 5 [2024-05-07 05:15:31,272][root][INFO] - Iteration 3: Code Run 5 execution error! [2024-05-07 05:15:31,272][root][INFO] - Iteration 3: Processing Code Run 6 [2024-05-07 05:15:32,094][root][INFO] - Iteration 3: Code Run 6 execution error! [2024-05-07 05:15:32,095][root][INFO] - Iteration 3: Processing Code Run 7 [2024-05-07 05:15:32,902][root][INFO] - Iteration 3: Code Run 7 execution error! [2024-05-07 05:15:32,903][root][INFO] - Iteration 3: Processing Code Run 8 [2024-05-07 05:15:33,723][root][INFO] - Iteration 3: Code Run 8 execution error! [2024-05-07 05:15:33,723][root][INFO] - Iteration 3: Processing Code Run 9 [2024-05-07 05:15:34,525][root][INFO] - Iteration 3: Code Run 9 execution error! [2024-05-07 05:15:34,525][root][INFO] - Iteration 3: Processing Code Run 10 [2024-05-07 05:15:35,318][root][INFO] - Iteration 3: Code Run 10 execution error! [2024-05-07 05:15:35,318][root][INFO] - Iteration 3: Processing Code Run 11 [2024-05-07 05:15:36,151][root][INFO] - Iteration 3: Code Run 11 execution error! [2024-05-07 05:15:36,151][root][INFO] - Iteration 3: Processing Code Run 12 [2024-05-07 05:15:36,956][root][INFO] - Iteration 3: Code Run 12 execution error! [2024-05-07 05:15:36,956][root][INFO] - Iteration 3: Processing Code Run 13 [2024-05-07 05:15:37,759][root][INFO] - Iteration 3: Code Run 13 execution error! [2024-05-07 05:15:37,760][root][INFO] - Iteration 3: Processing Code Run 14 [2024-05-07 05:15:38,568][root][INFO] - Iteration 3: Code Run 14 execution error! [2024-05-07 05:15:38,568][root][INFO] - Iteration 3: Processing Code Run 15 [2024-05-07 05:15:39,367][root][INFO] - Iteration 3: Code Run 15 execution error! [2024-05-07 05:15:39,411][root][INFO] - All code generation failed! Repeat this iteration from the current message checkpoint! [2024-05-07 05:15:39,411][root][INFO] - Iteration 4: Generating 16 samples with gpt-4-0125-preview [2024-05-07 05:17:21,182][root][INFO] - Iteration 4: Prompt Tokens: 1869, Completion Tokens: 9034, Total Tokens: 16510 [2024-05-07 05:17:21,183][root][INFO] - Iteration 4: Processing Code Run 0 [2024-05-07 05:17:23,575][root][INFO] - Iteration 4: Code Run 0 execution error! [2024-05-07 05:17:23,575][root][INFO] - Iteration 4: Processing Code Run 1 [2024-05-07 05:17:24,385][root][INFO] - Iteration 4: Code Run 1 execution error! [2024-05-07 05:17:24,386][root][INFO] - Iteration 4: Processing Code Run 2 [2024-05-07 05:17:25,205][root][INFO] - Iteration 4: Code Run 2 execution error! [2024-05-07 05:17:25,206][root][INFO] - Iteration 4: Processing Code Run 3 [2024-05-07 05:17:26,005][root][INFO] - Iteration 4: Code Run 3 execution error! [2024-05-07 05:17:26,005][root][INFO] - Iteration 4: Processing Code Run 4 [2024-05-07 05:17:26,812][root][INFO] - Iteration 4: Code Run 4 execution error! [2024-05-07 05:17:26,812][root][INFO] - Iteration 4: Processing Code Run 5 [2024-05-07 05:17:27,636][root][INFO] - Iteration 4: Code Run 5 execution error! [2024-05-07 05:17:27,636][root][INFO] - Iteration 4: Processing Code Run 6 [2024-05-07 05:17:28,448][root][INFO] - Iteration 4: Code Run 6 execution error! [2024-05-07 05:17:28,448][root][INFO] - Iteration 4: Processing Code Run 7 [2024-05-07 05:17:29,253][root][INFO] - Iteration 4: Code Run 7 execution error! [2024-05-07 05:17:29,253][root][INFO] - Iteration 4: Processing Code Run 8 [2024-05-07 05:17:30,072][root][INFO] - Iteration 4: Code Run 8 execution error! [2024-05-07 05:17:30,073][root][INFO] - Iteration 4: Processing Code Run 9 [2024-05-07 05:17:30,877][root][INFO] - Iteration 4: Code Run 9 execution error! [2024-05-07 05:17:30,878][root][INFO] - Iteration 4: Processing Code Run 10 [2024-05-07 05:17:31,684][root][INFO] - Iteration 4: Code Run 10 execution error! [2024-05-07 05:17:31,684][root][INFO] - Iteration 4: Processing Code Run 11 [2024-05-07 05:17:32,511][root][INFO] - Iteration 4: Code Run 11 execution error! [2024-05-07 05:17:32,511][root][INFO] - Iteration 4: Processing Code Run 12 [2024-05-07 05:17:33,312][root][INFO] - Iteration 4: Code Run 12 execution error! [2024-05-07 05:17:33,313][root][INFO] - Iteration 4: Processing Code Run 13 [2024-05-07 05:17:34,116][root][INFO] - Iteration 4: Code Run 13 execution error! [2024-05-07 05:17:34,116][root][INFO] - Iteration 4: Processing Code Run 14 [2024-05-07 05:17:34,946][root][INFO] - Iteration 4: Code Run 14 execution error! [2024-05-07 05:17:34,947][root][INFO] - Iteration 4: Processing Code Run 15 [2024-05-07 05:17:35,755][root][INFO] - Iteration 4: Code Run 15 execution error! [2024-05-07 05:17:35,799][root][INFO] - All code generation failed! Repeat this iteration from the current message checkpoint! [2024-05-07 05:17:35,799][root][INFO] - All iterations of code generation failed, aborting... [2024-05-07 05:17:35,799][root][INFO] - Please double check the output env_iter_response.txt files for repeating errors!

RaedShabbir commented 6 months ago

This occurs because of https://github.com/eureka-research/DrEureka/issues/2

You can see the fix here https://github.com/eureka-research/DrEureka/pull/3/commits/49bc214989c07937639cecc4485fb4bcd1f39119