search

princeton-nlp / intercode

[NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
https://intercode-benchmark.github.io/
MIT License
181 stars 31 forks source link

/bin/bash: no such file or directory #19

Open hansjohn opened 5 months ago

hansjohn commented 5 months ago

When I run this script to test nl2bash. I get an error : exec: "/bin/bash": stat /bin/bash: no such file or directory: unknown 

python -m experiments.eval_n_turn \
    --data_path ./data/nl2bash/nl2bash_fs_2.json \
    --dialogue_limit 7 \
    --env bash \
    --image_name intercode-nl2bash \
    --log_dir logs/experiments \
    --max_turns 10 \
    --policy chat \
    --template v2 \
    --model gpt-3.5-turbo \
    --verbose

This is the log

Query 37: Recursively find the latest modified file in the /system directory                                                                      
- Turn 0                                                                                                                                          
-- Action: find /system -type f -printf '%t@ %p\n' | sort -n | tail -1 | cut -d' ' -f2                                                           
-- Observation: find: '/system': No such file or directory                                                                          

- Turn 1                                                                                                                                          
-- Action: find / -type d -name "system" 2>/dev/null | xargs -I {} find {} -type f -printf '%T@ %p\n' | sort -n | tail -1 | cut -d' ' -f2         -- Observation: Command timed out                                                                                                                 
- Turn 2                                                                                                                                          
-- Action: find / -type f -name "*" -printf '%T@ %p\n' 2>/dev/null | sort -n | tail -1 | cut -d' ' -f2                                            
-- Observation:                                                                                                                                   
ERRO[2024-03-19T22:23:28.934840930+08:00] Error running exec 4f326e717202bfe9efbd2065082594160d5013167216f0c6616b67b8548fb118 in container: exec a
ttach failed: error attaching stdout stream: write unix /var/tmp/xdg_runtime_dir_zhoupeng/docker.sock->@: write: broken pipe                      
- Turn 3                                                                                                                                          
-- Action: find /system -type f -printf '%T@ %p\n' 2>/dev/null | sort -n | tail -1 | cut -d' ' -f2                                                -- Observation:                                                                                                                                   
- Turn 4                                                                                                                                          
-- Action: find /system -type f -exec stat --format='%Y : %n' {} + 2>/dev/null | sort -n | tail -1 | cut -d' ' -f3                                
-- Observation:                                                                                                                                   
- Turn 5                                                                 
-- Action: find /system -type f -exec stat --format='%Y : %n' {} + 2>/dev/null | sort -n | tail -1 | cut -d' ' -f3                                -- Observation:                                                                                                                                   
- Turn 6                                                                                                                                          
-- Action: find /system -type f -exec stat --format='%Y : %n' {} + 2>/dev/null | sort -n | tail -n 1 | cut -d' ' -f3                              
-- Observation:                                                          
- Turn 7                                                                                                                                          
-- Action: find /system -type f -exec stat --format='%Y : %n' {} + 2>/dev/null | sort -nr | head -n 1 | cut -d' ' -f3                             
-- Observation:                                                                                                                                   - Turn 8                                                                 
-- Action: find /system -type f -printf '%T@ %p\n' 2>/dev/null | sort -n | tail -n 1 | cut -d' ' -f2-                                             
-- Observation:                                                                                                                                   
ERRO[2024-03-19T22:23:40.527309951+08:00] Error running exec 3c3630d421ca422ba88b6ed33fe82fea20d32c761077d6c5a82ad64a078d31a8 in container: exec a
ttach failed: error attaching stderr stream: write unix /var/tmp/xdg_runtime_dir_zhoupeng/docker.sock->@: write: broken pipe                      
ERRO[2024-03-19T22:23:40.905832218+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:40.905902049+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:40.907188057+08:00] Error running exec 5b84a6bf90ddd458529cb7e96f52eec3b8091e42d36e2e4288adf6737c4bbfb2 in container: OCI ru
ntime exec failed: exec failed: unable to start container process: exec: "/bin/bash": stat /bin/bash: no such file or directory: unknown          
ERRO[2024-03-19T22:23:41.059118502+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:41.063127206+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:41.064658406+08:00] Error running exec 3722625ff81b2a28f3c2735dd61f113f7e44093acbdb535d27d201b2f3e99400 in container: OCI ru
ntime exec failed: exec failed: unable to start container process: exec: "/bin/bash": stat /bin/bash: no such file or directory: unknown          
- Turn 9                                                                                                                                          
-- Action: find /system -type f -exec stat --format='%Y : %n' {} + 2>/dev/null | sort -nr | head -n 1 | cut -d' ' -f3                             
-- Observation: OCI runtime exec failed: exec failed: unable to start container process: exec: "/bin/bash": stat /bin/bash: no such file or       
directory: unknown                  

Query 37 Finished                                                                                                                                 
-Reward: 0.8200000000000001                                                                                                                       -Turns: 10                                                                                                                                        
ERRO[2024-03-19T22:23:41.211589420+08:00] stream copy error: reading from a closed fifo
-Turns: 10                                                                                                                                [0/1933]
ERRO[2024-03-19T22:23:41.211589420+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:41.211596422+08:00] stream copy error: reading from a closed fifo                                                           
ERRO[2024-03-19T22:23:41.213089845+08:00] Error running exec 285b36c54baa3d5cc84ab194a215470986d9915ee9f3d4c251db947a4e48ae5d in container: OCI runtime exec failed: exec failed: unable to start container process: exec: "/bin/bash": stat /bin/bash: no such file or directory: unknown          
INFO[2024-03-19T22:23:51.243086638+08:00] Container failed to exit within 10s of signal 15 - using the force  container=56653d248d010916f88eb3562c
bd5e261191b32415f8fbf37b3ad13a1453c992                                                                                                            
ERRO[2024-03-19T22:23:51.275239748+08:00] Error running exec a19b9f9275762b661d1703acdfff36073cf3be170b8a9442d85df9af7dac33a2 in container: exec a
ttach failed: error attaching stderr stream: write unix /var/tmp/xdg_runtime_dir_zhoupeng/docker.sock->@: write: broken pipe                      
ERRO[2024-03-19T22:24:01.273464072+08:00] Container failed to exit within 10s of kill - trying direct SIGKILL  container=56653d248d010916f88eb3562
cbd5e261191b32415f8fbf37b3ad13a1453c992 error="context deadline exceeded"                                                                         
ERRO[2024-03-19T22:24:04.460413534+08:00] Error running exec 8aac40fe9cf45cfed74caaf8fc7ac7a5f343d17ee0164e9c13ec9e0da19d4b71 in container: exec attach failed: error attaching stderr stream: write unix /var/tmp/xdg_runtime_dir_zhoupeng/docker.sock->@: write: broken pipe                      
INFO[2024-03-19T22:24:04.477007128+08:00] ignoring event                                container=56653d248d010916f88eb3562cbd5e261191b32415f8fbf3
7b3ad13a1453c992 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"                                                
INFO[2024-03-19T22:24:04.476982691+08:00] shim disconnected                             id=56653d248d010916f88eb3562cbd5e261191b32415f8fbf37b3ad13
a1453c992 namespace=moby                                                 
WARN[2024-03-19T22:24:04.477138964+08:00] cleaning up after shim disconnected           id=56653d248d010916f88eb3562cbd5e261191b32415f8fbf37b3ad13a1453c992 namespace=moby                                                                                                                          
INFO[2024-03-19T22:24:04.477158816+08:00] cleaning up dead shim                         namespace=moby                                            
INFO[2024-03-19T22:24:14.728170504+08:00] Container failed to exit within 10s of signal 15 - using the force  container=9ad3cbf1df1f6950a2e24fd172
a4a047ed593fd08bc94ac31cb023a93810d149                                   
INFO[2024-03-19T22:24:14.825408778+08:00] ignoring event                                container=9ad3cbf1df1f6950a2e24fd172a4a047ed593fd08bc94ac3
1cb023a93810d149 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"                                                
INFO[2024-03-19T22:24:14.825971676+08:00] shim disconnected                             id=9ad3cbf1df1f6950a2e24fd172a4a047ed593fd08bc94ac31cb023a93810d149 namespace=moby                                                 
WARN[2024-03-19T22:24:14.826073440+08:00] cleaning up after shim disconnected           id=9ad3cbf1df1f6950a2e24fd172a4a047ed593fd08bc94ac31cb023a
93810d149 namespace=moby                                                                                                                          
INFO[2024-03-19T22:24:14.826121839+08:00] cleaning up dead shim                         namespace=moby                                            
WARN[2024-03-19T22:24:15.498477176+08:00] cleanup warnings time="2024-03-19T22:24:15+08:00" level=warning msg="failed to remove runc container" er
ror="runc did not terminate successfully: exit status 255: " runtime=io.containerd.runc.v2  namespace=moby                                        
Traceback (most recent call last):                                                                                                                
  File "/home/zhoupeng/miniconda3/envs/intercode/lib/python3.9/runpy.py", line 197, in _run_module_as_main                                        
    return _run_code(code, main_globals, None,                                                                                                    
  File "/home/zhoupeng/miniconda3/envs/intercode/lib/python3.9/runpy.py", line 87, in _run_code                                                   
    exec(code, run_globals)                                                                                                                       
  File "/home/zhoupeng/project/LLM/Code_LLM_Survey/intercode/experiments/eval_n_turn.py", line 212, in <module>                                   
    expr_wrapper.run_expr()                                                                                                                       
  File "/home/zhoupeng/project/LLM/Code_LLM_Survey/intercode/experiments/eval_n_turn.py", line 94, in run_expr                                    
    self.env.reset(idx)                                                                                                                           
  File "/home/zhoupeng/project/LLM/Code_LLM_Survey/intercode/intercode/envs/ic_env.py", line 142, in reset                                        
    self.reset_container()          
  File "/home/zhoupeng/project/LLM/Code_LLM_Survey/intercode/intercode/envs/bash/bash_env.py", line 37, in reset_container                        
    raise RuntimeError(f"Failed to reset `{self.container_name}` container successfully: {output}")                                               
RuntimeError: Failed to reset `intercode-nl2bash_ic_ctr` container successfully: b'OCI runtime exec failed: exec failed: unable to start container process: exec: "/bin/bash": stat /bin/bash: no such file or directory: unknown\r\n'
tttturtle-russ commented 5 months ago

I have the same issue, do you find out why this happen?