search

siegelz / core-bench

MIT License
10 stars 3 forks source link

Harness times out when copying over files #12

Open siegelz opened 6 days ago

siegelz commented 6 days ago

Running locally

python3 main.py \
    --experiment_name test_coreagent_gpt4o_c-4 \
    --agent_dir agents/AutoGPT-CORE \
    --use_azure \
    --dataset_file benchmark/dataset/core_test.json \
    --no_gpu \
    --task_limit 1 \
    --benchmark_level codeocean_hard \
    --agent_script coreagent_hard_gpt4o.sh

Screenshot 2024-09-30 at 7 19 33 PM

siegelz commented 6 days ago

Unsuccessful at replicating the bug when attempting to run the harness locally.