Closed mamoodi closed 1 hour ago
End-user friendly description of the problem this fixes or functionality that this introduces
Fix eval run on forks.
Give a summary of what the PR does, explaining any non-trivial design decisions
The evaluation pipeline does not work for forks.
TESTING IN PROGRESS.
Link of any specific issues this addresses https://github.com/All-Hands-AI/OpenHands/issues/5228
To run this PR locally, use the following command:
docker run -it --rm -p 3000:3000 -v /var/run/docker.sock:/var/run/docker.sock --add-host host.docker.internal:host-gateway -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:4fa4357-nikolaik --name openhands-app-4fa4357 docker.all-hands.dev/all-hands-ai/openhands:4fa4357
End-user friendly description of the problem this fixes or functionality that this introduces
Fix eval run on forks.
Give a summary of what the PR does, explaining any non-trivial design decisions
The evaluation pipeline does not work for forks.
TESTING IN PROGRESS.
Link of any specific issues this addresses https://github.com/All-Hands-AI/OpenHands/issues/5228
To run this PR locally, use the following command: