search

All-Hands-AI / OpenHands

🙌 OpenHands: Code Less, Make More
https://all-hands.dev
MIT License
36.61k stars 4.16k forks source link

Integration test github action #5076

Open enyst opened 6 hours ago

enyst commented 6 hours ago

The eval-runner workflow from the .github/workflows directory is too big. Read it all carefully, and note how it's doing two different things: integration test evaluation and SWE-Bench evaluation. Let's split it: 1) find the section named "Run integration test evaluation" and the necessary sections before and after 2) create a new workflow named integration-runner 3) define it as to work on a PR with the label 'integration-test' trigger 4) move the integration test evaluation section to the new file and copy the prerequisites.

IMPORTANT:

github-actions[bot] commented 6 hours ago

OpenHands started fixing the issue! You can monitor the progress here.

github-actions[bot] commented 6 hours ago

A potential fix has been generated and a draft PR #5077 has been created. Please review the changes.