search

All-Hands-AI / openhands-resolver

A system that tries to resolve all issues on a github repo with OpenHands.
MIT License
85 stars 20 forks source link

Passing screenshot context from original issues to Agents #220

Closed malhotra5 closed 2 weeks ago

malhotra5 commented 2 weeks ago

This PR addresses #213

Changes

  1. Extract all image links from body or review threads with format ![alt text](url.com)
  2. Pass them to the MessageAction
  3. Updated test cases according to new functionality
malhotra5 commented 2 weeks ago

Yup! In my example, I created an issue with no text description and a single image. The task was embedded inside the image image

Also, the issue title wasn't specific enough for the agent to solely rely on it, thus requiring the agent to interpret the image as well. The PR contained the correct changes, except the agent believed it was incorrectly resolved. Seems like it would be beneficial to also have images passed to guess_success.

Sample issue Link Successful PR link