WIP:avoid unnecessary segmentation

[Animesh404]

What kind of change does this PR introduce?

attempt for issue #614 to extract the portion of active window that is different and combine with similar image

Summary

Trying to extract the portion of the active window that is different (i.e. greater than some tolerance) from the window retrieved, this can be used later to segment + describe this portion rather than the full thing.

• reference image segments

• new image segments

• non-matching image section

• matching image section

• non-matching image section segments

• matching image section segments

• combined matching image section segments with non-matching image section segments

  

• Final result

  

Checklist

• [x] My code follows the style guidelines of OpenAdapt
• [x] I have performed a self-review of my code
• [x] If applicable, I have added tests to prove my fix is functional/effective
• [ ] I have linted my code locally prior to submission
• [x] I have commented my code, particularly in hard-to-understand areas
• [ ] I have made corresponding changes to the documentation (e.g. README.md, requirements.txt)
• [ ] New and existing unit tests pass locally with my changes

How can your code be run and tested?

try to run experiments/visualizing_segments.py

[abrichr]

That's a great start!

The next steps are:

• identify reference segments that overlap with the difference areas
• extract the portion of the new image corresponding to the reference segments from the previous step
• segment the extracted portion from the previous step
• combine a) the segments extracted in the previous step with b) the reference segments that do not overlap with the difference areas