[2.0.5] Finding elements on dark background and OCR

[Fe-Bell]

Hi all,

My team has been using SikuliX to automate certain applications that often times have dark backgrounds and buttons. However, the api is missing locations onscreen quite frequently, mainly in two scenarios:

• Finding buttons (with text inside) using wait()/find()/pattern with dark backgrounds
• Finding text inside buttons (+bounds) waitT()/findT() (possibly related to 388), but more frequently with dark backgrounds The search is being done in the Region of a focused App object. We know the Region/App is working because we haven't seen many issues with light backgrounds. We are still investigating that though.

For now, we decided to not use SikuliX's image or text recognition in our automation, in favor of "hard coded" locations. Unfortunately, I cannot share samples due to the company's strict policies, but I can provide some environment details:

• SikuliX v.2.0.5 used from java API
• Eclipse EE IDE as the dev environment, projects are based on java 1.8
• AdoptOpenJDK Hotspot v.15+
• Windows 10
• VC++ 2019

Do you know if this scenario has been captured or reported before?

Thank you for your hard work maintaining this great project.

Regards.

[balmma]

Have you already tried to set the lightFont option?

OCR.globalOptions().lightFont()

[Fe-Bell]

Hi @balmma ,

We did try that, but it doesn't always work. Often times it will not pick anything up, but for some buttons it will work just fine.

Let me know if you have any other suggestions.

All the best.