search

rainmanwy / robotframework-SikuliLibrary

Sikuli Robot Framework Library provide keywords for Robot Framework to test UI through Sikuli.
Apache License 2.0
144 stars 61 forks source link

One suggestion: calculating text position through easyocr and automatically operating it #159

Open fengnex opened 3 years ago

fengnex commented 3 years ago

It is difficult for some GUI components to be tested automatically because of all kinds of reasons, but now those components' text can be recognized with the help of easyocr and a rectangle in the corresponding ui can be return, so robotframework-SikuliLibray can find the very position in the UI and then, for example, click at the position.

It seems feasible and practicable now to develop relevant function points in robotframework-SikuliLibray. Would you like talking about your opinions or plans about that?

rainmanwy commented 2 years ago

Hi, fengnex

i think ocr is a big topic. Maybe it could be implemented as a plugin. Could support easyocr, paddleocr, etc.. i think sikulilibrary should not depend with these libraries directly, because these libraries depended with a lot of libraries, and may need special python version, gpu, and so on. it will make the library installation become difficult for beginners.

what's you opinion?