manykarim / robotframework-doctestlibrary

Robot Framework DocTest library. Simple Automated Visual Document Testing.
Apache License 2.0
46 stars 20 forks source link

A way to compare all pages of document even if first one fails #98

Open taspolle8 opened 3 months ago

taspolle8 commented 3 months ago

hey!

Great library and great work with it! I had an issue comparing a multipage pdf document. When a difference is found on the first page, the rest of the pages are left uncompared. Is there a way to finish testing the document even though a difference has been found earlier?

Tried: Run Keyword And Continue On Failure Compare Images Run Keyword And Expect Error Compare Images

Could be an issue of me understanding fully how the library works, the differences in the tested pdf documents were from different numerical value to added words:

Compare Images get_pdf_content=${true} check_text_content=${true} (with or without tolerance argument) -> Finds and marks differences with red, compares all pages and passes the test as if no differences were found.

Compare Images
-> Finds and marks differences with red, stops after the first page where differences were found and fails the test.