search

NixOS / nixpkgs

Nix Packages collection & NixOS
MIT License
18.02k stars 14.03k forks source link

[Feature request] NixOS tests screenshot verification system #26009

Open ericsagnes opened 7 years ago

ericsagnes commented 7 years ago

In NixOS tests, Screenshots can be taken with the screenshot command, but there is no way to check the correctness of a screenshot.

OpenQA, the test system from open suse, has a very interesting needle mechanism that allow to check if a screenshot is correct by comparing sections of it with a reference. Having a similar mechanism available in NixOS tests would greatly improve how graphic software and features are tested.

copumpkin commented 7 years ago

cc @aszlig who added the current OCR screenshot mechanism we have in place today.

aszlig commented 7 years ago

Yep, not only the needle system but also their UI is really great. Having a similar needle system would also improve our OCR detection, because it removes most of the noise from the screenshot and only OCRs the relevant parts.

stale[bot] commented 4 years ago

Thank you for your contributions.

This has been automatically marked as stale because it has had no activity for 180 days.

If this is still important to you, we ask that you leave a comment below. Your comment can be as simple as "still important to me". This lets people see that at least one person still cares about this. Someone will have to do this at most twice a year if there is no other activity.

Here are suggestions that might help resolve this more quickly:

  1. Search for maintainers and people that previously touched the related code and @ mention them in a comment.
  2. Ask on the NixOS Discourse.
  3. Ask on the #nixos channel on irc.freenode.net.