search

canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
33 stars 48 forks source link

Increase the threshold for camera-quality_video.* #1559

Open kevinyehk opened 2 weeks ago

kevinyehk commented 2 weeks ago

Enhancement Proposal

Some images from the camera have higher noise, base on the conversion with @fernando79513, we could increase the threshold of the algorithm to pass the test.

syncronize-issues-to-jira[bot] commented 2 weeks ago

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/CHECKBOX-1628.

This message was autogenerated

fernando79513 commented 5 days ago

I look at some recomendations for rescaling the image and changing the interpolation method to AREA fixed the issue with this device, since it reduced the noise produced when rescaling the image. We are still failing with low quality images, but now the test pass with this device

fernando79513 commented 5 days ago

Original image: download

NEAREST interpolation resized_image_nearest The BRISQUE score is too high: 65.15044131116338 > 60

AREA interpolation resized_image_area BRISQUE score: 32.42782220073718

fernando79513 commented 5 days ago

Bad quality images:

wrong_camera_color wrong_camera_color.jpeg The BRISQUE score is too high: 159.1849551827096 > 60

2023-09-27-113128 The BRISQUE score is too high: 80.10864111807274 > 60

frame_0 Unable to compute BRISQUE score