search

canonical / checkbox

Checkbox is a testing framework used to validate device compatibility with Ubuntu Linux. It’s the testing tool developed for the purposes of the Ubuntu Certification program.
https://checkbox.readthedocs.io
GNU General Public License v3.0
33 stars 50 forks source link

Test cases and test plan for PR 1245 (New) #1550

Closed hanhsuan closed 3 weeks ago

hanhsuan commented 1 month ago

Description

This is part of #1245 to add test cases and test plan to utilize the python script to find which GPU is the renderer.

Resolved issues

Documentation

Tests

submission:

pieqq commented 3 weeks ago

I checked the submission logs, and I have a question:

For the desktop auto, I can see the following tests have passed:

However, it looks like the FPS is 1 frame per second. Is that normal? For the record, the output looks like:

running command:[['glxgears']]
Process is running on:
  process:[['glxgears']]
  Card ID:[0000:47:00.0]
  Device Name:[AD107GL [RTX 2000 Ada Generation] [10DE:28B0]]
Running synchronized to the vertical refresh.  The framerate should be
approximately the same as the monitor refresh rate.
7 frames in 5.0 seconds =  1.399 FPS
6 frames in 6.0 seconds =  1.000 FPS
6 frames in 6.0 seconds =  1.000 FPS
6 frames in 6.0 seconds =  1.000 FPS
5 frames in 5.0 seconds =  1.000 FPS
Test finished
hanhsuan commented 3 weeks ago

I checked the submission logs, and I have a question:

For the desktop auto, I can see the following tests have passed:

* [after-suspend-graphics/auto_glxgears](https://certification.canonical.com/hardware/202406-34161/submission/400472/test/219921/result/45088343/)

* [after-suspend-graphics/auto_glxgears_fullscreen](https://certification.canonical.com/hardware/202406-34161/submission/400472/test/219922/result/45088344/)

* [graphics/auto_glxgears](https://certification.canonical.com/hardware/202406-34161/submission/400472/test/210940/result/45088351/)

* [graphics/auto_glxgears_fullscreen](https://certification.canonical.com/hardware/202406-34161/submission/400472/test/210941/result/45088352/)

However, it looks like the FPS is 1 frame per second. Is that normal? For the record, the output looks like:

running command:[['glxgears']]
Process is running on:
  process:[['glxgears']]
  Card ID:[0000:47:00.0]
  Device Name:[AD107GL [RTX 2000 Ada Generation] [10DE:28B0]]
Running synchronized to the vertical refresh.  The framerate should be
approximately the same as the monitor refresh rate.
7 frames in 5.0 seconds =  1.399 FPS
6 frames in 6.0 seconds =  1.000 FPS
6 frames in 6.0 seconds =  1.000 FPS
6 frames in 6.0 seconds =  1.000 FPS
5 frames in 5.0 seconds =  1.000 FPS
Test finished

@pieqq The low FPS comes from the bad edid emulator and these auto test cases are used to validate the renderer.

pieqq commented 3 weeks ago

@hanhsuan thanks for the explanation.

Another question: This modifies the graphics-gpu-cert-automated and after-suspend-graphics-gpu-cert-automated test plans. Was it tested with a 22.04 test plan? (apologies if this was discussed already!)

hanhsuan commented 3 weeks ago

@hanhsuan thanks for the explanation.

Another question: This modifies the graphics-gpu-cert-automated and after-suspend-graphics-gpu-cert-automated test plans. Was it tested with a 22.04 test plan? (apologies if this was discussed already!)

@pieqq These two test plans are included in 24.04 only. 22.04 are using graphics-integrated-gpu-cert-full and graphics-discrete-gpu-cert-full.