search

kernelci / kernelci-backend

Upstream Linux Kernel Validation Project API
http://api.kernelci.org
GNU Lesser General Public License v2.1
40 stars 27 forks source link

T23919 - Show number of regressions in the e-mail reports #258

Closed mgalka closed 4 years ago

mgalka commented 4 years ago

Fixes for a GH Issue #257 https://github.com/kernelci/kernelci-backend/issues/257 It replaces "results" column which values seemed unintuitive with "regressions" column that simply displays the total number of regressions.

mgalka commented 4 years ago

Tested locally

Before changes:


kernelci/staging-next sleep: 9 runs, 20 regressions (staging-next-20201005.0)

Regressions Summary
-------------------

platform         | arch  | lab           | compiler | defconfig          | results
-----------------+-------+---------------+----------+--------------------+--------
peach-pi         | arm   | lab-collabora | gcc-8    | multi_v7_defconfig | 2/22   
rk3399-gru-kevin | arm64 | lab-collabora | gcc-8    | defconfig          | 10/12  

  Details:  https://staging.kernelci.org/test/job/kernelci/branch/staging-next/kernel/staging-next-20201005.0/plan/sleep/

  Test:     sleep
  Tree:     kernelci
  Branch:   staging-next
  Describe: staging-next-20201005.0
  URL:      https://github.com/kernelci/linux.git
  SHA:      c47842e45f40c2cf39a3a667fb122a4abd30bd24 

Test Regressions
---------------- 

platform         | arch  | lab           | compiler | defconfig          | results
-----------------+-------+---------------+----------+--------------------+--------
peach-pi         | arm   | lab-collabora | gcc-8    | multi_v7_defconfig | 2/22   

  Details:     https://staging.kernelci.org/test/plan/id/5f7b4de05c109f49e2e8d4cf

  Results:     2 PASS, 20 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.staging.kernelci.org/kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/sleep-peach-pi.txt
  HTML log:    https://storage.staging.kernelci.org/kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/sleep-peach-pi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster/20201002.0/armhf/rootfs.cpio.gz 

  * sleep.rtcwake-mem-1: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d2
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:47.853000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:54 2020
    2020-10-05 16:45:47.876000  <6>[   15.413041] PM: suspend entry (deep)
    2020-10-05 16:45:47.876000  <6>[   15.415535] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:47.888000  <6>[   15.421293] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:47.888000  <6>[   15.428995] OOM killer disabled.
    2020-10-05 16:45:47.900000  <6>[   15.432493] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:47.905000  <6>[   15.440098] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:49.344000  <3>[   15.530601] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:49.344000  <6>[   15.536758] wake enabled for irq 179
    2020-10-05 16:45:49.354000  <6>[   15.658726] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (36 line(s) more)  

  * sleep.rtcwake-mem-2: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d3
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:49.580000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:56 2020
    2020-10-05 16:45:49.602000  <6>[   17.073195] OOM killer enabled.
    2020-10-05 16:45:49.602000  <6>[   17.073199] Restarting tasks ... done.
    2020-10-05 16:45:49.602000  <6>[   17.077623] PM: suspend exit
    2020-10-05 16:45:49.614000  <6>[   17.140255] PM: suspend entry (deep)
    2020-10-05 16:45:49.615000  <6>[   17.149100] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:49.623000  <6>[   17.154686] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:49.623000  <6>[   17.162376] OOM killer disabled.
    2020-10-05 16:45:49.662000  <6>[   17.165796] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:45:49.668000  <6>[   17.203039] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (37 line(s) more)  

  * sleep.rtcwake-mem-3: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d4
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:51.253000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:57 2020
    2020-10-05 16:45:51.274000  <6>[   18.811254] PM: suspend entry (deep)
    2020-10-05 16:45:51.275000  <6>[   18.813866] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:51.288000  <6>[   18.820001] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:51.289000  <6>[   18.827860] OOM killer disabled.
    2020-10-05 16:45:51.334000  <6>[   18.831327] Freezing remaining freezable tasks ... (elapsed 0.037 seconds) done.
    2020-10-05 16:45:51.340000  <6>[   18.875153] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:52.623000  <3>[   18.956756] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:52.624000  <6>[   18.961841] wake enabled for irq 179
    2020-10-05 16:45:52.634000  <6>[   19.075245] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-4: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d5
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:52.824000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:59 2020
    2020-10-05 16:45:52.842000  <6>[   20.378531] PM: suspend entry (deep)
    2020-10-05 16:45:52.843000  <6>[   20.381084] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:52.855000  <6>[   20.387457] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:52.855000  <6>[   20.395548] OOM killer disabled.
    2020-10-05 16:45:52.905000  <6>[   20.398961] Freezing remaining freezable tasks ... (elapsed 0.040 seconds) done.
    2020-10-05 16:45:52.911000  <6>[   20.446146] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:54.325000  <3>[   20.546842] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:54.326000  <6>[   20.552490] wake enabled for irq 179
    2020-10-05 16:45:54.337000  <6>[   20.666365] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (31 line(s) more)  

  * sleep.rtcwake-mem-5: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d6
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:54.516000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:00 2020
    2020-10-05 16:45:54.554000  <6>[   22.022221] OOM killer enabled.
    2020-10-05 16:45:54.555000  <6>[   22.022224] Restarting tasks ... done.
    2020-10-05 16:45:54.555000  <6>[   22.026751] PM: suspend exit
    2020-10-05 16:45:54.565000  <6>[   22.075559] PM: suspend entry (deep)
    2020-10-05 16:45:54.565000  <6>[   22.075688] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:54.573000  <6>[   22.077536] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:54.574000  <6>[   22.079995] OOM killer disabled.
    2020-10-05 16:45:54.597000  <6>[   22.080002] Freezing remaining freezable tasks ... (elapsed 0.052 seconds) done.
    2020-10-05 16:45:54.603000  <6>[   22.138251] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (37 line(s) more)  

  * sleep.rtcwake-mem-6: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d7
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:56.080000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:02 2020
    2020-10-05 16:45:56.098000  <6>[   23.635112] PM: suspend entry (deep)
    2020-10-05 16:45:56.098000  <6>[   23.637734] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:56.113000  <6>[   23.644788] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:56.113000  <6>[   23.653326] OOM killer disabled.
    2020-10-05 16:45:56.155000  <6>[   23.656678] Freezing remaining freezable tasks ... (elapsed 0.033 seconds) done.
    2020-10-05 16:45:56.161000  <6>[   23.696068] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:57.552000  <3>[   23.785635] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:57.552000  <6>[   23.791555] wake enabled for irq 179
    2020-10-05 16:45:57.563000  <6>[   23.907769] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (31 line(s) more)  

  * sleep.rtcwake-mem-7: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d8
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:57.754000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:04 2020
    2020-10-05 16:45:57.754000  <6>[   25.248490] OOM killer enabled.
    2020-10-05 16:45:57.760000  <6>[   25.248495] Restarting tasks ... done.
    2020-10-05 16:45:57.760000  <6>[   25.253053] PM: suspend exit
    2020-10-05 16:45:57.774000  <6>[   25.309245] PM: suspend entry (deep)
    2020-10-05 16:45:57.774000  <6>[   25.311735] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:57.785000  <6>[   25.317767] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:57.785000  <6>[   25.325524] OOM killer disabled.
    2020-10-05 16:45:57.824000  <6>[   25.328955] Freezing remaining freezable tasks ... (elapsed 0.029 seconds) done.
    2020-10-05 16:45:57.830000  <6>[   25.364723] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-8: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d9
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:59.309000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:05 2020
    2020-10-05 16:45:59.334000  <6>[   26.809355] OOM killer enabled.
    2020-10-05 16:45:59.334000  <6>[   26.809359] Restarting tasks ... done.
    2020-10-05 16:45:59.335000  <6>[   26.813856] PM: suspend exit
    2020-10-05 16:45:59.342000  <6>[   26.868299] PM: suspend entry (deep)
    2020-10-05 16:45:59.342000  <6>[   26.868418] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:59.355000  <6>[   26.887060] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:59.355000  <6>[   26.894864] OOM killer disabled.
    2020-10-05 16:45:59.388000  <6>[   26.898278] Freezing remaining freezable tasks ... (elapsed 0.024 seconds) done.
    2020-10-05 16:45:59.394000  <6>[   26.928926] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-9: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4da
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:01.021000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:07 2020
    2020-10-05 16:46:01.054000  <6>[   28.527499] OOM killer enabled.
    2020-10-05 16:46:01.055000  <6>[   28.527502] Restarting tasks ... done.
    2020-10-05 16:46:01.055000  <6>[   28.532058] PM: suspend exit
    2020-10-05 16:46:01.065000  <6>[   28.580312] PM: suspend entry (deep)
    2020-10-05 16:46:01.065000  <6>[   28.580459] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:01.074000  <6>[   28.582100] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:01.074000  <6>[   28.584300] OOM killer disabled.
    2020-10-05 16:46:01.105000  <6>[   28.584312] Freezing remaining freezable tasks ... (elapsed 0.054 seconds) done.
    2020-10-05 16:46:01.111000  <6>[   28.645630] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-10: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4db
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:02.643000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:09 2020
    2020-10-05 16:46:02.771000  <6>[   30.128540] OOM killer enabled.
    2020-10-05 16:46:02.771000  <6>[   30.128544] Restarting tasks ... done.
    2020-10-05 16:46:02.771000  <6>[   30.133020] PM: suspend exit
    2020-10-05 16:46:02.776000  <6>[   30.202670] PM: suspend entry (deep)
    2020-10-05 16:46:02.788000  <6>[   30.202936] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:02.788000  <6>[   30.205579] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:02.799000  <6>[   30.208204] OOM killer disabled.
    2020-10-05 16:46:02.799000  <6>[   30.208218] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:46:02.805000  <6>[   30.238863] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-freeze-1: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4dc
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:04.311000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:10 2020
    2020-10-05 16:46:04.325000  <6>[   31.810526] OOM killer enabled.
    2020-10-05 16:46:04.325000  <6>[   31.810530] Restarting tasks ... done.
    2020-10-05 16:46:04.325000  <6>[   31.814884] PM: suspend exit
    2020-10-05 16:46:04.334000  <6>[   31.870087] PM: suspend entry (s2idle)
    2020-10-05 16:46:04.334000  <6>[   31.872756] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:04.346000  <6>[   31.878383] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:04.346000  <6>[   31.886148] OOM killer disabled.
    2020-10-05 16:46:04.393000  <6>[   31.889552] Freezing remaining freezable tasks ... (elapsed 0.037 seconds) done.
    2020-10-05 16:46:04.399000  <6>[   31.933509] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-2: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4dd
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:05.822000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:12 2020
    2020-10-05 16:46:05.845000  <6>[   33.381693] PM: suspend entry (s2idle)
    2020-10-05 16:46:05.845000  <6>[   33.384390] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:05.858000  <6>[   33.389948] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:05.858000  <6>[   33.397871] OOM killer disabled.
    2020-10-05 16:46:05.899000  <6>[   33.401338] Freezing remaining freezable tasks ... (elapsed 0.032 seconds) done.
    2020-10-05 16:46:05.905000  <6>[   33.440162] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:07.282000  <3>[   33.527768] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:07.282000  <6>[   33.533287] wake enabled for irq 179
    2020-10-05 16:46:07.293000  <6>[   33.646495] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-3: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4de
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:07.406000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:13 2020
    2020-10-05 16:46:07.418000  <6>[   34.913195] OOM killer enabled.
    2020-10-05 16:46:07.418000  <6>[   34.913201] Restarting tasks ... done.
    2020-10-05 16:46:07.418000  <6>[   34.917587] PM: suspend exit
    2020-10-05 16:46:07.429000  <6>[   34.965300] PM: suspend entry (s2idle)
    2020-10-05 16:46:07.429000  <6>[   34.967965] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:07.442000  <6>[   34.973602] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:07.442000  <6>[   34.981282] OOM killer disabled.
    2020-10-05 16:46:07.490000  <6>[   34.984800] Freezing remaining freezable tasks ... (elapsed 0.040 seconds) done.
    2020-10-05 16:46:07.495000  <6>[   35.031183] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-5: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e0
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:10.455000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:16 2020
    2020-10-05 16:46:10.471000  <6>[   37.963955] OOM killer enabled.
    2020-10-05 16:46:10.472000  <6>[   37.963971] Restarting tasks ... done.
    2020-10-05 16:46:10.472000  <6>[   37.969118] PM: suspend exit
    2020-10-05 16:46:10.481000  <6>[   38.013709] PM: suspend entry (s2idle)
    2020-10-05 16:46:10.481000  <6>[   38.019804] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:10.494000  <6>[   38.025734] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:10.494000  <6>[   38.033760] OOM killer disabled.
    2020-10-05 16:46:10.542000  <6>[   38.037177] Freezing remaining freezable tasks ... (elapsed 0.039 seconds) done.
    2020-10-05 16:46:10.549000  <6>[   38.083279] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (55 line(s) more)  

  * sleep.rtcwake-freeze-7: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e2
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:13.819000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:20 2020
    2020-10-05 16:46:13.842000  <6>[   41.377565] PM: suspend entry (s2idle)
    2020-10-05 16:46:13.842000  <6>[   41.380200] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:13.854000  <6>[   41.386300] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:13.855000  <6>[   41.394552] OOM killer disabled.
    2020-10-05 16:46:13.895000  <6>[   41.397928] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:46:13.900000  <6>[   41.435130] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:15.213000  <3>[   41.536006] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:15.213000  <6>[   41.542420] wake enabled for irq 179
    2020-10-05 16:46:15.233000  <6>[   41.658288] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-8: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e3
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:15.330000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:21 2020
    2020-10-05 16:46:15.348000  <6>[   42.843338] OOM killer enabled.
    2020-10-05 16:46:15.348000  <6>[   42.843360] Restarting tasks ... done.
    2020-10-05 16:46:15.348000  <6>[   42.849217] PM: suspend exit
    2020-10-05 16:46:15.357000  <6>[   42.890158] PM: suspend entry (s2idle)
    2020-10-05 16:46:15.357000  <6>[   42.895617] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:15.370000  <6>[   42.902119] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:15.371000  <6>[   42.910582] OOM killer disabled.
    2020-10-05 16:46:15.417000  <6>[   42.914170] Freezing remaining freezable tasks ... (elapsed 0.038 seconds) done.
    2020-10-05 16:46:15.423000  <6>[   42.958694] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-9: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e4
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:17.005000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:23 2020
    2020-10-05 16:46:17.028000  <6>[   44.564646] PM: suspend entry (s2idle)
    2020-10-05 16:46:17.029000  <6>[   44.567355] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:17.042000  <6>[   44.573508] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:17.042000  <6>[   44.581382] OOM killer disabled.
    2020-10-05 16:46:17.082000  <6>[   44.584895] Freezing remaining freezable tasks ... (elapsed 0.031 seconds) done.
    2020-10-05 16:46:17.087000  <6>[   44.622991] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:18.383000  <3>[   44.706564] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:18.383000  <6>[   44.712668] wake enabled for irq 179
    2020-10-05 16:46:18.394000  <6>[   44.828101] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-10: https://staging.kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e5
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:18.501000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:24 2020
    2020-10-05 16:46:18.513000  <6>[   46.013365] OOM killer enabled.
    2020-10-05 16:46:18.513000  <6>[   46.013387] Restarting tasks ... done.
    2020-10-05 16:46:18.514000  <6>[   46.019454] PM: suspend exit
    2020-10-05 16:46:18.527000  <6>[   46.060630] PM: suspend entry (s2idle)
    2020-10-05 16:46:18.527000  <6>[   46.063260] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:18.536000  <6>[   46.068659] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:18.536000  <6>[   46.076207] OOM killer disabled.
    2020-10-05 16:46:18.591000  <6>[   46.079614] Freezing remaining freezable tasks ... (elapsed 0.046 seconds) done.
    2020-10-05 16:46:18.597000  <6>[   46.132940] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (17 line(s) more)  

platform         | arch  | lab           | compiler | defconfig          | results
-----------------+-------+---------------+----------+--------------------+--------
rk3399-gru-kevin | arm64 | lab-collabora | gcc-8    | defconfig          | 10/12  

  Details:     https://staging.kernelci.org/test/plan/id/5f7b4de85c109f49e2e8d4e7

  Results:     10 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.staging.kernelci.org/kernelci/staging-next/staging-next-20201005.0/arm64/defconfig/gcc-8/lab-collabora/sleep-rk3399-gru-kevin.txt
  HTML log:    https://storage.staging.kernelci.org/kernelci/staging-next/staging-next-20201005.0/arm64/defconfig/gcc-8/lab-collabora/sleep-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster/20201002.0/arm64/rootfs.cpio.gz 

  * sleep.rtcwake-mem-5: https://staging.kernelci.org/test/case/id/5f7b4de85c109f49e2e8d4ee
        new failure (last pass: staging-next-20201004.0) 

  * sleep.rtcwake-mem-7: https://staging.kernelci.org/test/case/id/5f7b4de85c109f49e2e8d4f0
        new failure (last pass: staging-next-20201004.0)

    2020-10-05 16:42:23.466000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 15:07:18 2020
    2020-10-05 16:42:23.484000  <6>[   62.156536] PM: suspend entry (deep)
    2020-10-05 16:42:23.498000  <6>[   62.170776] Filesystems sync: 0.000 seconds
    2020-10-05 16:42:24.303000  <6>[   62.184874] Freezing user space processes ... (elapsed 0.786 seconds) done.
    2020-10-05 16:42:24.315000  <6>[   62.987964] OOM killer disabled.
    2020-10-05 16:42:24.336000  <6>[   63.003098] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
    2020-10-05 16:42:24.352000  <6>[   63.021848] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:42:29.905000    <3>[   63.660893] mwifiex_pcie 0000:01:00.0: adapter is not valid
    2020-10-05 16:42:29.920000  <3>[   63.894110] cros-ec-spi spi2.0: spi transfer failed: -108
    2020-10-05 16:42:29.939000  <3>[   63.894118] cros-ec-spi spi2.0: cs-deassert spi transfer failed: -108 
    ... (1091 line(s) more)

After

kernelci/staging-next sleep: 13 runs, 21 regressions (staging-next-20201005.0)

Regressions Summary
-------------------

platform          | arch  | lab           | compiler | defconfig          | regressions
------------------+-------+---------------+----------+--------------------+------------
peach-pi          | arm   | lab-collabora | gcc-8    | multi_v7_defconfig | 18         
rk3288-veyron-jaq | arm   | lab-collabora | clang-11 | multi_v7_defconfig | 1          
rk3399-gru-kevin  | arm64 | lab-collabora | gcc-8    | defconfig          | 2          

  Details:  https://kernelci.org/test/job/kernelci/branch/staging-next/kernel/staging-next-20201005.0/plan/sleep/

  Test:     sleep
  Tree:     kernelci
  Branch:   staging-next
  Describe: staging-next-20201005.0
  URL:      https://github.com/kernelci/linux.git
  SHA:      c47842e45f40c2cf39a3a667fb122a4abd30bd24 

Test Regressions
---------------- 

platform          | arch  | lab           | compiler | defconfig          | regressions
------------------+-------+---------------+----------+--------------------+------------
peach-pi          | arm   | lab-collabora | gcc-8    | multi_v7_defconfig | 18         

  Details:     https://kernelci.org/test/plan/id/5f7b4de05c109f49e2e8d4cf

  Results:     2 PASS, 20 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/sleep-peach-pi.txt
  HTML log:    https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/sleep-peach-pi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster/20201002.0/armhf/rootfs.cpio.gz 

  * sleep.rtcwake-mem-1: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d2
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:47.853000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:54 2020
    2020-10-05 16:45:47.876000  <6>[   15.413041] PM: suspend entry (deep)
    2020-10-05 16:45:47.876000  <6>[   15.415535] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:47.888000  <6>[   15.421293] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:47.888000  <6>[   15.428995] OOM killer disabled.
    2020-10-05 16:45:47.900000  <6>[   15.432493] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:47.905000  <6>[   15.440098] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:49.344000  <3>[   15.530601] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:49.344000  <6>[   15.536758] wake enabled for irq 179
    2020-10-05 16:45:49.354000  <6>[   15.658726] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (36 line(s) more)  

  * sleep.rtcwake-mem-2: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d3
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:49.580000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:56 2020
    2020-10-05 16:45:49.602000  <6>[   17.073195] OOM killer enabled.
    2020-10-05 16:45:49.602000  <6>[   17.073199] Restarting tasks ... done.
    2020-10-05 16:45:49.602000  <6>[   17.077623] PM: suspend exit
    2020-10-05 16:45:49.614000  <6>[   17.140255] PM: suspend entry (deep)
    2020-10-05 16:45:49.615000  <6>[   17.149100] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:49.623000  <6>[   17.154686] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:49.623000  <6>[   17.162376] OOM killer disabled.
    2020-10-05 16:45:49.662000  <6>[   17.165796] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:45:49.668000  <6>[   17.203039] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (37 line(s) more)  

  * sleep.rtcwake-mem-3: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d4
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:51.253000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:57 2020
    2020-10-05 16:45:51.274000  <6>[   18.811254] PM: suspend entry (deep)
    2020-10-05 16:45:51.275000  <6>[   18.813866] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:51.288000  <6>[   18.820001] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:51.289000  <6>[   18.827860] OOM killer disabled.
    2020-10-05 16:45:51.334000  <6>[   18.831327] Freezing remaining freezable tasks ... (elapsed 0.037 seconds) done.
    2020-10-05 16:45:51.340000  <6>[   18.875153] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:52.623000  <3>[   18.956756] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:52.624000  <6>[   18.961841] wake enabled for irq 179
    2020-10-05 16:45:52.634000  <6>[   19.075245] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-4: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d5
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:52.824000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:45:59 2020
    2020-10-05 16:45:52.842000  <6>[   20.378531] PM: suspend entry (deep)
    2020-10-05 16:45:52.843000  <6>[   20.381084] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:52.855000  <6>[   20.387457] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:52.855000  <6>[   20.395548] OOM killer disabled.
    2020-10-05 16:45:52.905000  <6>[   20.398961] Freezing remaining freezable tasks ... (elapsed 0.040 seconds) done.
    2020-10-05 16:45:52.911000  <6>[   20.446146] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:54.325000  <3>[   20.546842] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:54.326000  <6>[   20.552490] wake enabled for irq 179
    2020-10-05 16:45:54.337000  <6>[   20.666365] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (31 line(s) more)  

  * sleep.rtcwake-mem-5: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d6
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:54.516000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:00 2020
    2020-10-05 16:45:54.554000  <6>[   22.022221] OOM killer enabled.
    2020-10-05 16:45:54.555000  <6>[   22.022224] Restarting tasks ... done.
    2020-10-05 16:45:54.555000  <6>[   22.026751] PM: suspend exit
    2020-10-05 16:45:54.565000  <6>[   22.075559] PM: suspend entry (deep)
    2020-10-05 16:45:54.565000  <6>[   22.075688] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:54.573000  <6>[   22.077536] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:54.574000  <6>[   22.079995] OOM killer disabled.
    2020-10-05 16:45:54.597000  <6>[   22.080002] Freezing remaining freezable tasks ... (elapsed 0.052 seconds) done.
    2020-10-05 16:45:54.603000  <6>[   22.138251] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (37 line(s) more)  

  * sleep.rtcwake-mem-6: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d7
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:56.080000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:02 2020
    2020-10-05 16:45:56.098000  <6>[   23.635112] PM: suspend entry (deep)
    2020-10-05 16:45:56.098000  <6>[   23.637734] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:56.113000  <6>[   23.644788] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:45:56.113000  <6>[   23.653326] OOM killer disabled.
    2020-10-05 16:45:56.155000  <6>[   23.656678] Freezing remaining freezable tasks ... (elapsed 0.033 seconds) done.
    2020-10-05 16:45:56.161000  <6>[   23.696068] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:45:57.552000  <3>[   23.785635] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:45:57.552000  <6>[   23.791555] wake enabled for irq 179
    2020-10-05 16:45:57.563000  <6>[   23.907769] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (31 line(s) more)  

  * sleep.rtcwake-mem-7: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d8
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:57.754000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:04 2020
    2020-10-05 16:45:57.754000  <6>[   25.248490] OOM killer enabled.
    2020-10-05 16:45:57.760000  <6>[   25.248495] Restarting tasks ... done.
    2020-10-05 16:45:57.760000  <6>[   25.253053] PM: suspend exit
    2020-10-05 16:45:57.774000  <6>[   25.309245] PM: suspend entry (deep)
    2020-10-05 16:45:57.774000  <6>[   25.311735] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:57.785000  <6>[   25.317767] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:57.785000  <6>[   25.325524] OOM killer disabled.
    2020-10-05 16:45:57.824000  <6>[   25.328955] Freezing remaining freezable tasks ... (elapsed 0.029 seconds) done.
    2020-10-05 16:45:57.830000  <6>[   25.364723] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-8: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4d9
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:45:59.309000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:05 2020
    2020-10-05 16:45:59.334000  <6>[   26.809355] OOM killer enabled.
    2020-10-05 16:45:59.334000  <6>[   26.809359] Restarting tasks ... done.
    2020-10-05 16:45:59.335000  <6>[   26.813856] PM: suspend exit
    2020-10-05 16:45:59.342000  <6>[   26.868299] PM: suspend entry (deep)
    2020-10-05 16:45:59.342000  <6>[   26.868418] Filesystems sync: 0.000 seconds
    2020-10-05 16:45:59.355000  <6>[   26.887060] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:45:59.355000  <6>[   26.894864] OOM killer disabled.
    2020-10-05 16:45:59.388000  <6>[   26.898278] Freezing remaining freezable tasks ... (elapsed 0.024 seconds) done.
    2020-10-05 16:45:59.394000  <6>[   26.928926] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-9: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4da
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:01.021000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:07 2020
    2020-10-05 16:46:01.054000  <6>[   28.527499] OOM killer enabled.
    2020-10-05 16:46:01.055000  <6>[   28.527502] Restarting tasks ... done.
    2020-10-05 16:46:01.055000  <6>[   28.532058] PM: suspend exit
    2020-10-05 16:46:01.065000  <6>[   28.580312] PM: suspend entry (deep)
    2020-10-05 16:46:01.065000  <6>[   28.580459] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:01.074000  <6>[   28.582100] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:01.074000  <6>[   28.584300] OOM killer disabled.
    2020-10-05 16:46:01.105000  <6>[   28.584312] Freezing remaining freezable tasks ... (elapsed 0.054 seconds) done.
    2020-10-05 16:46:01.111000  <6>[   28.645630] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-mem-10: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4db
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:02.643000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 16:46:09 2020
    2020-10-05 16:46:02.771000  <6>[   30.128540] OOM killer enabled.
    2020-10-05 16:46:02.771000  <6>[   30.128544] Restarting tasks ... done.
    2020-10-05 16:46:02.771000  <6>[   30.133020] PM: suspend exit
    2020-10-05 16:46:02.776000  <6>[   30.202670] PM: suspend entry (deep)
    2020-10-05 16:46:02.788000  <6>[   30.202936] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:02.788000  <6>[   30.205579] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:02.799000  <6>[   30.208204] OOM killer disabled.
    2020-10-05 16:46:02.799000  <6>[   30.208218] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:46:02.805000  <6>[   30.238863] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (34 line(s) more)  

  * sleep.rtcwake-freeze-1: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4dc
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:04.311000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:10 2020
    2020-10-05 16:46:04.325000  <6>[   31.810526] OOM killer enabled.
    2020-10-05 16:46:04.325000  <6>[   31.810530] Restarting tasks ... done.
    2020-10-05 16:46:04.325000  <6>[   31.814884] PM: suspend exit
    2020-10-05 16:46:04.334000  <6>[   31.870087] PM: suspend entry (s2idle)
    2020-10-05 16:46:04.334000  <6>[   31.872756] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:04.346000  <6>[   31.878383] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:04.346000  <6>[   31.886148] OOM killer disabled.
    2020-10-05 16:46:04.393000  <6>[   31.889552] Freezing remaining freezable tasks ... (elapsed 0.037 seconds) done.
    2020-10-05 16:46:04.399000  <6>[   31.933509] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-2: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4dd
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:05.822000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:12 2020
    2020-10-05 16:46:05.845000  <6>[   33.381693] PM: suspend entry (s2idle)
    2020-10-05 16:46:05.845000  <6>[   33.384390] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:05.858000  <6>[   33.389948] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:05.858000  <6>[   33.397871] OOM killer disabled.
    2020-10-05 16:46:05.899000  <6>[   33.401338] Freezing remaining freezable tasks ... (elapsed 0.032 seconds) done.
    2020-10-05 16:46:05.905000  <6>[   33.440162] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:07.282000  <3>[   33.527768] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:07.282000  <6>[   33.533287] wake enabled for irq 179
    2020-10-05 16:46:07.293000  <6>[   33.646495] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-3: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4de
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:07.406000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:13 2020
    2020-10-05 16:46:07.418000  <6>[   34.913195] OOM killer enabled.
    2020-10-05 16:46:07.418000  <6>[   34.913201] Restarting tasks ... done.
    2020-10-05 16:46:07.418000  <6>[   34.917587] PM: suspend exit
    2020-10-05 16:46:07.429000  <6>[   34.965300] PM: suspend entry (s2idle)
    2020-10-05 16:46:07.429000  <6>[   34.967965] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:07.442000  <6>[   34.973602] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:07.442000  <6>[   34.981282] OOM killer disabled.
    2020-10-05 16:46:07.490000  <6>[   34.984800] Freezing remaining freezable tasks ... (elapsed 0.040 seconds) done.
    2020-10-05 16:46:07.495000  <6>[   35.031183] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-5: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e0
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:10.455000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:16 2020
    2020-10-05 16:46:10.471000  <6>[   37.963955] OOM killer enabled.
    2020-10-05 16:46:10.472000  <6>[   37.963971] Restarting tasks ... done.
    2020-10-05 16:46:10.472000  <6>[   37.969118] PM: suspend exit
    2020-10-05 16:46:10.481000  <6>[   38.013709] PM: suspend entry (s2idle)
    2020-10-05 16:46:10.481000  <6>[   38.019804] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:10.494000  <6>[   38.025734] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:10.494000  <6>[   38.033760] OOM killer disabled.
    2020-10-05 16:46:10.542000  <6>[   38.037177] Freezing remaining freezable tasks ... (elapsed 0.039 seconds) done.
    2020-10-05 16:46:10.549000  <6>[   38.083279] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (55 line(s) more)  

  * sleep.rtcwake-freeze-7: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e2
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:13.819000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:20 2020
    2020-10-05 16:46:13.842000  <6>[   41.377565] PM: suspend entry (s2idle)
    2020-10-05 16:46:13.842000  <6>[   41.380200] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:13.854000  <6>[   41.386300] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:13.855000  <6>[   41.394552] OOM killer disabled.
    2020-10-05 16:46:13.895000  <6>[   41.397928] Freezing remaining freezable tasks ... (elapsed 0.030 seconds) done.
    2020-10-05 16:46:13.900000  <6>[   41.435130] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:15.213000  <3>[   41.536006] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:15.213000  <6>[   41.542420] wake enabled for irq 179
    2020-10-05 16:46:15.233000  <6>[   41.658288] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-8: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e3
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:15.330000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:21 2020
    2020-10-05 16:46:15.348000  <6>[   42.843338] OOM killer enabled.
    2020-10-05 16:46:15.348000  <6>[   42.843360] Restarting tasks ... done.
    2020-10-05 16:46:15.348000  <6>[   42.849217] PM: suspend exit
    2020-10-05 16:46:15.357000  <6>[   42.890158] PM: suspend entry (s2idle)
    2020-10-05 16:46:15.357000  <6>[   42.895617] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:15.370000  <6>[   42.902119] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:15.371000  <6>[   42.910582] OOM killer disabled.
    2020-10-05 16:46:15.417000  <6>[   42.914170] Freezing remaining freezable tasks ... (elapsed 0.038 seconds) done.
    2020-10-05 16:46:15.423000  <6>[   42.958694] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (20 line(s) more)  

  * sleep.rtcwake-freeze-9: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e4
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:17.005000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:23 2020
    2020-10-05 16:46:17.028000  <6>[   44.564646] PM: suspend entry (s2idle)
    2020-10-05 16:46:17.029000  <6>[   44.567355] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:17.042000  <6>[   44.573508] Freezing user space processes ... (elapsed 0.002 seconds) done.
    2020-10-05 16:46:17.042000  <6>[   44.581382] OOM killer disabled.
    2020-10-05 16:46:17.082000  <6>[   44.584895] Freezing remaining freezable tasks ... (elapsed 0.031 seconds) done.
    2020-10-05 16:46:17.087000  <6>[   44.622991] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:46:18.383000  <3>[   44.706564] mwifiex_sdio mmc2:0001:1: adapter is not valid
    2020-10-05 16:46:18.383000  <6>[   44.712668] wake enabled for irq 179
    2020-10-05 16:46:18.394000  <6>[   44.828101] smsc95xx 1-1.1:1.0 eth0: entering SUSPEND2 mode 
    ... (14 line(s) more)  

  * sleep.rtcwake-freeze-10: https://kernelci.org/test/case/id/5f7b4de05c109f49e2e8d4e5
        failing since 0 day (last pass: staging-next-20201003.0, first fail: staging-next-20201004.0)

    2020-10-05 16:46:18.501000  rtcwake: wakeup from \"freeze\" using rtc0 at Mon Oct  5 16:46:24 2020
    2020-10-05 16:46:18.513000  <6>[   46.013365] OOM killer enabled.
    2020-10-05 16:46:18.513000  <6>[   46.013387] Restarting tasks ... done.
    2020-10-05 16:46:18.514000  <6>[   46.019454] PM: suspend exit
    2020-10-05 16:46:18.527000  <6>[   46.060630] PM: suspend entry (s2idle)
    2020-10-05 16:46:18.527000  <6>[   46.063260] Filesystems sync: 0.000 seconds
    2020-10-05 16:46:18.536000  <6>[   46.068659] Freezing user space processes ... (elapsed 0.001 seconds) done.
    2020-10-05 16:46:18.536000  <6>[   46.076207] OOM killer disabled.
    2020-10-05 16:46:18.591000  <6>[   46.079614] Freezing remaining freezable tasks ... (elapsed 0.046 seconds) done.
    2020-10-05 16:46:18.597000  <6>[   46.132940] printk: Suspending console(s) (use no_console_suspend to debug) 
    ... (17 line(s) more)  

platform          | arch  | lab           | compiler | defconfig          | regressions
------------------+-------+---------------+----------+--------------------+------------
rk3288-veyron-jaq | arm   | lab-collabora | clang-11 | multi_v7_defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/5f7b5e9851656d1207e8d442

  Results:     21 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-11 (Debian clang version 11.0.0-++20200827022622+522d80ab553-1~exp1~20200827123237.67)
  Plain log:   https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/clang-11/lab-collabora/sleep-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm/multi_v7_defconfig/clang-11/lab-collabora/sleep-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster/20201002.0/armhf/rootfs.cpio.gz 

  * sleep.rtcwake-freeze-10: https://kernelci.org/test/case/id/5f7b5e9851656d1207e8d458
        new failure (last pass: staging-next-20201004.0)

    2020-10-05 17:57:38.090000  <6>[   96.332504] usb 2-1: new high-speed USB device number 22 using dwc2
    2020-10-05 17:57:38.309000  <3>[   96.552503] rk3x-i2c ff650000.i2c: timeout, ipd: 0x00, state: 3
    2020-10-05 17:57:38.347000  <6>[   96.592972] hub 2-1:1.0: USB hub found
    2020-10-05 17:57:38.353000  <6>[   96.600253] hub 2-1:1.0: 5 ports detected
    2020-10-05 17:57:38.366000  <3>[   96.609630] rockchip-snd-max98090 sound: Soc register card failed -517
    2020-10-05 17:57:38.680000  <6>[   96.922503] usb 2-1.1: new high-speed USB device number 23 using dwc2
    2020-10-05 17:57:38.817000  <6>[   97.065249] smsc95xx v2.0.0
    2020-10-05 17:57:38.897000  <6>[   97.142549] libphy: smsc95xx-mdiobus: probed
    2020-10-05 17:57:38.908000  <3>[   97.151577] rockchip-snd-max98090 sound: Soc register card failed -517
    2020-10-05 17:57:38.936000  <6>[   97.162428] smsc95xx 2-1.1:1.0 eth0: register 'smsc95xx' at usb-ff580000.usb-1.1, smsc95xx USB 2.0 Ethernet, 94:eb:2c:00:03:cf 
    ... (5 line(s) more)  

platform          | arch  | lab           | compiler | defconfig          | regressions
------------------+-------+---------------+----------+--------------------+------------
rk3399-gru-kevin  | arm64 | lab-collabora | gcc-8    | defconfig          | 2          

  Details:     https://kernelci.org/test/plan/id/5f7b4de85c109f49e2e8d4e7

  Results:     10 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm64/defconfig/gcc-8/lab-collabora/sleep-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//kernelci/staging-next/staging-next-20201005.0/arm64/defconfig/gcc-8/lab-collabora/sleep-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster/20201002.0/arm64/rootfs.cpio.gz 

  * sleep.rtcwake-mem-5: https://kernelci.org/test/case/id/5f7b4de85c109f49e2e8d4ee
        new failure (last pass: staging-next-20201004.0) 

  * sleep.rtcwake-mem-7: https://kernelci.org/test/case/id/5f7b4de85c109f49e2e8d4f0
        new failure (last pass: staging-next-20201004.0)

    2020-10-05 16:42:23.466000  rtcwake: wakeup from \"mem\" using rtc0 at Mon Oct  5 15:07:18 2020
    2020-10-05 16:42:23.484000  <6>[   62.156536] PM: suspend entry (deep)
    2020-10-05 16:42:23.498000  <6>[   62.170776] Filesystems sync: 0.000 seconds
    2020-10-05 16:42:24.303000  <6>[   62.184874] Freezing user space processes ... (elapsed 0.786 seconds) done.
    2020-10-05 16:42:24.315000  <6>[   62.987964] OOM killer disabled.
    2020-10-05 16:42:24.336000  <6>[   63.003098] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
    2020-10-05 16:42:24.352000  <6>[   63.021848] printk: Suspending console(s) (use no_console_suspend to debug)
    2020-10-05 16:42:29.905000  <3>[   63.660893] mwifiex_pcie 0000:01:00.0: adapter is not valid
    2020-10-05 16:42:29.920000  <3>[   63.894110] cros-ec-spi spi2.0: spi transfer failed: -108
    2020-10-05 16:42:29.939000  <3>[   63.894118] cros-ec-spi spi2.0: cs-deassert spi transfer failed: -108 
    ... (1091 line(s) more)
gctucker commented 4 years ago

LGTM, waiting for some staging email reports to confirm. That's a pretty verbose example btw ;)

mgalka commented 4 years ago

Tested on staging.

kernelci/staging-mainline igt-kms-rockchip: 3 runs, 1 regressions (staging-mainline-20201007.0)

Regressions Summary
-------------------

platform         | arch  | lab           | compiler | defconfig | regressions
-----------------+-------+---------------+----------+-----------+------------
rk3399-gru-kevin | arm64 | lab-collabora | gcc-8    | defconfig | 1          

  Details:  https://staging.kernelci.org/test/job/kernelci/branch/staging-mainline/kernel/staging-mainline-20201007.0/plan/igt-kms-rockchip/

  Test:     igt-kms-rockchip
  Tree:     kernelci
  Branch:   staging-mainline
  Describe: staging-mainline-20201007.0
  URL:      https://github.com/kernelci/linux.git
  SHA:      3e449a144753b4302c916ec55745cdd98fcc9822

  Test suite revisions:
    drm
      URL:  git://anongit.freedesktop.org/mesa/drm
      SHA:  77687f8d6ea321998b87f87433db1fea7518b8bf
    igt-gpu-tools
      URL:  https://gitlab.freedesktop.org/drm/igt-gpu-tools.git
      SHA:  1a7ef7eb5e99c9a8f4ffbc13cdae399a01a9aa12 

Test Regressions
---------------- 

platform         | arch  | lab           | compiler | defconfig | regressions
-----------------+-------+---------------+----------+-----------+------------
rk3399-gru-kevin | arm64 | lab-collabora | gcc-8    | defconfig | 1          

  Details:     https://staging.kernelci.org/test/plan/id/5f7d0e089f6c330718516fd8

  Results:     68 PASS, 18 FAIL, 26 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.staging.kernelci.org/kernelci/staging-mainline/staging-mainline-20201007.0/arm64/defconfig/gcc-8/lab-collabora/igt-kms-rockchip-rk3399-gru-kevin.txt
  HTML log:    https://storage.staging.kernelci.org/kernelci/staging-mainline/staging-mainline-20201007.0/arm64/defconfig/gcc-8/lab-collabora/igt-kms-rockchip-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/debian/buster-igt/20201002.0/arm64/rootfs.cpio.gz 

  * igt-kms-rockchip.kms_vblank.pipe-A-ts-continuation-dpms-suspend: https://staging.kernelci.org/test/case/id/5f7d0e089f6c330718517048
        new failure (last pass: staging-mainline-20201005.0)

    2020-10-07 00:31:03.261000  t in function igt_require_pipe, file ../lib/igt_kms.c:1908:
    2020-10-07 00:31:03.266000  Test requirement: !(!display->pipes[pipe].enabled)
    2020-10-07 00:31:03.270000  Pipe F does not exist or not enabled
    2020-10-07 00:31:03.292000  <6>[   69.337186] Console: switching to colour dummy device 80x25
    2020-10-07 00:31:03.297000  <14>[   69.344256] [IGT] kms_vblank: executing
    2020-10-07 00:31:03.312000  IGT-Version: 1.25-g1a7ef7e (aarch64) (Linux: 5.9.0-rc8 aarch64)<14>[   69.350377] [IGT] kms_vblank: starting subtest pipe-A-ts-continuation-dpms-suspend
    2020-10-07 00:31:03.316000  Force option used: Using driver rockchip
    2020-10-07 00:31:03.321000  Starting subtest: pipe-A-ts-continuation-dpms-suspend
    2020-10-07 00:31:03.398000  Beginning pipe-A-ts-continuation-dpms-suspend on pipe A, connector eDP-1
    2020-10-07 00:31:04.034000  [cmd] rtcwake: assuming RTC uses UTC ... 
    ... (109 line(s) more)