GHA: Windows builds timeout due to `200-flexdashboard-render-text` shinyjster test's interruption

MadhulikaTanuboddi commented 3 years ago

Adding to https://github.com/rstudio/shinycoreci-apps/issues/96#issuecomment-813532527, after the discussion with Barret and Shalu, we noticed that this specific instances of time out are due to 200-flexdashboard-render-text app's shinyjster test being stopped.

This started happening since the shinyjster test has been added for above app.

Detailed logs below starting from https://github.com/rstudio/shinycoreci-apps/runs/2285509215?check_suite_focus=true#step:31:26659

Wed, 07 Apr 2021 09:23:24 GMT
shinyjster - Progress: 1/94 (waiting)
Wed, 07 Apr 2021 09:23:24 GMT

Wed, 07 Apr 2021 09:23:24 GMT
shinyjster - Progress: 1/94 (running)
Wed, 07 Apr 2021 09:23:24 GMT

Wed, 07 Apr 2021 09:23:25 GMT
shinyjster - Browser window has been closed. Stopping Shiny Application now.
Wed, 07 Apr 2021 09:23:25 GMT

Wed, 07 Apr 2021 09:23:35 GMT
shinyjster - Browser process is still alive. Sending SIGINT!
Wed, 07 Apr 2021 09:23:35 GMT

Wed, 07 Apr 2021 09:23:35 GMT
shinyjster - Checking browser...
Wed, 07 Apr 2021 09:23:35 GMT

Wed, 07 Apr 2021 09:23:35 GMT
shinyjster - Browser is closed!
Wed, 07 Apr 2021 09:23:35 GMT

Wed, 07 Apr 2021 09:23:35 GMT
shinyjster - stopping app: 200-flexdashboard-render-text
Wed, 07 Apr 2021 09:23:35 GMT

Wed, 07 Apr 2021 09:23:35 GMT
List of 4
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
 $ appDir     : chr "D:\\a\\shinycoreci-apps\\shinycoreci-apps\\apps\\200-flexdashboard-render-text/index.Rmd"
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
 $ successful : logi FALSE
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
 $ returnValue:List of 1
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
  ..$ :List of 1
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
  .. ..$ type: chr "Session closed early"
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
 $ browser    : chr "chrome_headless"
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
Error in shinyjster-chrome.R
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
Error in assert_jster(ret): 
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
shinyjster - Failing apps:
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT
shinyjster - * D:\a\shinycoreci-apps\shinycoreci-apps\apps\200-flexdashboard-render-text/index.Rmd - chrome_headless
Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 09:23:36 GMT

Wed, 07 Apr 2021 12:32:29 GMT

Wed, 07 Apr 2021 12:32:29 GMT
Execution halted
Wed, 07 Apr 2021 12:32:34 GMT
Error: The action has timed out.

Browser is opened and immediately closed. Also, notice the time stamp after the last run of this app. The process waited for 3 hours to timeout. Is there a way not to wait for such a long period of time to timeout. Can we just return the test results for the apps which ran successfully similar to other builds (Mac and Ubuntu)?

schloerke commented 3 years ago

Have added temp patch in #137 to disable windows shinyjster checks. I've updated the tests there. The tests are still failing due to random html being produced. 🙄

MadhulikaTanuboddi commented 3 years ago

Thank you. From today's run and with the workaround, Windows builds are showing the test results: https://github.com/rstudio/shinycoreci-apps/runs/2415030153?check_suite_focus=true#step:31:31730

rstudio / shinycoreci-apps

GHA: Windows builds timeout due to `200-flexdashboard-render-text` shinyjster test's interruption #133