search

ansible / vscode-ansible

vscode/vscodium extension for providing Ansible auto-completion and integrating quality assurance tools like ansible-lint, ansible syntax check, yamllint, molecule and ansible-test.
https://ansible.readthedocs.io/projects/vscode-ansible/
MIT License
363 stars 91 forks source link

test: task ui reports some flaky test failues on linux #1478

Open ssbarnea opened 3 months ago

ssbarnea commented 3 months ago

Based on https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444 

14 passing (6m)
[279](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:280)
  1 pending
[280](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:281)
  20 failing
[281](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:282)

[282](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:283)
  1) VSCode Ansible - UI tests
[283](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:284)
       Verify the presence of lightspeed element in the status bar and the explorer view
[284](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:285)
         Ansible Lightspeed status bar item absent when settings not enabled:
[285](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:286)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[286](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:287)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[287](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:288)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[288](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:289)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[289](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:290)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:64:13)
[290](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:291)

[291](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:292)
  2) VSCode Ansible - UI tests
[292](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:293)
       Verify the presence of lightspeed element in the status bar and the explorer view
[293](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:294)
         Ansible Lightspeed status bar item present when only lightspeed is enabled (with warning color):
[294](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:295)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[295](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:296)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[296](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:297)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[297](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:298)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[298](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:299)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:84:13)
[299](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:300)

[300](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:301)
  3) VSCode Ansible - UI tests
[301](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:302)
       Verify the presence of lightspeed element in the status bar and the explorer view
[302](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:303)
         Ansible Lightspeed status bar item present when lightspeed and lightspeed suggestions are enabled (with normal color):
[303](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:304)
     Error: No editor with title 'playbook_1.yml' in group '0' available
[304](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:305)
      at EditorGroup.getTabByTitle (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:288:15)
[305](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:306)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[306](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:307)
      at async EditorGroup.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:195:21)
[307](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:308)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:95:13)
[308](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:309)

[309](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:310)
  4) VSCode Ansible - UI tests
[310](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:311)
       Verify playbook generation and explanation features work as expected
[311](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:312)
         Playbook explanation webview works as expected:
[312](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:313)
     TypeError: Cannot read properties of undefined (reading 'openEditor')
[313](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:314)
      at EditorView.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:49:22)
[314](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:315)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[315](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:316)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:429:34)
[316](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:317)

[317](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:318)
  5) VSCode Ansible - UI tests
[318](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:319)
       Verify playbook generation and explanation features work as expected
[319](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:320)
         Playbook explanation webview with a playbook with no tasks:
[320](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:321)
     TypeError: Cannot read properties of undefined (reading 'openEditor')
[321](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:322)
      at EditorView.openEditor (node_modules/@redhat-developer/page-objects/out/components/editor/EditorView.js:49:22)
[322](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:323)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[323](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:324)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedUiTest.js:478:34)
[324](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:325)

[325](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:326)
  6) VSCode Ansible - UI tests
[326](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:327)
       Verify the execution of playbook using ansible-playbook command
[327](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:328)
         Execute ansible-playbook command with arg:
[328](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:329)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'ansible-playbook --syntax-check'
[329](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:330)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:29:38)
[330](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:331)

[331](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:332)
  7) VSCode Ansible - UI tests
[332](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:333)
       Verify the execution of playbook using ansible-playbook command
[333](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:334)
         Execute ansible-playbook command without arg:
[334](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:335)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'ansible-playbook '
[335](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:336)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:39:38)
[336](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:337)

[337](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:338)
  8) VSCode Ansible - UI tests
[338](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:339)
       Verify the execution of playbook using ansible-navigator command
[339](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:340)
         Execute playbook with ansible-navigator EE mode:
[340](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:341)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'Play '
[341](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:342)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:65:42)
[342](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:343)

[343](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:344)
  9) VSCode Ansible - UI tests
[344](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:345)
       Verify the execution of playbook using ansible-navigator command
[345](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:346)
         Execute playbook with ansible-navigator without EE mode:
[346](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:347)
     AssertionError: expected 'runner@fv-az1344-837:~$ \n\n\n\n\n\n\n\n\n\n\n' to include 'Play '
[347](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:348)
      at Context.<anonymous> (out/client/test/ui-test/terminalUiTest.js:79:38)
[348](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:349)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[349](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:350)

[350](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:351)
  10) VSCode Ansible - UI tests
[351](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:352)
       Test One Click Trial feature
[352](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:353)
         Click Open if a dialog shows up for opening the external website:
[353](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:354)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[354](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:355)
      at listOnTimeout (node:internal/timers:569:17)
[355](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:356)
      at process.processTimers (node:internal/timers:512:7)
[356](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:357)

[357](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:358)
  11) VSCode Ansible - UI tests
[358](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:359)
       Test One Click Trial feature
[359](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:360)
         Click Open to open the callback URI:
[360](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:361)

[361](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:362)
      AssertionError: expected 'Do you want Code to open the external website?' to equal 'Allow \'Ansible\' extension to open this URI?'
[362](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:363)
      + expected - actual
[363](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:364)

[364](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:365)
      -Do you want Code to open the external website?
[365](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:366)
      +Allow 'Ansible' extension to open this URI?
[366](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:367)

[367](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:368)
      at Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:73:47)
[368](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:369)
      at process.processImmediate (node:internal/timers:476:21)
[369](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:370)

[370](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:371)
  12) VSCode Ansible - UI tests
[371](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:372)
       Test One Click Trial feature
[372](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:373)
         Verify Ansible Lightspeed webview now contains user's information:
[373](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:374)
     AssertionError: expected 'Experience smarter automation using Ansible Lightspeed with watsonx Code Assistant solutions for your playbook. Learn more\nConnect' to include 'Logged in as: ONE_CLICK_USER (unlicensed)'
[374](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:375)
      at Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:81:38)
[375](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:376)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[376](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:377)

[377](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:378)
  13) VSCode Ansible - UI tests
[378](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:379)
       Test One Click Trial feature
[379](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:380)
         Verify the Refresh icon is found on the title of Explorer view:
[380](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:381)
     NoSuchElementError: no such element: Unable to locate element: {"method":"xpath","selector":"//a[contains(@class, 'codicon-refresh')]"}
[381](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:382)
  (Session info: chrome=122.0.6261.156)
[382](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:383)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[383](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:384)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[384](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:385)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[385](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:386)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[386](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:387)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[387](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:388)
      at async WebviewViewBase.findWebElement (node_modules/@redhat-developer/page-objects/out/components/WebviewMixin.js:42:20)
[388](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:389)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:86:33)
[389](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:390)

[390](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:391)
  14) VSCode Ansible - UI tests
[391](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:392)
       Test One Click Trial feature
[392](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:393)
         Invoke Playbook generation without experimental features enabled:
[393](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:394)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[394](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:395)
  (Session info: chrome=122.0.6261.156)
[395](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:396)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[396](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:397)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[397](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:398)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[398](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:399)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[399](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:400)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[400](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:401)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[401](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:402)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[402](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:403)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[403](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:404)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[404](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:405)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[405](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:406)

[406](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:407)
  15) VSCode Ansible - UI tests
[407](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:408)
       Test One Click Trial feature
[408](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:409)
         Invoke Playbook generation with experimental features enabled:
[409](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:410)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[410](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:411)
  (Session info: chrome=122.0.6261.156)
[411](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:412)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[412](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:413)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[413](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:414)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[414](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:415)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[415](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:416)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[416](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:417)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[417](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:418)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[418](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:419)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[419](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:420)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[420](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:421)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[421](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:422)

[422](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:423)
  16) VSCode Ansible - UI tests
[423](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:424)
       Test One Click Trial feature
[424](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:425)
         Invoke Playbook explanation with experimental features enabled:
[425](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:426)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[426](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:427)
      at listOnTimeout (node:internal/timers:569:17)
[427](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:428)
      at process.processTimers (node:internal/timers:512:7)
[428](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:429)

[429](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:430)
  17) VSCode Ansible - UI tests
[430](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:431)
       Test One Click Trial feature
[431](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:432)
         Invoke Completion with experimental features enabled:
[432](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:433)
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/vscode-ansible/vscode-ansible/out/client/test/ui-test/allTestsSuite.js)
[433](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:434)
      at listOnTimeout (node:internal/timers:569:17)
[434](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:435)
      at process.processTimers (node:internal/timers:512:7)
[435](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:436)

[436](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:437)
  18) VSCode Ansible - UI tests
[437](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:438)
       Test One Click Trial feature
[438](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:439)
         Sign out using Accounts global action:
[439](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:440)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-workbench"}
[440](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:441)
  (Session info: chrome=122.0.6261.156)
[441](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:442)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[442](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:443)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[443](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:444)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[444](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:445)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[445](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:446)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[446](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:447)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[447](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:448)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[448](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:449)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[449](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:450)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[450](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:451)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[451](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:452)

[452](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:453)
  19) VSCode Ansible - UI tests
[453](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:454)
       Test One Click Trial feature
[454](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:455)
         Click Sign Out button on the modal dialog:
[455](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:456)
     NoSuchElementError: no such element: Unable to locate element: {"method":"css selector","selector":".monaco-dialog-box"}
[456](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:457)
  (Session info: chrome=122.0.6261.156)
[457](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:458)
      at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:521:15)
[458](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:459)
      at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:514:13)
[459](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:460)
      at Executor.execute (node_modules/selenium-webdriver/lib/http.js:446:28)
[460](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:461)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[461](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:462)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:742:17)
[462](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:463)
      at async toWireValue (node_modules/selenium-webdriver/lib/webdriver.js:147:15)
[463](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:464)
      at async /home/runner/work/vscode-ansible/vscode-ansible/node_modules/selenium-webdriver/lib/webdriver.js:193:16
[464](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:465)
      at async forEachKey (node_modules/selenium-webdriver/lib/webdriver.js:187:9)
[465](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:466)
      at async convertKeys (node_modules/selenium-webdriver/lib/webdriver.js:192:3)
[466](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:467)
      at async Driver.execute (node_modules/selenium-webdriver/lib/webdriver.js:740:22)
[467](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:468)

[468](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:469)
  20) VSCode Ansible - UI tests
[469](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:470)
       Test One Click Trial feature
[470](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:471)
         Verify the notification message:
[471](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:472)

[472](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:473)
      AssertionError: expected +0 to be above +0
[473](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:474)
      + expected - actual
[474](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:475)

[475](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:476)

[476](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:477)
      at expectNotification (out/client/test/ui-test/uiTestHelper.js:58:46)
[477](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:478)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[478](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:479)
      at async Context.<anonymous> (out/client/test/ui-test/lightspeedOneClickTrialUITest.js:187:13)
[479](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:480)

[480](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:481)

[481](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:482)

[482](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:483)
INFO: Screenshots of failures can be found in: /home/runner/work/vscode-ansible/vscode-ansible/out/test-resources/screenshots
[483](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:484)

[484](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:485)
Error: Command failed with exit code 1: TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current
[485](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:486)
    at makeError (/home/runner/work/vscode-ansible/vscode-ansible/node_modules/start-server-and-test/node_modules/execa/lib/error.js:60:11)
[486](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:487)
    at handlePromise (/home/runner/work/vscode-ansible/vscode-ansible/node_modules/start-server-and-test/node_modules/execa/index.js:118:26)
[487](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:488)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
[488](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:489)
  shortMessage: 'Command failed with exit code 1: TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current',
[489](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:490)
  command: 'TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current',
[490](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:491)
  escapedCommand: '"TEST_LIGHTSPEED_ACCESS_TOKEN=dummy TEST_LIGHTSPEED_URL=http://ip6-localhost:3000 yarn coverage-ui-current"',
[491](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:492)
  exitCode: 1,
[492](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:493)
  signal: undefined,
[493](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:494)
  signalDescription: undefined,
[494](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:495)
  stdout: undefined,
[495](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:496)
  stderr: undefined,
[496](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:497)
  failed: true,
[497](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:498)
  timedOut: false,
[498](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:499)
  isCanceled: false,
[499](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:500)
  killed: false
[500](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:501)
}
[501](https://github.com/ansible/vscode-ansible/actions/runs/10183596416/job/28201750808?pr=1444#step:14:502)
task: Failed to run task "test-ui": exit status 1
tima commented 2 months ago

@TamiTakamiya Can you confirm this is one of your Lightspeed test or is this something underlying in the framework?

TamiTakamiya commented 2 months ago

@tima It is true that a few Lightspeed tests occasionally fails in CI even though the reason is not perfectly clear. I assign this to myself anyway.