Encountering various Timed out error when running UI tests

[anusreelakshmi934]

When running UI tests in windows some of the tests are failing intermittently with the below errors.

Timed out while waiting for project with resource URI api/resourceand port 9080 to become available.

Timed out waiting for message CWWKE0036I in log:D:\a\liberty-tools-intellij\liberty-tools-intellij\liberty-tools-intellij\src\test\resources\projects\gradle\singleModGradleMP\build\wlp\usr\servers\defaultServer\logs\messages.log
errors.

The error are observed in the following files: testCustomStartParametersClearedOnConfigRemoval testStartWithConfigInDebugModeUsingToolbar testStartWithConfigInRunModeUsingMenu testStartWithParamsActionUsingPopUpMenu testRunTestsActionUsingDropDownMenu testRunTestsActionUsingPopUpMenu testStartWithParamsActionUsingDropDownMenu testStartWithConfigInRunModeUsingToolbar testStartWithConfigInDebugModeUsingMenu testRunTestsActionUsingPlayToolbarButton testStartWithParamsActionUsingSearch

In one of the build an error occured in testQuickFixInServerXML() and testDiagnosticInServerXML() -

java.lang.RuntimeException: Hover on text: 'wrong' did not trigger a pop-up window to open 
Caused by:
        com.intellij.remoterobot.utils.WaitForConditionTimeoutException: Exceeded timeout (PT5S) for condition function (Failed to find 'Container' by '//div[@class='HeavyWeightWindow']//div[@class='JEditorPane']' in 5s) 

Also we get the following errors in some builds testInsertJakartaCodeSnippetIntoJavaPart() FAILED

com.intellij.remoterobot.client.IdeaSideException
    Caused by:
        java.lang.Throwable: component must be showing on the screen to determine its location

testMPQuickFixInJavaFile() FAILED

    java.lang.RuntimeException: Hover on text: 'ServiceLiveHealthCheck' did not trigger a pop-up window to open
Caused by:
        com.intellij.remoterobot.utils.WaitForConditionTimeoutException: Exceeded timeout (PT5S) for condition function (Failed to find 'Container' by '//div[@class='HeavyWeightWindow']//div[@class='JEditorPane']' in 5s) 

In some rare builds we are facing initializationError- FAILED These timed out errors are also intermittently occuring in some linux buils

List of tests failed.

• [ ] #910
• [ ] #929

[aparnamichael]

testCustomStartParametersClearedOnConfigRemoval - Timeout error is because after 'cd command' it is not executing gradle start command. (gradlew libertyDev --libertyDebugPort=9876). Not able to reproduce in our local windows machine. But in GHA it is failing inconsistently due to this timeout issue.

[aparnamichael]

Details of windows test executed - https://ibm.box.com/s/x31nsrev91x22mrwz04rjc7nn92up5s8

[aparnamichael]

Tested with 40 windows build. Out of 40, 33 of them were green builds.

Links

• https://github.com/aparnamichael/liberty-tools-intellij/actions/runs/10501415107
• https://github.com/aparnamichael/liberty-tools-intellij/actions/runs/10495172135
• https://github.com/aparnamichael/liberty-tools-intellij/actions/runs/10476801359
• https://github.com/aparnamichael/liberty-tools-intellij/actions/runs/10470497297

This branch contains intellij version update to 2024.1.6 update and Paul’s fix for jdk indexing.

1. Most of the test failures start from 'custom start' tests, in that sometimes dev mode is getting stuck. As a result, subsequent tests are also failing because the dev mode is not able to stop.

2. Out of 40 builds, the MP test failed only once due to the diagnostic message popup. java.lang.RuntimeException: Hover on text: ServiceLiveHealthCheck did not trigger a pop-up window to open

Detailed test results - https://ibm.box.com/s/x31nsrev91x22mrwz04rjc7nn92up5s8

[aparnamichael]

Next steps:

1. Try to reproduce locally by doing the same steps manually.
2. Check how much time it takes to complete searching in messages.log for the success tests.