opensearch-project / opensearch-dashboards-functional-test

Maintains functional tests for OpenSearch Dashboards and Dashboards plugins
Apache License 2.0
12 stars 113 forks source link

[BUG] Github CI only pick few test cases on windows platform #1117

Open Hailong-am opened 7 months ago

Hailong-am commented 7 months ago

What is the bug?

https://github.com/opensearch-project/opensearch-dashboards-functional-test/actions/runs/7999641398/job/21847789458

Using custom test command: env CYPRESS_NO_COMMAND_LOG=1 CYPRESS_VISBUILDER_ENABLED=true CYPRESS_DATASOURCE_MANAGEMENT_ENABLED=true yarn cypress:run-with-security --browser chrome --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/**/*.js'
run tests command "env CYPRESS_NO_COMMAND_LOG=1 CYPRESS_VISBUILDER_ENABLED=true CYPRESS_DATASOURCE_MANAGEMENT_ENABLED=true yarn cypress:run-with-security --browser chrome --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/**/*.js'"
current working directory "D:\a\opensearch-dashboards-functional-test\opensearch-dashboards-functional-test\cypress-test"
"C:\Program Files\Git\usr\bin\env.exe" CYPRESS_NO_COMMAND_LOG=1 CYPRESS_VISBUILDER_ENABLED=true CYPRESS_DATASOURCE_MANAGEMENT_ENABLED=true yarn cypress:run-with-security --browser chrome --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/**/*.js'
yarn run v1.22.21
$ env TZ=America/Los_Angeles NO_COLOR=1 cypress run --headless --env SECURITY_ENABLED=true,openSearchUrl=https://localhost:9200,WAIT_FOR_LOADER_BUFFER_MS=500 --browser chrome --spec cypress/integration/core-opensearch-dashboards/opensearch-dashboards/**/*.js

⚠ Warning: It looks like you're passing --spec a space-separated list of arguments:

"cypress/integration/core-opensearch-dashboards/opensearch-dashboards/datasource-management-plugin/1_create_datasource.spec.js cypress/integration/core-opensearch-dashboards/opensearch-dashboards/datasource-management-plugin/2_datasource_table.spec.js cypress/integration/core-opensearch-dashboards/opensearch-dashboards/datasource-management-plugin/3_update_datasource.spec.js"

This will work, but it's not recommended.

If you are trying to pass multiple arguments, separate them with commas instead:
  cypress run --spec arg1,arg2,arg3

The most common cause of this warning is using an unescaped glob pattern. If you are
trying to pass a glob pattern, escape it using quotes:
  cypress run --spec "**/*.spec.js"

only 3 cases been picked up

  │ Specs:          3 found (core-opensearch-dashboards/opensearch-dashboards/datasource-managemen │
  │                 t-plugin/1_create_datasource.spec.js, core-opensearch-dashboards/opensearch-da │
  │                 shboards/datasource-management-plugin/2_datasource_table.spec.js, core-opensea │
  │                 rch-dashboards/opensea...)    

How can one reproduce the bug?

Steps to reproduce the behavior.

What is the expected behavior?

A clear and concise description of what you expected to happen.

What is your host/environment?

Operating system, version.

Do you have any screenshots?

If applicable, add screenshots to help explain your problem.

Do you have any additional context?

Linux platform could pick up all 41 test cases


  │ Cypress:        9.5.4                                                                          │
  │ Browser:        Chromium 121 (headless)                                                        │
  │ Node Version:   v18.19.1 (/usr/local/bin/node)                                                 │
  │ Specs:          41 found (core-opensearch-dashboards/opensearch-dashboards/apps/data_explorer/ │
  │                 aaa_before.spec.js, core-opensearch-dashboards/opensearch-dashboards/apps/data │
  │                 _explorer/data_source_selector.spec.js, core-opensearch-dashboards/opensearch- │
  │                 dashboards/apps/data_ex...)                                                    │
  │ Searched:       cypress/integration/core-opensearch-dashboards/opensearch-dashboards/**/*.js ```
kavilla commented 6 months ago

Related issue: https://github.com/opensearch-project/opensearch-dashboards-functional-test/issues/1117, could be related to how the string is being handled to find the tests.

@AMoo-Miki