VDE-181 [REVIEW] Feature/concurrent e2e

[GPUtester]

Please update the changelog in order to start CI tests.

View the gpuCI docs here.

[diegodfrf]

This PR provides us with the following:

• Configuration file creation config.yaml: Global settings will load from here and other options were added.

  # config.yaml
  RUN_SETTINGS:
  CONCURRENT: False
  SETUP:
  APPLY_ORDER: True
  USE_PERCENTAGE: False
  ACCEPTABLE_DIFFERENCE: 0.01
  PRINT_RESULT: True
  COMPARE_WITH: drill
  COMPARING: True
  DATA_TYPES:
  - CUDF
  - DASK_CUDF
  - ORC
  - PARQUET
  - CSV
  - JSON

• Support Concurrent E2E test: All E2E test are support, except for legacyTest. This is configured from config.yaml

  # config.yaml
  RUN_SETTINGS:
  CONCURRENT: False

• Support skip_with for concurrent: If a SuiteTest needs to be skipped for concurrency, it can be disabled.

This option skip test when concurrent is True

# config.yaml
TEST_SUITE:
  SETUP:
    SKIP_WITH:
      - CONCURRENT: True

• A configuration file can be specified using the --config-file parameter: The same option will be added for test.sh

  python -m EndToEndTests.mainE2ETests --config-file config.yaml

• Some E2E environment variables were migrated to config.yaml: The goal is to migrate all or most. The following environment variables are here now

  
  # config.yaml
  TEST_SETTINGS:
  LOG_DIRECTORY: $CONDA_PREFIX/
  DATA_SIZE: "100MB2Part"
  EXECUTION_ENV: "local"
  DASK_CONNECTION: "local"

RUN_SETTINGS: EXEC_MODE: gpuci NGPUS: 1 NETWORK_INTERFACE: lo WORKSHEET: BSQL Log Results LOG_INFO: CONCURRENT: False

[diegodfrf]

Only TPCHSuite will execute for concurrent True and False