openshift-psap / topsail

Test Orchestrator for Performance and Scalability of AI pLatforms
Apache License 2.0
11 stars 16 forks source link

[TOPSAIL] Use YAML to pass the variable overrides #567

Closed kpouget closed 4 weeks ago

kpouget commented 1 month ago

See the related (internal) MiddlewareCI update in this PR: https://gitlab.cee.redhat.com/middlewareperformance/performance-lab-scripts/-/merge_requests/154

openshift-ci[bot] commented 1 month ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please ask for approval from kpouget. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/openshift-psap/topsail/blob/main/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
kpouget commented 1 month ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 1 month ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 00 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 1 month ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 1 month ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 00 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 1 month ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 1 month ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 00 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 1 month ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 1 month ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 00 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 1 month ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 4 weeks ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 00 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 4 weeks ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 4 weeks ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 04 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

PR_POSITIONAL_ARGS: fine_tuning hello-world
PR_POSITIONAL_ARG_0: rhoai-plot
PR_POSITIONAL_ARG_1: fine_tuning
PR_POSITIONAL_ARG_2: hello-world
fine_tuning.image: "hello world"

Failure indicator: Empty. (See run.log)

kpouget commented 4 weeks ago

/test rhoai-plot fine_tuning hello-world /var fine_tuning.image: "hello world"

topsail-bot[bot] commented 4 weeks ago

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 02 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run fine_tuning test generate_plots_from_pr_args
PR_POSITIONAL_ARGS: hello-world
PR_POSITIONAL_ARG_0: fine_tuning-rhoai-plot
PR_POSITIONAL_ARG_1: hello-world
fine_tuning.image: hello world

Failure indicator: Empty. (See run.log)

openshift-ci[bot] commented 4 weeks ago

@kpouget: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/rhoai-plot 3583ee1524da8bec92836680ced3967d38614114 link true /test rhoai-plot

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository. I understand the commands that are listed [here](https://go.k8s.io/bot-commands).
topsail-bot[bot] commented 4 weeks ago

Jenkins Job #1575

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 02 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run fine_tuning test generate_plots_from_pr_args
PR_POSITIONAL_ARGS: ''
PR_POSITIONAL_ARG_0: fine_tuning-perf-ci-plot
fine_tuning.image: hello world

• Link to the Rebuild page.

Failure indicator: Empty. (See run.log)

[Test ran on the internal Perflab CI]

topsail-bot[bot] commented 4 weeks ago

Jenkins Job #1576

:green_circle: Test of 'rhoai test generate_plots_from_pr_args' succeeded after 00 hours 08 minutes 59 seconds. :green_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test generate_plots_from_pr_args
PR_POSITIONAL_ARGS: https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1572/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com//002_test_ci/
  gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci-plot
PR_POSITIONAL_ARG_1: https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1572/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com//002_test_ci/
PR_POSITIONAL_ARG_2: gating_test

• Link to the Rebuild page.

[Test ran on the internal Perflab CI]

kpouget commented 4 weeks ago

smoke tests passed, merging this PR