openshift-psap / topsail

Test Orchestrator for Performance and Scalability of AI pLatforms
Apache License 2.0
11 stars 16 forks source link

[matrix_benchmarking] library: visualize: apply the variable overrides in replot mode #556

Closed kpouget closed 1 month ago

openshift-ci[bot] commented 1 month ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please ask for approval from kpouget. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/openshift-psap/topsail/blob/main/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
topsail-bot[bot] commented 1 month ago

Jenkins Job #1546

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 00 minutes 05 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run kserve test generate_plots_from_pr_args
PR_POSITIONAL_ARGS=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/ cpt_single_model_gating
PR_POSITIONAL_ARG_0=kserve-perf-ci-plot
PR_POSITIONAL_ARG_1=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/
PR_POSITIONAL_ARG_2=cpt_single_model_gating
matbench.workload=projects.kserve.visualizations.kserve-prom
matbench.lts.opensearch.index=rhoai-kserve-single-prom

• Link to the Rebuild page.

Failure indicator: Empty. (See run.log)

[Test ran on the internal Perflab CI]

topsail-bot[bot] commented 1 month ago

Jenkins Job #1547

:green_circle: Test of 'rhoai test generate_plots_from_pr_args' succeeded after 00 hours 03 minutes 49 seconds. :green_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run kserve test generate_plots_from_pr_args
PR_POSITIONAL_ARGS=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/ cpt_single_model_gating
PR_POSITIONAL_ARG_0=kserve-perf-ci-plot
PR_POSITIONAL_ARG_1=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/
PR_POSITIONAL_ARG_2=cpt_single_model_gating
matbench.workload=projects.kserve.visualizations.kserve-prom
matbench.lts.opensearch.index=rhoai-kserve-single-prom

• Link to the Rebuild page.

[Test ran on the internal Perflab CI]

topsail-bot[bot] commented 1 month ago

Jenkins Job #1550

:red_circle: Test of 'rhoai test generate_plots_from_pr_args' failed after 00 hours 06 minutes 24 seconds. :red_circle:

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run kserve test generate_plots_from_pr_args
PR_POSITIONAL_ARGS=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/ cpt_single_model_gating
PR_POSITIONAL_ARG_0=kserve-perf-ci-plot
PR_POSITIONAL_ARG_1=https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1510/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com/002_test_ci/000__local_ci__run_multi_e2e_perf_test/artifacts/ci-pod-0/
PR_POSITIONAL_ARG_2=cpt_single_model_gating

• Link to the Rebuild page.

[Failure indicator](https://ci.app-svc-perf.corp.redhat.com/job/ExternalTeams/job/RHODS/job/topsail/1550/artifact/run/f23-h33-000-6018r.rdu2.scalelab.redhat.com//000_generate_plots_from_pr_args/FAILURES/view/):

/logs/artifacts/000_generate_plots_from_pr_args/FAILURE | An error happened during the visualization post-processing ... (regression detected)

[Test ran on the internal Perflab CI]