tests.unit.aiplatform.test_model_evaluation.TestModelEvaluationJob: test_model_evaluation_job_submit_with_caching_disabled[{"pipelineInfo": {"name": "evaluation-default-pipeline"}, "root": {"dag": {"tasks": {"model-evaluation-text-generation": {"taskInfo": {"name": "model-evaluation-text-generation"}, "cachingOptions": {"enableCache": false}}}}, "inputDefinitions": {"parameters": {"batch_predict_gcs_source_uris": {"type": "STRING"}, "dataflow_service_account": {"type": "STRING"}, "batch_predict_instances_format": {"type": "STRING"}, "batch_predict_machine_type": {"type": "STRING"}, "evaluation_class_labels": {"type": "STRING"}, "location": {"type": "STRING"}, "model_name": {"type": "STRING"}, "project": {"type": "STRING"}, "batch_predict_gcs_destination_output_uri": {"type": "STRING"}, "target_field_name": {"type": "STRING"}}}}, "schemaVersion": "2.0.0", "sdkVersion": "kfp-1.8.12", "components": {}}] failed

googleapis / python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.

Apache License 2.0

615 stars 331 forks source link

tests.unit.aiplatform.test_model_evaluation.TestModelEvaluationJob: test_model_evaluation_job_submit_with_caching_disabled[{"pipelineInfo": {"name": "evaluation-default-pipeline"}, "root": {"dag": {"tasks": {"model-evaluation-text-generation": {"taskInfo": {"name": "model-evaluation-text-generation"}, "cachingOptions": {"enableCache": false}}}}, "inputDefinitions": {"parameters": {"batch_predict_gcs_source_uris": {"type": "STRING"}, "dataflow_service_account": {"type": "STRING"}, "batch_predict_instances_format": {"type": "STRING"}, "batch_predict_machine_type": {"type": "STRING"}, "evaluation_class_labels": {"type": "STRING"}, "location": {"type": "STRING"}, "model_name": {"type": "STRING"}, "project": {"type": "STRING"}, "batch_predict_gcs_destination_output_uri": {"type": "STRING"}, "target_field_name": {"type": "STRING"}}}}, "schemaVersion": "2.0.0", "sdkVersion": "kfp-1.8.12", "components": {}}] failed #4388

Closed flaky-bot[bot] closed 1 day ago

flaky-bot[bot] commented 6 days ago

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and I will stop commenting.

commit: 73490b22a239cb1a3c31349f8db6cfbc5232e231 buildURL: Build Status, Sponge status: failed

flaky-bot[bot] commented 6 days ago

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.

When run at the same commit (73490b22a239cb1a3c31349f8db6cfbc5232e231), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).