googleapis / python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
Apache License 2.0
615 stars 330 forks source link

tests.system.vertexai.test_generative_models.TestGenerativeModels: test_generate_content_from_text_and_remote_image failed #3210

Closed flaky-bot[bot] closed 6 months ago

flaky-bot[bot] commented 8 months ago

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and I will stop commenting.


commit: 1d9bd233e636c024def55d4c867f662a4a351f9e buildURL: Build Status, Sponge status: failed

flaky-bot[bot] commented 8 months ago

Test passed for commit 67e593b34928682491c0d00555459108261feb8e (Build Status, Sponge)! Closing this issue.

flaky-bot[bot] commented 7 months ago

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.


commit: 3b28d64c0f263fc5baa457ebeec70adc20f71df9 buildURL: Build Status, Sponge status: failed

Ark-kun commented 7 months ago
def test_generate_content_from_text_and_remote_image(self):
        vision_model = generative_models.GenerativeModel("gemini-pro-vision")
        image_part = generative_models.Part.from_uri(
            uri="gs://[download.tensorflow.org/example_images/320px-Felis_catus-cat_on_snow.jpg](https://www.google.com/url?q=http://download.tensorflow.org/example_images/320px-Felis_catus-cat_on_snow.jpg&sa=D)",
            mime_type="image/jpeg",
        )
>       response = vision_model.generate_content(
            contents=["What is shown in this image?", image_part],
        )

[tests/system/vertexai/test_generative_models.py:116](https://cs.corp.google.com/piper///depot/google3/tests/system/vertexai/test_generative_models.py?l=116): 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[vertexai/generative_models/_generative_models.py:353](https://cs.corp.google.com/piper///depot/google3/vertexai/generative_models/_generative_models.py?l=353): in generate_content
    return self._generate_content(
[vertexai/generative_models/_generative_models.py:437](https://cs.corp.google.com/piper///depot/google3/vertexai/generative_models/_generative_models.py?l=437): in _generate_content
    stream = self._prediction_client.stream_generate_content(request=request)
[google/cloud/aiplatform_v1beta1/services/prediction_service/client.py:1634](https://cs.corp.google.com/piper///depot/google3/google/cloud/aiplatform_v1beta1/services/prediction_service/client.py?l=1634): in stream_generate_content
    response = rpc(
[.nox/system-3-10/lib/python3.10/site-packages/google/api_core/gapic_v1/method.py:131](https://cs.corp.google.com/piper///depot/google3/.nox/system-3-10/lib/python3.10/site-packages/google/api_core/gapic_v1/method.py?l=131): in __call__
    return wrapped_func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = (model: "projects/ucaip-sample-tests/locations/us-central1/publishers/google/models/gemini-pro-vision"
contents {
  ro...ge/jpeg"
      file_uri: "gs://[download.tensorflow.org/example_images/320px-Felis_catus-cat_on_snow.jpg](https://www.google.com/url?q=http://download.tensorflow.org/example_images/320px-Felis_catus-cat_on_snow.jpg&sa=D)"
    }
  }
}
,)
kwargs = {'metadata': [('x-goog-request-params', 'model=projects/ucaip-sample-tests/locations/us-central1/publishers/google/mod...ic/1.39.0+top_google_constructor_method+vertexai.preview.generative_models._PreviewGenerativeModel.generate_content')]}
result = <_MultiThreadedRendezvous of RPC that terminated with:
    status = StatusCode.INVALID_ARGUMENT
    details = "Request conta...ted_time:"2024-01-18T11:58:40.035806011+00:00", grpc_status:3, grpc_message:"Request contains an invalid argument."}"
>
Ark-kun commented 7 months ago

The error does not reproduce.

flaky-bot[bot] commented 7 months ago

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: b2458ec51d7c3bbba787bbefac31c9aad6ffdb10 buildURL: Build Status, Sponge status: failed

flaky-bot[bot] commented 7 months ago

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 07c2a25225cf163584fc38616ddb6c1e560ac288 buildURL: Build Status, Sponge status: failed

Ark-kun commented 6 months ago

Flake: "Online prediction request quota exceeded for gemini-pro-vision. Please try again later with backoff."