search

GoogleCloudPlatform / python-docs-samples

Code samples used on cloud.google.com
Apache License 2.0
7.46k stars 6.45k forks source link

Build failures in translate/automl #4353

Closed tmatsuo closed 4 years ago

tmatsuo commented 4 years ago

It seems like a deterministic failure.

Python 3.6 build Python 3.7 build Python 3.8 build

Log:

_________________________ test_model_list_get_evaluate _________________________
Traceback (most recent call last):
  File "/workspace/translate/automl/model_test.py", line 80, in test_model_list_get_evaluate
    assert "evaluation_metric" in out
AssertionError: assert 'evaluation_metric' in 'name: "projects/1012616486416/locations/us-central1/models/VAR6465236123462402048/modelEvaluations/452876416420741254"\ncreate_time {\n  seconds: 1595365133\n  nanos: 496593000\n}\nevaluated_example_count: 30\n\n'

BTW, Build Cop Bot didn't report them. I filed: https://github.com/googleapis/repo-automation-bots/issues/727

tmatsuo commented 4 years ago

First step. This is happening locally on my workstation.

tmatsuo commented 4 years ago

I think the API response changed the field name from evaluation_metric to evaluated_example_count.