search

googleapis / google-cloud-python

Google Cloud Client Library for Python
https://googleapis.github.io/google-cloud-python/
Apache License 2.0
4.83k stars 1.52k forks source link

Synthesis failed for dataproc #6713

Closed yoshi-automation closed 5 years ago

yoshi-automation commented 5 years ago

Hello! Autosynth couldn't regenerate dataproc. :broken_heart:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth-dataproc'
synthtool > You are running the synthesis script directly, this will be disabled in a future release of Synthtool. Please use python3 -m synthtool instead.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:2f6b261ee7fe1aedf238991c93a20b3820de37a343d0cacf3e3e9555c2aaf2ea
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
MANIFEST.in
noxfile.py.j2
setup.cfg
Traceback (most recent call last):
  File "synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 403, in run
    with Popen(*popenargs, **kwargs) as process:
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 707, in __init__
    restore_signals, start_new_session)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 1326, in _execute_child
    raise child_exception_type(errno_num, err_msg)
FileNotFoundError: [Errno 2] No such file or directory: 'nox'
synthtool > Cleaned up 2 temporary directories.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 5 years ago

Autosynth is still having trouble generating dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth-dataproc'
synthtool > You are running the synthesis script directly, this will be disabled in a future release of Synthtool. Please use python3 -m synthtool instead.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:2f6b261ee7fe1aedf238991c93a20b3820de37a343d0cacf3e3e9555c2aaf2ea
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
MANIFEST.in
noxfile.py.j2
setup.cfg
Traceback (most recent call last):
  File "synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 403, in run
    with Popen(*popenargs, **kwargs) as process:
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 707, in __init__
    restore_signals, start_new_session)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 1326, in _execute_child
    raise child_exception_type(errno_num, err_msg)
FileNotFoundError: [Errno 2] No such file or directory: 'nox'
synthtool > Cleaned up 2 temporary directories.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 5 years ago

Autosynth is still having trouble generating dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth-dataproc'
synthtool > You are running the synthesis script directly, this will be disabled in a future release of Synthtool. Please use python3 -m synthtool instead.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:2f6b261ee7fe1aedf238991c93a20b3820de37a343d0cacf3e3e9555c2aaf2ea
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
MANIFEST.in
noxfile.py.j2
setup.cfg
Traceback (most recent call last):
  File "synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 403, in run
    with Popen(*popenargs, **kwargs) as process:
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 707, in __init__
    restore_signals, start_new_session)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 1326, in _execute_child
    raise child_exception_type(errno_num, err_msg)
FileNotFoundError: [Errno 2] No such file or directory: 'nox'
synthtool > Cleaned up 2 temporary directories.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 5 years ago

Autosynth is still having trouble generating dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth-dataproc'
synthtool > You are running the synthesis script directly, this will be disabled in a future release of Synthtool. Please use python3 -m synthtool instead.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:2f6b261ee7fe1aedf238991c93a20b3820de37a343d0cacf3e3e9555c2aaf2ea
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Failed executing docker run --name artman-docker --rm -i -e HOST_USER_ID=0 -e HOST_GROUP_ID=0 -e RUNNING_IN_ARTMAN_DOCKER=True -v /root/.cache/synthtool/googleapis:/root/.cache/synthtool/googleapis -v /root/.cache/synthtool/googleapis/artman-genfiles:/root/.cache/synthtool/googleapis/artman-genfiles -w /root/.cache/synthtool/googleapis googleapis/artman:latest /bin/bash -c artman --local --config google/cloud/dataproc/artman_dataproc_v1beta2.yaml generate python_gapic:

artman> Artman config file `/root/.cache/synthtool/googleapis/google/cloud/dataproc/artman_dataproc_v1beta2.yaml` doesn't exist.

Traceback (most recent call last):
  File "synth.py", line 30, in <module>
    library = gapic.py_library("dataproc", version)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/gcp/gapic_generator.py", line 43, in py_library
    return self._generate_code(service, version, "python", **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/gcp/gapic_generator.py", line 116, in _generate_code
    gapic_language_arg,
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/gcp/artman.py", line 102, in run
    shell.run(cmd, cwd=root_dir)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/root/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'run', '--name', 'artman-docker', '--rm', '-i', '-e', 'HOST_USER_ID=0', '-e', 'HOST_GROUP_ID=0', '-e', 'RUNNING_IN_ARTMAN_DOCKER=True', '-v', '/root/.cache/synthtool/googleapis:/root/.cache/synthtool/googleapis', '-v', '/root/.cache/synthtool/googleapis/artman-genfiles:/root/.cache/synthtool/googleapis/artman-genfiles', '-w', PosixPath('/root/.cache/synthtool/googleapis'), 'googleapis/artman:latest', '/bin/bash', '-c', 'artman --local --config google/cloud/dataproc/artman_dataproc_v1beta2.yaml generate python_gapic']' returned non-zero exit status 96.
synthtool > Cleaned up 1 temporary directories.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 5 years ago

Autosynth passed, closing! :green_heart: