googleapis / python-dataproc

This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc
Apache License 2.0
48 stars 32 forks source link

Synthesis failed for python-dataproc #4

Closed yoshi-automation closed 4 years ago

yoshi-automation commented 4 years ago

Hello! Autosynth couldn't regenerate python-dataproc. :broken_heart:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 99, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 91, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 99, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 91, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

Cloning into 'working_repo'...
Switched to branch 'autosynth'
Running synthtool
['/tmpfs/src/git/autosynth/env/bin/python3', '-m', 'synthtool', 'synth.py', '--']
synthtool > Executing /tmpfs/src/git/autosynth/working_repo/synth.py.
On branch autosynth
nothing to commit, working tree clean
HEAD detached at FETCH_HEAD
nothing to commit, working tree clean
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:6aec9c34db0e4be221cdaf6faba27bdc07cfea846808b3d3b964dfce3a9a0f9b
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
.github/CONTRIBUTING.md
.github/ISSUE_TEMPLATE/bug_report.md
.github/ISSUE_TEMPLATE/feature_request.md
.github/ISSUE_TEMPLATE/support_request.md
.github/PULL_REQUEST_TEMPLATE.md
.github/release-please.yml
.gitignore
.kokoro/build.sh
.kokoro/continuous/common.cfg
.kokoro/continuous/continuous.cfg
.kokoro/docs/common.cfg
.kokoro/docs/docs.cfg
.kokoro/presubmit/common.cfg
.kokoro/presubmit/presubmit.cfg
.kokoro/publish-docs.sh
.kokoro/release.sh
.kokoro/release/common.cfg
.kokoro/release/release.cfg
.kokoro/trampoline.sh
CODE_OF_CONDUCT.md
CONTRIBUTING.rst
LICENSE
MANIFEST.in
docs/_static/custom.css
docs/_templates/layout.html
docs/conf.py.j2
noxfile.py.j2
renovate.json
setup.cfg
Running session blacken
Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
pip install black==19.3b0
Error: pip is not installed into the virtualenv, it is located at /tmpfs/src/git/autosynth/env/bin/pip. Pass external=True into run() to explicitly allow this.
Session blacken failed.
synthtool > Failed executing nox -s blacken:

None
synthtool > Wrote metadata to synth.metadata.
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed
  File "/tmpfs/src/git/autosynth/working_repo/synth.py", line 87, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/git/autosynth/env/lib/python3.6/site-packages/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.

Synthesis failed

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

error: unknown option `branch debug-synthhttps://github.com/googleapis/python-dataproc.git'
usage: git clone [<options>] [--] <repo> [<dir>]

    -v, --verbose         be more verbose
    -q, --quiet           be more quiet
    --progress            force progress reporting
    -n, --no-checkout     don't create a checkout
    --bare                create a bare repository
    --mirror              create a mirror repository (implies bare)
    -l, --local           to clone from a local repository
    --no-hardlinks        don't use local hardlinks, always copy
    -s, --shared          setup as shared repository
    --recurse-submodules[=<pathspec>]
                          initialize submodules in the clone
    -j, --jobs <n>        number of submodules cloned in parallel
    --template <template-directory>
                          directory from which templates will be used
    --reference <repo>    reference repository
    --reference-if-able <repo>
                          reference repository
    --dissociate          use --reference only while cloning
    -o, --origin <name>   use <name> instead of 'origin' to track upstream
    -b, --branch <branch>
                          checkout <branch> instead of the remote's HEAD
    -u, --upload-pack <path>
                          path to git-upload-pack on the remote
    --depth <depth>       create a shallow clone of that depth
    --shallow-since <time>
                          create a shallow clone since a specific time
    --shallow-exclude <revision>
                          deepen history of shallow clone, excluding rev
    --single-branch       clone only one branch, HEAD or --branch
    --no-tags             don't clone any tags, and make later fetches not to follow them
    --shallow-submodules  any cloned submodules will be shallow
    --separate-git-dir <gitdir>
                          separate git dir from working tree
    -c, --config <key=value>
                          set config inside the new repository
    -4, --ipv4            use IPv4 addresses only
    -6, --ipv6            use IPv6 addresses only
    --filter <args>       object filtering

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 265, in <module>
    main()
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 194, in main
    clone_repo(args.github_user, args.github_token, args.repository, WORKING_REPO)
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 60, in clone_repo
    env=env,
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clone', '--single-branch', '--branch debug-synthhttps://github.com/googleapis/python-dataproc.git', 'working_repo']' returned non-zero exit status 129.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating python-dataproc. :sob:

Here's the output from running synth.py:

error: unknown option `branch debug-synth'
usage: git clone [<options>] [--] <repo> [<dir>]

    -v, --verbose         be more verbose
    -q, --quiet           be more quiet
    --progress            force progress reporting
    -n, --no-checkout     don't create a checkout
    --bare                create a bare repository
    --mirror              create a mirror repository (implies bare)
    -l, --local           to clone from a local repository
    --no-hardlinks        don't use local hardlinks, always copy
    -s, --shared          setup as shared repository
    --recurse-submodules[=<pathspec>]
                          initialize submodules in the clone
    -j, --jobs <n>        number of submodules cloned in parallel
    --template <template-directory>
                          directory from which templates will be used
    --reference <repo>    reference repository
    --reference-if-able <repo>
                          reference repository
    --dissociate          use --reference only while cloning
    -o, --origin <name>   use <name> instead of 'origin' to track upstream
    -b, --branch <branch>
                          checkout <branch> instead of the remote's HEAD
    -u, --upload-pack <path>
                          path to git-upload-pack on the remote
    --depth <depth>       create a shallow clone of that depth
    --shallow-since <time>
                          create a shallow clone since a specific time
    --shallow-exclude <revision>
                          deepen history of shallow clone, excluding rev
    --single-branch       clone only one branch, HEAD or --branch
    --no-tags             don't clone any tags, and make later fetches not to follow them
    --shallow-submodules  any cloned submodules will be shallow
    --separate-git-dir <gitdir>
                          separate git dir from working tree
    -c, --config <key=value>
                          set config inside the new repository
    -4, --ipv4            use IPv4 addresses only
    -6, --ipv6            use IPv6 addresses only
    --filter <args>       object filtering

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 265, in <module>
    main()
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 194, in main
    clone_repo(args.github_user, args.github_token, args.repository, WORKING_REPO)
  File "/tmpfs/src/git/autosynth/autosynth/synth.py", line 60, in clone_repo
    env=env,
  File "/home/kbuilder/.pyenv/versions/3.6.1/lib/python3.6/subprocess.py", line 291, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['git', 'clone', '--single-branch', '--branch debug-synth', 'https://github.com/googleapis/python-dataproc.git', 'working_repo']' returned non-zero exit status 129.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth passed, closing! :green_heart: