search

googleapis / elixir-google-api

Elixir client libraries for accessing Google APIs.
https://hex.pm/users/google-cloud
Apache License 2.0
1.01k stars 459 forks source link

Synthesis failed for Dataproc #4882

Closed yoshi-automation closed 4 years ago

yoshi-automation commented 4 years ago

Hello! Autosynth couldn't regenerate Dataproc. :broken_heart:

Here's the output from running synth.py:

2020-05-09 05:10:28 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-09 05:10:28,359 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-dataproc'
2020-05-09 05:10:30 [INFO] Running synthtool
2020-05-09 05:10:30,021 autosynth > Running synthtool
2020-05-09 05:10:30 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-09 05:10:30,021 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-09 05:10:30,228 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-dataproc
nothing to commit, working tree clean
2020-05-09 05:10:30,541 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-09 05:10:30,996 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh Dataproc
2020-05-09 05:10:34,913 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/dataproc/synth.metadata'
2020-05-09 05:10:34 [ERROR] Synthesis failed
2020-05-09 05:10:34,941 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--', 'Dataproc']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating Dataproc. :sob:

Here's the output from running synth.py:

2020-05-10 05:10:22 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-10 05:10:22,833 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-dataproc'
2020-05-10 05:10:24 [INFO] Running synthtool
2020-05-10 05:10:24,994 autosynth > Running synthtool
2020-05-10 05:10:24 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-10 05:10:24,994 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-10 05:10:25,210 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-dataproc
nothing to commit, working tree clean
2020-05-10 05:10:25,461 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-10 05:10:26,273 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh Dataproc
2020-05-10 05:10:30,031 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/dataproc/synth.metadata'
2020-05-10 05:10:30 [ERROR] Synthesis failed
2020-05-10 05:10:30,056 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--', 'Dataproc']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating Dataproc. :sob:

Here's the output from running synth.py:

2020-05-11 05:09:09 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-11 05:09:09,569 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-dataproc'
2020-05-11 05:09:11 [INFO] Running synthtool
2020-05-11 05:09:11,158 autosynth > Running synthtool
2020-05-11 05:09:11 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-11 05:09:11,158 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-11 05:09:11,341 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-dataproc
nothing to commit, working tree clean
2020-05-11 05:09:11,686 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-11 05:09:12,112 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh Dataproc
2020-05-11 05:09:16,513 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/dataproc/synth.metadata'
2020-05-11 05:09:16 [ERROR] Synthesis failed
2020-05-11 05:09:16,537 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--', 'Dataproc']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating Dataproc. :sob:

Here's the output from running synth.py:

2020-05-11 15:11:10 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-11 15:11:10,066 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-dataproc'
2020-05-11 15:11:11 [INFO] Running synthtool
2020-05-11 15:11:11,609 autosynth > Running synthtool
2020-05-11 15:11:11 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-11 15:11:11,609 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-11 15:11:11,818 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-dataproc
nothing to commit, working tree clean
2020-05-11 15:11:12,007 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-11 15:11:12,992 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh Dataproc
/workspace /workspace
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.
Resolving Hex dependencies...
Dependency resolution completed:
Unchanged:
  certifi 2.5.1
  google_api_discovery 0.7.0
  google_gax 0.3.2
  hackney 1.15.2
  idna 6.0.0
  jason 1.2.0
  metrics 1.0.1
  mime 1.3.1
  mimerl 1.2.0
  oauth2 0.9.4
  parse_trans 3.3.0
  poison 3.1.0
  ssl_verify_fun 1.1.5
  temp 0.4.7
  tesla 1.3.3
  unicode_util_compat 0.4.1
A new Hex version is available (0.20.1 < 0.20.5), please update with `mix local.hex`
All dependencies are up to date
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.

22:11:16.407 [info]  FETCHING: https://dataproc.googleapis.com/$discovery/GOOGLE_REST_SIMPLE_URI?version=v1

22:11:16.576 [info]  FOUND: https://dataproc.googleapis.com/$discovery/GOOGLE_REST_SIMPLE_URI?version=v1
Revision check: old=20200409, new=20200409, generating=true
Creating leading directories
Writing AcceleratorConfig to clients/dataproc/lib/google_api/dataproc/v1/model/accelerator_config.ex.
Writing AutoscalingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/autoscaling_config.ex.
Writing AutoscalingPolicy to clients/dataproc/lib/google_api/dataproc/v1/model/autoscaling_policy.ex.
Writing BasicAutoscalingAlgorithm to clients/dataproc/lib/google_api/dataproc/v1/model/basic_autoscaling_algorithm.ex.
Writing BasicYarnAutoscalingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/basic_yarn_autoscaling_config.ex.
Writing Binding to clients/dataproc/lib/google_api/dataproc/v1/model/binding.ex.
Writing CancelJobRequest to clients/dataproc/lib/google_api/dataproc/v1/model/cancel_job_request.ex.
Writing Cluster to clients/dataproc/lib/google_api/dataproc/v1/model/cluster.ex.
Writing ClusterConfig to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_config.ex.
Writing ClusterMetrics to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_metrics.ex.
Writing ClusterOperation to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation.ex.
Writing ClusterOperationMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation_metadata.ex.
Writing ClusterOperationStatus to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation_status.ex.
Writing ClusterSelector to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_selector.ex.
Writing ClusterStatus to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_status.ex.
Writing DiagnoseClusterRequest to clients/dataproc/lib/google_api/dataproc/v1/model/diagnose_cluster_request.ex.
Writing DiagnoseClusterResults to clients/dataproc/lib/google_api/dataproc/v1/model/diagnose_cluster_results.ex.
Writing DiskConfig to clients/dataproc/lib/google_api/dataproc/v1/model/disk_config.ex.
Writing Empty to clients/dataproc/lib/google_api/dataproc/v1/model/empty.ex.
Writing EncryptionConfig to clients/dataproc/lib/google_api/dataproc/v1/model/encryption_config.ex.
Writing Expr to clients/dataproc/lib/google_api/dataproc/v1/model/expr.ex.
Writing GceClusterConfig to clients/dataproc/lib/google_api/dataproc/v1/model/gce_cluster_config.ex.
Writing GetIamPolicyRequest to clients/dataproc/lib/google_api/dataproc/v1/model/get_iam_policy_request.ex.
Writing GetPolicyOptions to clients/dataproc/lib/google_api/dataproc/v1/model/get_policy_options.ex.
Writing HadoopJob to clients/dataproc/lib/google_api/dataproc/v1/model/hadoop_job.ex.
Writing HiveJob to clients/dataproc/lib/google_api/dataproc/v1/model/hive_job.ex.
Writing InstanceGroupAutoscalingPolicyConfig to clients/dataproc/lib/google_api/dataproc/v1/model/instance_group_autoscaling_policy_config.ex.
Writing InstanceGroupConfig to clients/dataproc/lib/google_api/dataproc/v1/model/instance_group_config.ex.
Writing InstantiateWorkflowTemplateRequest to clients/dataproc/lib/google_api/dataproc/v1/model/instantiate_workflow_template_request.ex.
Writing Job to clients/dataproc/lib/google_api/dataproc/v1/model/job.ex.
Writing JobMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/job_metadata.ex.
Writing JobPlacement to clients/dataproc/lib/google_api/dataproc/v1/model/job_placement.ex.
Writing JobReference to clients/dataproc/lib/google_api/dataproc/v1/model/job_reference.ex.
Writing JobScheduling to clients/dataproc/lib/google_api/dataproc/v1/model/job_scheduling.ex.
Writing JobStatus to clients/dataproc/lib/google_api/dataproc/v1/model/job_status.ex.
Writing KerberosConfig to clients/dataproc/lib/google_api/dataproc/v1/model/kerberos_config.ex.
Writing LifecycleConfig to clients/dataproc/lib/google_api/dataproc/v1/model/lifecycle_config.ex.
Writing ListAutoscalingPoliciesResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_autoscaling_policies_response.ex.
Writing ListClustersResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_clusters_response.ex.
Writing ListJobsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_jobs_response.ex.
Writing ListOperationsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_operations_response.ex.
Writing ListWorkflowTemplatesResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_workflow_templates_response.ex.
Writing LoggingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/logging_config.ex.
Writing ManagedCluster to clients/dataproc/lib/google_api/dataproc/v1/model/managed_cluster.ex.
Writing ManagedGroupConfig to clients/dataproc/lib/google_api/dataproc/v1/model/managed_group_config.ex.
Writing NodeInitializationAction to clients/dataproc/lib/google_api/dataproc/v1/model/node_initialization_action.ex.
Writing Operation to clients/dataproc/lib/google_api/dataproc/v1/model/operation.ex.
Writing OrderedJob to clients/dataproc/lib/google_api/dataproc/v1/model/ordered_job.ex.
Writing ParameterValidation to clients/dataproc/lib/google_api/dataproc/v1/model/parameter_validation.ex.
Writing PigJob to clients/dataproc/lib/google_api/dataproc/v1/model/pig_job.ex.
Writing Policy to clients/dataproc/lib/google_api/dataproc/v1/model/policy.ex.
Writing PrestoJob to clients/dataproc/lib/google_api/dataproc/v1/model/presto_job.ex.
Writing PySparkJob to clients/dataproc/lib/google_api/dataproc/v1/model/py_spark_job.ex.
Writing QueryList to clients/dataproc/lib/google_api/dataproc/v1/model/query_list.ex.
Writing RegexValidation to clients/dataproc/lib/google_api/dataproc/v1/model/regex_validation.ex.
Writing ReservationAffinity to clients/dataproc/lib/google_api/dataproc/v1/model/reservation_affinity.ex.
Writing SecurityConfig to clients/dataproc/lib/google_api/dataproc/v1/model/security_config.ex.
Writing SetIamPolicyRequest to clients/dataproc/lib/google_api/dataproc/v1/model/set_iam_policy_request.ex.
Writing SoftwareConfig to clients/dataproc/lib/google_api/dataproc/v1/model/software_config.ex.
Writing SparkJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_job.ex.
Writing SparkRJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_r_job.ex.
Writing SparkSqlJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_sql_job.ex.
Writing Status to clients/dataproc/lib/google_api/dataproc/v1/model/status.ex.
Writing SubmitJobRequest to clients/dataproc/lib/google_api/dataproc/v1/model/submit_job_request.ex.
Writing TemplateParameter to clients/dataproc/lib/google_api/dataproc/v1/model/template_parameter.ex.
Writing TestIamPermissionsRequest to clients/dataproc/lib/google_api/dataproc/v1/model/test_iam_permissions_request.ex.
Writing TestIamPermissionsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/test_iam_permissions_response.ex.
Writing ValueValidation to clients/dataproc/lib/google_api/dataproc/v1/model/value_validation.ex.
Writing WorkflowGraph to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_graph.ex.
Writing WorkflowMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_metadata.ex.
Writing WorkflowNode to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_node.ex.
Writing WorkflowTemplate to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_template.ex.
Writing WorkflowTemplatePlacement to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_template_placement.ex.
Writing YarnApplication to clients/dataproc/lib/google_api/dataproc/v1/model/yarn_application.ex.
Writing Projects to clients/dataproc/lib/google_api/dataproc/v1/api/projects.ex.
Writing connection.ex.
Writing metadata.ex.
Writing mix.exs
Writing README.md
Writing LICENSE
Writing .gitignore
Writing config/config.exs
Writing test/test_helper.exs
fixing file permissions
2020-05-11 15:11:17,758 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/dataproc/synth.metadata'
2020-05-11 15:11:17 [ERROR] Synthesis failed
2020-05-11 15:11:17,790 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--', 'Dataproc']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth is still having trouble generating Dataproc. :sob:

Here's the output from running synth.py:

2020-05-12 05:10:43 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-12 05:10:43,771 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-dataproc'
2020-05-12 05:10:45 [INFO] Running synthtool
2020-05-12 05:10:45,525 autosynth > Running synthtool
2020-05-12 05:10:45 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-12 05:10:45,525 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--']
2020-05-12 05:10:45,741 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-dataproc
nothing to commit, working tree clean
2020-05-12 05:10:45,817 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-12 05:10:46,272 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh Dataproc
/workspace /workspace
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.
Resolving Hex dependencies...
Dependency resolution completed:
Unchanged:
  certifi 2.5.1
  google_api_discovery 0.7.0
  google_gax 0.3.2
  hackney 1.15.2
  idna 6.0.0
  jason 1.2.0
  metrics 1.0.1
  mime 1.3.1
  mimerl 1.2.0
  oauth2 0.9.4
  parse_trans 3.3.0
  poison 3.1.0
  ssl_verify_fun 1.1.5
  temp 0.4.7
  tesla 1.3.3
  unicode_util_compat 0.4.1
A new Hex version is available (0.20.1 < 0.20.5), please update with `mix local.hex`
All dependencies are up to date
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.

12:10:48.889 [info]  FETCHING: https://dataproc.googleapis.com/$discovery/GOOGLE_REST_SIMPLE_URI?version=v1

12:10:49.059 [info]  FOUND: https://dataproc.googleapis.com/$discovery/GOOGLE_REST_SIMPLE_URI?version=v1
Revision check: old=20200409, new=20200409, generating=true
Creating leading directories
Writing AcceleratorConfig to clients/dataproc/lib/google_api/dataproc/v1/model/accelerator_config.ex.
Writing AutoscalingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/autoscaling_config.ex.
Writing AutoscalingPolicy to clients/dataproc/lib/google_api/dataproc/v1/model/autoscaling_policy.ex.
Writing BasicAutoscalingAlgorithm to clients/dataproc/lib/google_api/dataproc/v1/model/basic_autoscaling_algorithm.ex.
Writing BasicYarnAutoscalingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/basic_yarn_autoscaling_config.ex.
Writing Binding to clients/dataproc/lib/google_api/dataproc/v1/model/binding.ex.
Writing CancelJobRequest to clients/dataproc/lib/google_api/dataproc/v1/model/cancel_job_request.ex.
Writing Cluster to clients/dataproc/lib/google_api/dataproc/v1/model/cluster.ex.
Writing ClusterConfig to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_config.ex.
Writing ClusterMetrics to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_metrics.ex.
Writing ClusterOperation to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation.ex.
Writing ClusterOperationMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation_metadata.ex.
Writing ClusterOperationStatus to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_operation_status.ex.
Writing ClusterSelector to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_selector.ex.
Writing ClusterStatus to clients/dataproc/lib/google_api/dataproc/v1/model/cluster_status.ex.
Writing DiagnoseClusterRequest to clients/dataproc/lib/google_api/dataproc/v1/model/diagnose_cluster_request.ex.
Writing DiagnoseClusterResults to clients/dataproc/lib/google_api/dataproc/v1/model/diagnose_cluster_results.ex.
Writing DiskConfig to clients/dataproc/lib/google_api/dataproc/v1/model/disk_config.ex.
Writing Empty to clients/dataproc/lib/google_api/dataproc/v1/model/empty.ex.
Writing EncryptionConfig to clients/dataproc/lib/google_api/dataproc/v1/model/encryption_config.ex.
Writing Expr to clients/dataproc/lib/google_api/dataproc/v1/model/expr.ex.
Writing GceClusterConfig to clients/dataproc/lib/google_api/dataproc/v1/model/gce_cluster_config.ex.
Writing GetIamPolicyRequest to clients/dataproc/lib/google_api/dataproc/v1/model/get_iam_policy_request.ex.
Writing GetPolicyOptions to clients/dataproc/lib/google_api/dataproc/v1/model/get_policy_options.ex.
Writing HadoopJob to clients/dataproc/lib/google_api/dataproc/v1/model/hadoop_job.ex.
Writing HiveJob to clients/dataproc/lib/google_api/dataproc/v1/model/hive_job.ex.
Writing InstanceGroupAutoscalingPolicyConfig to clients/dataproc/lib/google_api/dataproc/v1/model/instance_group_autoscaling_policy_config.ex.
Writing InstanceGroupConfig to clients/dataproc/lib/google_api/dataproc/v1/model/instance_group_config.ex.
Writing InstantiateWorkflowTemplateRequest to clients/dataproc/lib/google_api/dataproc/v1/model/instantiate_workflow_template_request.ex.
Writing Job to clients/dataproc/lib/google_api/dataproc/v1/model/job.ex.
Writing JobMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/job_metadata.ex.
Writing JobPlacement to clients/dataproc/lib/google_api/dataproc/v1/model/job_placement.ex.
Writing JobReference to clients/dataproc/lib/google_api/dataproc/v1/model/job_reference.ex.
Writing JobScheduling to clients/dataproc/lib/google_api/dataproc/v1/model/job_scheduling.ex.
Writing JobStatus to clients/dataproc/lib/google_api/dataproc/v1/model/job_status.ex.
Writing KerberosConfig to clients/dataproc/lib/google_api/dataproc/v1/model/kerberos_config.ex.
Writing LifecycleConfig to clients/dataproc/lib/google_api/dataproc/v1/model/lifecycle_config.ex.
Writing ListAutoscalingPoliciesResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_autoscaling_policies_response.ex.
Writing ListClustersResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_clusters_response.ex.
Writing ListJobsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_jobs_response.ex.
Writing ListOperationsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_operations_response.ex.
Writing ListWorkflowTemplatesResponse to clients/dataproc/lib/google_api/dataproc/v1/model/list_workflow_templates_response.ex.
Writing LoggingConfig to clients/dataproc/lib/google_api/dataproc/v1/model/logging_config.ex.
Writing ManagedCluster to clients/dataproc/lib/google_api/dataproc/v1/model/managed_cluster.ex.
Writing ManagedGroupConfig to clients/dataproc/lib/google_api/dataproc/v1/model/managed_group_config.ex.
Writing NodeInitializationAction to clients/dataproc/lib/google_api/dataproc/v1/model/node_initialization_action.ex.
Writing Operation to clients/dataproc/lib/google_api/dataproc/v1/model/operation.ex.
Writing OrderedJob to clients/dataproc/lib/google_api/dataproc/v1/model/ordered_job.ex.
Writing ParameterValidation to clients/dataproc/lib/google_api/dataproc/v1/model/parameter_validation.ex.
Writing PigJob to clients/dataproc/lib/google_api/dataproc/v1/model/pig_job.ex.
Writing Policy to clients/dataproc/lib/google_api/dataproc/v1/model/policy.ex.
Writing PrestoJob to clients/dataproc/lib/google_api/dataproc/v1/model/presto_job.ex.
Writing PySparkJob to clients/dataproc/lib/google_api/dataproc/v1/model/py_spark_job.ex.
Writing QueryList to clients/dataproc/lib/google_api/dataproc/v1/model/query_list.ex.
Writing RegexValidation to clients/dataproc/lib/google_api/dataproc/v1/model/regex_validation.ex.
Writing ReservationAffinity to clients/dataproc/lib/google_api/dataproc/v1/model/reservation_affinity.ex.
Writing SecurityConfig to clients/dataproc/lib/google_api/dataproc/v1/model/security_config.ex.
Writing SetIamPolicyRequest to clients/dataproc/lib/google_api/dataproc/v1/model/set_iam_policy_request.ex.
Writing SoftwareConfig to clients/dataproc/lib/google_api/dataproc/v1/model/software_config.ex.
Writing SparkJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_job.ex.
Writing SparkRJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_r_job.ex.
Writing SparkSqlJob to clients/dataproc/lib/google_api/dataproc/v1/model/spark_sql_job.ex.
Writing Status to clients/dataproc/lib/google_api/dataproc/v1/model/status.ex.
Writing SubmitJobRequest to clients/dataproc/lib/google_api/dataproc/v1/model/submit_job_request.ex.
Writing TemplateParameter to clients/dataproc/lib/google_api/dataproc/v1/model/template_parameter.ex.
Writing TestIamPermissionsRequest to clients/dataproc/lib/google_api/dataproc/v1/model/test_iam_permissions_request.ex.
Writing TestIamPermissionsResponse to clients/dataproc/lib/google_api/dataproc/v1/model/test_iam_permissions_response.ex.
Writing ValueValidation to clients/dataproc/lib/google_api/dataproc/v1/model/value_validation.ex.
Writing WorkflowGraph to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_graph.ex.
Writing WorkflowMetadata to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_metadata.ex.
Writing WorkflowNode to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_node.ex.
Writing WorkflowTemplate to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_template.ex.
Writing WorkflowTemplatePlacement to clients/dataproc/lib/google_api/dataproc/v1/model/workflow_template_placement.ex.
Writing YarnApplication to clients/dataproc/lib/google_api/dataproc/v1/model/yarn_application.ex.
Writing Projects to clients/dataproc/lib/google_api/dataproc/v1/api/projects.ex.
Writing connection.ex.
Writing metadata.ex.
Writing mix.exs
Writing README.md
Writing LICENSE
Writing .gitignore
Writing config/config.exs
Writing test/test_helper.exs
fixing file permissions
2020-05-12 05:10:50,254 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/dataproc/synth.metadata'
2020-05-12 05:10:50 [ERROR] Synthesis failed
2020-05-12 05:10:50,285 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/dataproc/synth.metadata', 'synth.py', '--', 'Dataproc']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation commented 4 years ago

Autosynth passed, closing! :green_heart: