yoshi-automation
commented
4 years ago Autosynth is still having trouble generating dlp. :sob:
Here's the output from running synth.py:
2020-06-07 03:45:33,340 synthtool [INFO] > 1.30.1
INFO:synthtool: 1.30.1
WARNING:root:object without properties GooglePrivacyDlpV2ActivateJobTriggerRequest: OrderedDict([(u'description', u'Request message for ActivateJobTrigger.'), (u'id', u'GooglePrivacyDlpV2ActivateJobTriggerRequest'), (u'properties', OrderedDict()), (u'type', u'object')])
WARNING:root:object without properties GooglePrivacyDlpV2CancelDlpJobRequest: OrderedDict([(u'type', u'object'), (u'id', u'GooglePrivacyDlpV2CancelDlpJobRequest'), (u'description', u'The request message for canceling a DLP job.'), (u'properties', OrderedDict())])
WARNING:root:object without properties GooglePrivacyDlpV2FinishDlpJobRequest: OrderedDict([(u'type', u'object'), (u'description', u'The request message for finishing a DLP hybrid job.'), (u'properties', OrderedDict()), (u'id', u'GooglePrivacyDlpV2FinishDlpJobRequest')])
WARNING:root:object without properties GooglePrivacyDlpV2HybridInspectResponse: OrderedDict([(u'type', u'object'), (u'id', u'GooglePrivacyDlpV2HybridInspectResponse'), (u'description', u'Quota exceeded errors will be thrown once quota has been met.'), (u'properties', OrderedDict())])
WARNING:root:object without properties GooglePrivacyDlpV2JobNotificationEmails: OrderedDict([(u'type', u'object'), (u'description', u"Enable email notification to project owners and editors on jobs's\ncompletion/failure."), (u'id', u'GooglePrivacyDlpV2JobNotificationEmails'), (u'properties', OrderedDict())])
WARNING:root:object without properties GooglePrivacyDlpV2LeaveUntransformed: OrderedDict([(u'id', u'GooglePrivacyDlpV2LeaveUntransformed'), (u'properties', OrderedDict()), (u'type', u'object'), (u'description', u'Skips the data without modifying it if the requested transformation would\ncause an error. For example, if a `DateShift` transformation were applied\nan an IP address, this mode would leave the IP address unchanged in the\nresponse.')])
WARNING:root:object without properties GooglePrivacyDlpV2Manual: OrderedDict([(u'description', u'Job trigger option for hybrid jobs. Jobs must be manually created\nand finished.'), (u'properties', OrderedDict()), (u'id', u'GooglePrivacyDlpV2Manual'), (u'type', u'object')])
WARNING:root:object without properties GooglePrivacyDlpV2PublishFindingsToCloudDataCatalog: OrderedDict([(u'id', u'GooglePrivacyDlpV2PublishFindingsToCloudDataCatalog'), (u'type', u'object'), (u'description', u'Publish findings of a DlpJob to Cloud Data Catalog. Labels summarizing the\nresults of the DlpJob will be applied to the entry for the resource scanned\nin Cloud Data Catalog. Any labels previously written by another DlpJob will\nbe deleted. InfoType naming patterns are strictly enforced when using this\nfeature. Note that the findings will be persisted in Cloud Data Catalog\nstorage and are governed by Data Catalog service-specific policy, see\nhttps://cloud.google.com/terms/service-terms\nOnly a single instance of this action can be specified and only allowed if\nall resources being scanned are BigQuery tables.\nCompatible with: Inspect'), (u'properties', OrderedDict())])
WARNING:root:object without properties GooglePrivacyDlpV2PublishSummaryToCscc: OrderedDict([(u'properties', OrderedDict()), (u'id', u'GooglePrivacyDlpV2PublishSummaryToCscc'), (u'description', u'Publish the result summary of a DlpJob to the Cloud Security\nCommand Center (CSCC Alpha).\nThis action is only available for projects which are parts of\nan organization and whitelisted for the alpha Cloud Security Command\nCenter.\nThe action will publish count of finding instances and their info types.\nThe summary of findings will be persisted in CSCC and are governed by CSCC\nservice-specific policy, see https://cloud.google.com/terms/service-terms\nOnly a single instance of this action can be specified.\nCompatible with: Inspect'), (u'type', u'object')])
WARNING:root:object without properties GooglePrivacyDlpV2PublishToStackdriver: OrderedDict([(u'description', u"Enable Stackdriver metric dlp.googleapis.com/finding_count. This\nwill publish a metric to stack driver on each infotype requested and\nhow many findings were found for it. CustomDetectors will be bucketed\nas 'Custom' under the Stackdriver label 'info_type'."), (u'id', u'GooglePrivacyDlpV2PublishToStackdriver'), (u'properties', OrderedDict()), (u'type', u'object')])
WARNING:root:object without properties GooglePrivacyDlpV2RedactConfig: OrderedDict([(u'description', u"Redact a given value. For example, if used with an `InfoTypeTransformation`\ntransforming PHONE_NUMBER, and input 'My phone number is 206-555-0123', the\noutput would be 'My phone number is '."), (u'id', u'GooglePrivacyDlpV2RedactConfig'), (u'type', u'object'), (u'properties', OrderedDict())])
WARNING:root:object without properties GooglePrivacyDlpV2ReplaceWithInfoTypeConfig: OrderedDict([(u'description', u'Replace each matching finding with the name of the info_type.'), (u'id', u'GooglePrivacyDlpV2ReplaceWithInfoTypeConfig'), (u'properties', OrderedDict()), (u'type', u'object')])
WARNING:root:object without properties GooglePrivacyDlpV2SurrogateType: OrderedDict([(u'type', u'object'), (u'properties', OrderedDict()), (u'id', u'GooglePrivacyDlpV2SurrogateType'), (u'description', u'Message for detecting output from deidentification transformations\nsuch as\n[`CryptoReplaceFfxFpeConfig`](/dlp/docs/reference/rest/v2/organizations.deidentifyTemplates#cryptoreplaceffxfpeconfig).\nThese types of transformations are\nthose that perform pseudonymization, thereby producing a "surrogate" as\noutput. This should be used in conjunction with a field on the\ntransformation such as `surrogate_info_type`. This CustomInfoType does\nnot support the use of `detection_rules`.')])
WARNING:root:object without properties GooglePrivacyDlpV2ThrowError: OrderedDict([(u'properties', OrderedDict()), (u'description', u'Throw an error and fail the request when a transformation error occurs.'), (u'type', u'object'), (u'id', u'GooglePrivacyDlpV2ThrowError')])
WARNING:root:object without properties GoogleProtobufEmpty: OrderedDict([(u'type', u'object'), (u'id', u'GoogleProtobufEmpty'), (u'description', u'A generic empty message that you can re-use to avoid defining duplicated\nempty messages in your APIs. A typical example is to use it as the request\nor the response type of an API method. For instance:\n\n service Foo {\n rpc Bar(google.protobuf.Empty) returns (google.protobuf.Empty);\n }\n\nThe JSON representation for `Empty` is empty JSON object `{}`.'), (u'properties', OrderedDict())])
Writing json metadata to clients/google-api-services-dlp/v2.metadata.json
2020-06-07 03:45:36,385 synthtool [DEBUG] > Wrote metadata to clients/google-api-services-dlp/synth.metadata.
DEBUG:synthtool:Wrote metadata to clients/google-api-services-dlp/synth.metadata.
2020-06-07 03:45:36,409 autosynth [DEBUG] > Running: git clean -fdx
Removing .cache/
Removing __pycache__/
Removing clients/google-api-services-dlp/synth.metadata
Removing generator/.cache/
Removing generator/ez_setup.pyc
Removing generator/src/google_apis_client_generator.egg-info/
Removing generator/src/googleapis/__init__.pyc
Removing generator/src/googleapis/codegen/__init__.pyc
Removing generator/src/googleapis/codegen/api.pyc
Removing generator/src/googleapis/codegen/api_exception.pyc
Removing generator/src/googleapis/codegen/api_library_generator.pyc
Removing generator/src/googleapis/codegen/data_types.pyc
Removing generator/src/googleapis/codegen/django_helpers.pyc
Removing generator/src/googleapis/codegen/filesys/__init__.pyc
Removing generator/src/googleapis/codegen/filesys/files.pyc
Removing generator/src/googleapis/codegen/filesys/filesystem_library_package.pyc
Removing generator/src/googleapis/codegen/filesys/library_package.pyc
Removing generator/src/googleapis/codegen/filesys/package_writer_foundry.pyc
Removing generator/src/googleapis/codegen/filesys/tar_library_package.pyc
Removing generator/src/googleapis/codegen/filesys/zip_library_package.pyc
Removing generator/src/googleapis/codegen/generate_library.pyc
Removing generator/src/googleapis/codegen/generator.pyc
Removing generator/src/googleapis/codegen/generator_lookup.pyc
Removing generator/src/googleapis/codegen/import_definition.pyc
Removing generator/src/googleapis/codegen/java_generator.pyc
Removing generator/src/googleapis/codegen/java_import_manager.pyc
Removing generator/src/googleapis/codegen/language_model.pyc
Removing generator/src/googleapis/codegen/schema.pyc
Removing generator/src/googleapis/codegen/targets.pyc
Removing generator/src/googleapis/codegen/template_helpers.pyc
Removing generator/src/googleapis/codegen/template_objects.pyc
Removing generator/src/googleapis/codegen/utilities/__init__.pyc
Removing generator/src/googleapis/codegen/utilities/convert_size.pyc
Removing generator/src/googleapis/codegen/utilities/html_stripper.pyc
Removing generator/src/googleapis/codegen/utilities/json_expander.pyc
Removing generator/src/googleapis/codegen/utilities/json_with_comments.pyc
Removing generator/src/googleapis/codegen/utilities/maven_utils.pyc
Removing generator/src/googleapis/codegen/utilities/name_validator.pyc
Traceback (most recent call last):
File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 615, in <module>
main()
File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 476, in main
return _inner_main(temp_dir)
File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 555, in _inner_main
).synthesize(base_synth_log_path)
File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 121, in synthesize
with open(log_file_path, "rt") as fp:
IsADirectoryError: [Errno 21] Is a directory: '/tmpfs/src/github/synthtool/logs/googleapis/google-api-java-client-services'
Google internal developers can see the full log here.
Hello! Autosynth couldn't regenerate dlp. :broken_heart:
Here's the output from running
synth.py:Google internal developers can see the full log here.