GoogleCloudPlatform / rad-lab

RAD Lab enables users to deploy infrastructure on Google Cloud Platform (GCP) to support specific use cases. Infrastructure is created and managed through Terraform in conjunction with support scripts written in Python. The templates, code, and documentation for each use case are bundled into modules.
Apache License 2.0
93 stars 80 forks source link

Silicon Design Module deployment is failing #84

Closed guptamukul-google closed 1 year ago

guptamukul-google commented 1 year ago

Describe the bug Silicon Design Module deployment is failing

To Reproduce Steps to reproduce the behavior:

  1. Go to Silicon Design module
  2. Execute terraform init & terraform apply -auto-approve
  3. See errors

ERROR FROM TERRAFORM LOGS:

null_resource.build_and_push_image (local-exec): BUILD FAILURE: Build step failure: build step 4 "gcr.io/cloud-builders/docker" failed: step exited with non-zero status: 1
null_resource.build_and_push_image (local-exec): ERROR: (gcloud.builds.submit) build 21fc5ef1-ff2a-443f-9530-07d0e3eca976 completed with status "FAILURE"
╷
│ Error: local-exec provisioner error
│ 
│   with null_resource.build_and_push_image,
│   on main.tf line 303, in resource "null_resource" "build_and_push_image":
│  303:   provisioner "local-exec" {
│ 
│ Error running command 'gcloud  --project=radlab-silicon-design-XXXX builds submit . --config ./scripts/build/cloudbuild.yaml --substitutions
│ "_ZONE=us-east4-c,_COMPUTE_IMAGE=silicon-design-ubuntu-2004,_CONTAINER_IMAGE=us-east4-docker.pkg.dev/radlab-silicon-design-XXXX/containers/silicon-design-ubuntu-2004,_NOTEBOOKS_BUCKET=radlab-silicon-design-XXXX-silicon-design-notebooks,_COMPUTE_NETWORK=projects/radlab-silicon-design-XXXX/global/networks/ai-notebook,_COMPUTE_SUBNET=projects/radlab-silicon-design-XXXX/regions/us-east4/subnetworks/subnet-ai-notebook,_CLOUD_BUILD_SA=sa-image-builder-identity@radlab-silicon-design-XXXX.iam.gserviceaccount.com"':
│ exit status 1. Output: Creating temporary tarball archive of 533 file(s) totalling 188.4 MiB before compression.
│ Uploading tarball of [.] to [gs://radlab-silicon-design-XXXX_cloudbuild/source/1668192690.218112-4248f207386c430eb8c8b2a47bcc08f6.tgz]
│ Created [https://cloudbuild.googleapis.com/v1/projects/radlab-silicon-design-XXXX/locations/global/builds/21fc5ef1-ff2a-443f-9530-07d0e3eca976].
│ Logs are available at [ https://console.cloud.google.com/cloud-build/builds/21fc5ef1-ff2a-443f-9530-07d0e3eca976?project=787069802309 ].
│ 
│ gcloud builds submit only displays logs from Cloud Storage. To view logs from Cloud Logging, run:
│ gcloud beta builds submit
│ 
│ 
│ BUILD FAILURE: Build step failure: build step 4 "gcr.io/cloud-builders/docker" failed: step exited with non-zero status: 1
│ ERROR: (gcloud.builds.submit) build 21fc5ef1-ff2a-443f-9530-07d0e3eca976 completed with status "FAILURE"
│ 
╵

Expected behavior The deployment should be successful without any issues.

Logs

CLOUD BUILD LOGS:

2022-11-11 11:06:57.526 PST Starting Step #4 - "container-image-test"
2022-11-11 11:06:57.528 PST Step #4 - "container-image-test": Already have image (with digest): gcr.io/cloud-builders/docker
2022-11-11 11:06:59.619 PST Step #4 - "container-image-test": OpenLane 9949f5d5f55749dc4b98648a25d355836895dc37
2022-11-11 11:06:59.619 PST Step #4 - "container-image-test": All rights reserved. (c) 2020-2022 Efabless Corporation and contributors.
2022-11-11 11:06:59.619 PST Step #4 - "container-image-test": Available under the Apache License, version 2.0. See the LICENSE file for more details.
2022-11-11 11:06:59.619 PST Step #4 - "container-image-test":
2022-11-11 11:06:59.937 PST Step #4 - "container-image-test": [WARNING]: OpenLane may not function properly: not enough values to unpack (expected 3, got 1)
2022-11-11 11:06:59.937 PST Step #4 - "container-image-test": The version of open_pdks used in building the PDK does not match the version OpenLane was tested on (installed: 5d4986783eeb354cc5ba490ae0b17750dd5cb9d3, tested: 0059588eebfc704681dc2368bd1d33d96281d10f)
2022-11-11 11:06:59.937 PST Step #4 - "container-image-test": This may introduce some issues. You may want to re-install the PDK by invoking `make pdk`.
2022-11-11 11:06:59.937 PST Step #4 - "container-image-test": The version of magic used in building the PDK does not match the version OpenLane was tested on (installed: 3534b7999480ed97b9311d2dd95231e54577adc5, tested: 94daf986ab9aa94a9ae2ac3539fa5def9bd2a1ac)
2022-11-11 11:06:59.937 PST Step #4 - "container-image-test": This may introduce some issues. You may want to re-install the PDK by invoking `make pdk`.
2022-11-11 11:07:00.103 PST Step #4 - "container-image-test": [INFO]: Using configuration in 'OpenLane/designs/inverter/config.json'...
2022-11-11 11:07:00.359 PST Step #4 - "container-image-test": [INFO]: PDK Root: /opt/conda/envs/silicon/share/pdk
2022-11-11 11:07:00.359 PST Step #4 - "container-image-test": [INFO]: Process Design Kit: sky130A
2022-11-11 11:07:00.371 PST Step #4 - "container-image-test": [INFO]: Standard Cell Library: sky130_fd_sc_hd
2022-11-11 11:07:00.371 PST Step #4 - "container-image-test": [INFO]: Optimization Standard Cell Library: sky130_fd_sc_hd
2022-11-11 11:07:00.622 PST Step #4 - "container-image-test": [INFO]: Run Directory: /OpenLane/designs/inverter/runs/RUN_2022.11.11_19.06.59
2022-11-11 11:07:00.702 PST Step #4 - "container-image-test": [INFO]: Preparing LEF files for the nom corner...
2022-11-11 11:07:01.404 PST Step #4 - "container-image-test": [ERROR]: during executing: "openroad -exit -no_init -python /OpenLane/scripts/odbpy/lefutil.py get_metal_layers -o /OpenLane/designs/inverter/runs/RUN_2022.11.11_19.06.59/tmp/layers.list /opt/conda/envs/silicon/share/pdk/sky130A/libs.ref/sky130_fd_sc_hd/techlef/sky130_fd_sc_hd__nom.tlef"
2022-11-11 11:07:01.411 PST Step #4 - "container-image-test": [ERROR]: Exit code: 1
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": [ERROR]: Last 10 lines:
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": OpenROAD dc11f5970c23ff81770fcbf705737516dad90b23
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": This program is licensed under the BSD-3 license. See the LICENSE file for details.
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": Components of this program may be licensed under more restrictive licenses which must be honored.
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": Unknown option: -e
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": usage: openroad [option] ... [-c cmd | -m mod | file | -] [arg] ...
2022-11-11 11:07:01.422 PST Step #4 - "container-image-test": Try `python -h' for more information.
2022-11-11 11:07:01.423 PST Step #4 - "container-image-test":
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": no such variable
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (read trace on "::env(CURRENT_DEF)")
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "lappend arg_list -def_path $::env(CURRENT_DEF)"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "save_final_views" line 18)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "save_final_views"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "flow_fail" line 5)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "flow_fail"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "try_catch" line 17)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "try_catch $::env(OPENROAD_BIN) -exit -no_init -python $::env(SCRIPTS_DIR)/odbpy/lefutil.py get_metal_layers -o $::env(TMP_DIR)/layers.list $arg_values..."
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "prep_lefs" line 36)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "prep_lefs -tech_lef $::env(TECH_LEF) -corner nom -env_var MERGED_LEF"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "prep" line 321)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "prep {*}$args"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (procedure "run_non_interactive_mode" line 12)
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "run_non_interactive_mode {*}$argv"
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": invoked from within
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": "if { [info exists flags_map(-interactive)] || [info exists flags_map(-it)] } {
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": if { [info exists arg_values(-file)] } {
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": run_file [file nor..."
2022-11-11 11:07:01.643 PST Step #4 - "container-image-test": (file "/OpenLane/flow.tcl" line 411)
2022-11-11 11:07:02.198 PST Finished Step #4 - "container-image-test"
github-actions[bot] commented 1 year ago

Thank you for raising the request! RAD Lab admins have been notified.