search

ankurchavda / streamify

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
544 stars 113 forks source link

I have an error when I launch the terraform apply #4

Open mbiombani opened 2 years ago

mbiombani commented 2 years ago

│ Error: Invalid value for network: project: required field is not set │ │ with google_compute_firewall.rules, │ on main.tf line 19, in resource "google_compute_firewall" "port_rules": │ 19: resource "google_compute_firewall" "port_rules" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_compute_instance.kafka_vm_instance, │ on main.tf line 35, in resource "google_compute_instance" "kafka_vm_instance": │ 35: resource "google_compute_instance" "kafka_vm_instance" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_compute_instance.airflow_vm_instance, │ on main.tf line 56, in resource "google_compute_instance" "airflow_vm_instance": │ 56: resource "google_compute_instance" "airflow_vm_instance" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_storage_bucket.bucket, │ on main.tf line 75, in resource "google_storage_bucket" "bucket": │ 75: resource "google_storage_bucket" "bucket" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_dataproc_cluster.mulitnode_spark_cluster, │ on main.tf line 93, in resource "google_dataproc_cluster" "mulitnode_spark_cluster": │ 93: resource "google_dataproc_cluster" "mulitnode_spark_cluster" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_bigquery_dataset.stg_dataset, │ on main.tf line 139, in resource "google_bigquery_dataset" "stg_dataset": │ 139: resource "google_bigquery_dataset" "stg_dataset" { │ ╵ ╷ │ Error: project: required field is not set │ │ with google_bigquery_dataset.prod_dataset, │ on main.tf line 146, in resource "google_bigquery_dataset" "prod_dataset": │ 146: resource "google_bigquery_dataset" "prod_dataset" { │

ankurchavda commented 2 years ago

You must be getting a prompt to enter project and bucket values when running terraform plan and terraform apply. Are you setting up these values?

mbiombani commented 2 years ago

yes

mbiombani commented 2 years ago

it works with this command

terraform apply -var="project="

mbiombani commented 2 years ago

can I have your dashboard please

ankurchavda commented 2 years ago

It should work without -var="project=" also, not sure what's wrong. But glad it's working for you. You can check the dashboard here. Please don't query a lot, I am not sure how Bigquery will charge for this if any haha.

mbiombani commented 2 years ago

It should work without -var="project=" also, not sure what's wrong. But glad it's working for you. You can check the dashboard here. Please don't query a lot, I am not sure how Bigquery will charge for this if any haha.

oh I thought it was a json or xml file for dashboard