GoogleCloudPlatform / pubsec-declarative-toolkit

The GCP PubSec Declarative Toolkit is a collection of declarative solutions to help you on your Journey to Google Cloud. Solutions are designed using Config Connector and deployed using Config Controller.

Apache License 2.0

30 stars 28 forks source link

Porting: adapt LZ V2 logging into the LZ V1 - specifically organization/folder/project level routing for buckets and 3rd party pubsub integration #634

Open obriensystems opened 9 months ago

obriensystems commented 9 months ago

Revisit requirements and dev environment

folder level logs experimentation using gcloud or krm instead of terraform for throughput

Start with the existing KCC logging and monitoring architecture

https://github.com/GoogleCloudPlatform/pubsec-declarative-toolkit/blob/main/solutions/client-landing-zone/logging-project/cloud-logging-bucket.yaml

References

446

https://github.com/GoogleCloudPlatform/pbmm-on-gcp-onboarding/issues/318

obriensystems commented 9 months ago

Test log entries using a bigquery dataset curl

562


GOOGLE_CLOUD_PROJECT=bigquery-ol
ACCESS_TOKEN="$(gcloud auth application-default print-access-token)"
curl -H "Authorization: Bearer $ACCESS_TOKEN" "https://www.googleapis.com/bigquery/v2/projects/$GOOGLE_CLOUD_PROJECT/datasets"

following https://console.cloud.google.com/logs/query;query=resource.type%3D%22project%22;cursorTimestamp=2023-11-02T12:08:03.089167Z;duration=PT1H?project=bigquery-ol

https://cloud.google.com/logging/docs/export/configure_export_v2#gcloud