GoogleCloudPlatform / cortex-salesforce

Apache License 2.0
12 stars 23 forks source link

Guide for deployment of Salesforce data #1

Closed jinruisap closed 1 year ago

jinruisap commented 1 year ago

Hi,

I'm trying to deploy the Salesforce data to BQ. I've read guide for data foundation, https://github.com/GoogleCloudPlatform/cortex-data-foundation, and it works fine. Now for Salesforce data it looks like is different from what is recoded in data foundation.

I tried with

sh deploy.sh Or

gcloud builds submit --config=cloudbuild.sfdc.yaml --project xxx --substitutions _projectIdSource=xxx ,_projectIdTarget=xxx,_GCS_LOGS_BUCKET=xxx,_TGT_BUCKET=xxx

the error is "Config file is missing needed attributes or has empty value: ['projectIdSource', 'projectIdTarget']"

Could someone please help on this issue?

Thanks Rui

jinruisap commented 1 year ago

I filled the parameters within config.json It works for step1. now it fails at

InvalidUrlError: Cloud URL scheme should be followed by colon and two slashes: "://". Found: "gs:///data/bq_data_replication".
Finished Step #2 - "copy_dag_sql_files_to_gcs"
dotinfinity commented 1 year ago

Hi Rui, please deploy for Salesforce by running the Cloud Build from the root of the clone instead of from src/sfdc. i.e. Please follow Execute the Build section of the guide and set _DEPLOY_SAP=false and _DEPLOY_SFDC=true if you are only interested in deploying SFDC.

Thanks, Max

benschuler commented 1 year ago

Closing this issue as inactive. If there are still open questions, please let us know and we will be happy to assist you.