GCP json file read from GCS/hdfs for Yarn Client

miraisolutions / sparkbq

Sparklyr extension package to connect to Google BigQuery

GNU General Public License v3.0

19 stars 3 forks source link

GCP json file read from GCS/hdfs for Yarn Client #10

Closed ghost closed 6 years ago

ghost commented 6 years ago

In spark_connect-master as yarn_client, Is there a way to pass gcpJSONkeyfile from GCS or HDFS rather than from a local file location? So that the credential exist and accessed from a centralized location

Thanks