search

gluent / goe

GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.
Apache License 2.0
8 stars 2 forks source link

Add support for Spark via ephemeral Dataproc clusters #147

Open nj1973 opened 6 months ago

nj1973 commented 6 months ago

Another option for accessing Spark is using Dataproc ephemeral clusters.

https://cloud.google.com/dataproc/docs/concepts/workflows/overview

We should look into whether this is a useful transport method for GOE and if it is simple to implement through the existing gcloud command structure.