Google Cloud Support

[loganjhennessy]

Is Google Cloud support envisioned for the future? Some things that I'd like to see:

• Google Cloud Storage as a repo, analogous to S3
• DataProc as a notebook runner, analogous to EMR
• Ability to store secrets so that cloud credentials can be stored safety and accessed by notebooks running on ZEPL

[Leemoonsoo]

Thanks @loganjhennessy for great question!

• Google Cloud Storage as a repo, analogous to S3

  Currently, ZEPL can read Apache Zeppelin and Jupyter notebooks, that

  • Created in ZEPL
  • Saved in S3 (and keep sync)
  • Pushed in github (and keep sync)
  • Uploaded from browser

  So, Google Cloud Storage as a notebook repo can come together with Google Cloud support in the future.

• DataProc as a notebook runner, analogous to EMR

  ZEPL currently runs notebook inside containerized environment on AWS. We have plan to make ZEPL run notebook on more various environments like Kubernetes cluster with various resource type like GPU/TPU.

  Regarding EMR and DataProc, ZEPL currently does not directly support EMR although user able to use Apache Zeppelin provided by EMR with ZEPL. We also have a plan to support Spark cluster inside the ZEPL. In this case, EMR is one of option we're considering and DataProc can be an option as well.

• Ability to store secrets so that cloud credentials can be stored safety and accessed by notebooks running on ZEPL

  This is a topic definitely we're looking at.