search

yuwtennis / google-data-engineer

Repository includes programs which was created while studying for google data engineer cert.
0 stars 0 forks source link

readme

google-data-engineer

Overview

Sets of code I have created while studying below book.

Data Science on the Google Cloud Platform
http://shop.oreilly.com/product/0636920057628.do

  1. Ch02. Ingesting Data into the Cloud
  2. Ch03. Creating Compelling Dashboard
  3. Ch04. Streaming Data' Publiation and Ingest
  4. Ch05. Interactive Data Exploration
  5. Ch06. Bayes Classifier on Cloud Dataproc

Instructions

Chapter 6

  1. Activate environment variables

    cd Ch06/dataproc
source env.sh

  2. Copy bootstrap script to google storage

    ./copy_to_gs.sh

  3. Start dataproc

    ./init_cluster.sh

  4. Remove cluster

    ./delete_cluster.sh