sanori / spark-sql-example

Spark batch script examples that is written in only SQL
0 stars 1 forks source link
spark spark-sql sql

Spark scripts only in SQL

SparkSQL only examples that process William Shakespeare's plays. The text of William Shakespeare's plays are from https://old.datahub.io/dataset/william-shakespeare-plays .

How to run

SQL scripts:

$SPARK_HOME/bin/spark-sql -f length_of_play.sql

Python scripts:

$SPARK_HOME/bin/spark-submit length_of_play.py

References