Closed acs closed 5 years ago
A Dataframe is an RDD with an schema, The key is howto manage the schema that defines the RDD contents. Scala case classes is a great way to do it. But there are others, like specifying manually the schema and use it to create the datafrane using the RDD.
Too specific for the intro. Closing.
Some nice references:
https://github.com/hortonworks/data-tutorials/wiki https://docs.databricks.com/spark/latest/dataframes-datasets/introduction-to-dataframes-scala.html