Spark SQL – Spark basics & internals



 

1. Introduction & main features

 

2. Main Components & Architecture

 

3. RDD, DataFrames, Transformations (Narrow & Wide), Actions, Lazy Evaluation

 

4. Working with DataFrames using Scala and Spark SQL

 

5. Spark 3.0 new Features & Improvements