Introduction to Spark DataFrames/SQL and Deep dive

Описание: In our last meetup ( refer link : http://www.meetup.com/Big-Data-Develo..., we discussed about spark, its unit of abstraction i.e. RDDs, and RDD Internals.

Continuing from our earlier efforts, we will discuss the next level of abstraction upon RDDS i.e. DataFrames, and also a peek into spark SQL

Agenda :

· Introduction to DataFrames

· Internals of a DataFrame and spark SQL

· Optimization Techniques.

· We will supplement theory concepts with sufficient examples

Speakers :

Ravi (Developer at IBM Labs)

Profile :   / ravishankarks  

Sachin Parmar(Developer at IBM Labs)

Profile :   / sachinparmar  

PS : We will upload demo code a few days in advance.

Github Link for Demo Code:

https://github.com/parmarsachin/spark...

Previous meetup video:    • Apache Spark Introduction and RDD basics a...