RDD vs Dataframe vs Dataset | Spark Interview Question Series | Spark tutorial | Dataframe | Dataset

Описание: This video is the part of Spark interview questions and answers series 2019.In this video we have gone through several metrics to find the differences between RDD, Dataframe and Dataset.

We have discussed these three APIs based on the metrics like API,Available to languages ,Records representation within these APIs,Type safety,Serialization,Garbage collection overhead,Auto code optimization,Auto space efficiency, efficiency in terms of memory usage and control over the placement of partitions over the cluster.

I hope this video will be able to give you deep insight about RDD vs Dataframe vs Datasets and you would be able to answer in a better way if this question (comparison between RDD Dataframe and Dataset) pops up in Spark interview.

Our aim is to make difference in your learning.

Kindly subscribe to my channel and stay connected.

Thanks so much.

About channel
---------------------
We are trying to make video series on technical interview questions on various skills for experienced and freshers. This is based on the industry experience. We are trying to compile all the possible questions with answers and give you the core concepts of the topic.

We will present a series on tutorial on various skill sets as well. Our first tutorial will be on Apache Spark and we will present it soon.

Our aim is to make a difference in your learning.

Please subscribe to our channel and stay connected.

Thank you so much.

e-mail:- [email protected]

Parquet with Spark :    • Apache Parquet and Apache Spark | Spark in...  
--------------------------------

Type safety in Dataframe vs Dataset - Part 2 :    • Type Safety in Dataset vs Dataframe ( Part...  
----------------------------------------------------------------------

Type safety in Dataframe vs Dataset - Part 1 :    • Type Safety in Dataset vs Dataframe ( Part...  
----------------------------------------------------------------------

Broadcast variable example :    • Broadcast variable example | Spark Intervi...  
---------------------------------------------

Broadcast variable vs Normal variable :    • Broadcast variable in Spark |Shared variab...  
-------------------------------------------------------------

toDF() vs createDataFrame() :    • Spark Interview Questions and Answers Seri...  
----------------------------------------------

User defined function Part -1 :    • UDF ( Part 1) |  User defined function  | ...  
---------------------------------------------

User defined function Part - 2 :    • UDF (Part 2) | user defined function Examp...  
----------------------------------------------

Dataframe :    • What is Dataframe | Dataframe API | Spark ...  
-----------------

What is Apache Spark :    • What is Spark | Spark interview question |...  
------------------------------------