Apache Spark - Window Functions, SparkUI- what, how to look all info , RangePartitioner

Описание: This video covers multiple Spark topics

1. It starts with explaining Windows functions in Spark with examples.
2. Then it talks about Spark UI. What all info it has and how to look for each type of info.
3. After that it cover Range Partitioner. Explains what Range Partitioner is etc.

In the beginning, how to use off heap memory to persist Spark dataset is discussed. The article referred is -   / spark-save-dataset-memory-outside-heap-san...  

Link for Ppts used the the video is - https://drive.google.com/file/d/1jNA3...