1 0 EDA databricks (How to do exploratory data analysis in PySpark)

Описание: PySpark Exploratory Data Analysis
Demonstration of EDA in Databricks using PySpark & Seaborn
0:00 Introduction
3:11 Demo
30:24 Wrap up
In this demonstration, I will show how to run visualizations in PySpark.
Mostly, this involves converting a PySpark DataFrame to a Pandas DataFrame and then using the seaborn library to plot the data.

All notebooks are on GitHub: https://github.com/robinson-wn/datademo