PySpark Learning Series | 07-Create DataFrames from Parquet, JSON and CSV

Описание: PySpark Learning Series | 07-Create DataFrames from Parquet, JSON & CSV

In this video we will learn how to create dataframe from parquet file, how to create dataframe from JSON file and how to create dataframe from csv file in pyspark. We will also learn what is meant by inferschema in csv file. We will use spark.read.load command to load the files into dataframes.