Parquet Format in Azure Data Factory | Using Self Hosted IR In Azure Data Factory ADF Tutorial 2022

Описание: Parquet Format in Azure Data Factory | Using Self Hosted IR In Azure Data Factory ADF Tutorial 2022

How to create Parquet File from CSV file by using Self Hosted IR or how to create CSV File from Parquet File from
SHIR VM by using Self Hosted IR.
Often you get this error when reading Parquet or writing Parquet format.
UserErrorJreNotFound error message when you run a copy activity to Azure
ErrorCode=UserErrorJreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment is not found. Go to http://go.microsoft.com/fwlink/?LinkI... to download and install on your Integration Runtime (Self-hosted) node machine. Note 64-bit Integration Runtime requires 64-bit JRE and 32-bit Integration Runtime requires 32-bit JRE.,Source=Microsoft.DataTransfer.Common,''Type=System.DllNotFoundException,Message=Unable to load DLL 'jvm.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E),Source=Microsoft.DataTransfer.Richfile.HiveOrcBridge

In this video you will learn all topics
How to create Azure VM - Windows Server 2019
How to Install Self Hosted IR on Windows Server 2019
How to setup Self Hosted IR in Azure Data Factory
Read Data from CSV File from Blob Storage and write to Self Hosted IR VM File Share
How to create pipeline to create CSV File from Blob storage and write to SHIR VM as Parquet Format
How to Install JRE on Windows VM To support Parquet file Format
Read Parquet file form SHIR VM Share and write to CSV File on Blob Storage