Run Serverless Spark in BigQuery | Step-by-step Guide + Real Example

Описание: In this video, I’ll provide a detailed, step-by-step guide for running Serverless Spark Stored Procedures in BigQuery.

This video is useful for Data Engineers, Data Analysts, and Data Scientists —especially if you're working in BigQuery on Google Cloud Platform and want to integrate Spark into your workflow.

🧠 For a deeper dive, check out my FREE article:
Spark Stored Procedures in BigQuery: A Practical Guide That Works (Part 1)
  / spark-stored-procedures-in-bigquery-a-prac...  

📌 Chapters:
00:00 Intro
00:40 Why would you use Spark Stored Procedures in BigQuery + Real world example from my job as a Data Engineer
02:15 Creating GCP project
02:42 Verify prerequisites
03:31 Enable BigQuery connection API
03:48 Create a Service Account for the procedure
05:00 Create Cloud Storage Bucket
05:46 Create a dataset in BigQuery
06:20 Configure Spark stored procedure in BigQuery
08:18 Add PySpark code and run stored procedure
10:53 Verify the results
12:11 Deep dive article overview
=========
Hi friend, my name is Eugene and I'm just a dev 👨🏼‍💻
I've been in tech for 5 years, working as a Data Engineer 📊
Join me on this journey, and let’s build an honest, open, supportive, authentic dev community of learners and builders.