How to Build Data Pipelines for ML Projects (w/ Python Code)

Описание: 30 AI Projects You Can Build This Weekend: https://the-data-entrepreneurs.kit.co...

This is the 3rd video in a series on Full Stack Data Science. Here, discuss key aspects of building data pipelines for machine learning and share Python code for pulling transcripts from all my YouTube videos.

🎥 Series Playlist:    • Full Stack Data Science  

More Resources:
📰 Read more: https://medium.com/towards-data-scien...
💻 Example Code: https://github.com/ShawhinT/YouTube-B...

References:
[1] How Data Engineering Works:    • How Data Engineering Works  
[2] ETL vs ELT: https://aws.amazon.com/compare/the-di...
[3] YouTube Search API: https://developers.google.com/youtube...

--
Homepage: https://www.shawhintalebi.com/

Introduction - 0:00
Data Engineering - 0:34
Data Pipelines - 1:19
2 Types of Pipelines (ETL vs ELT) - 2:18
Extract - 4:30
Transform - 6:07
Load - 7:22
Orchestration - 9:06
Example Code: ETL of My YouTube Video Transcripts - 10:47
What's Next? - 21:34