2021 Cloud Computing and Big Data Lecture 3 Apache Spark for Cloud Applications Part2 🖥️

Описание: Parallel & Scalable Machine Learning & Deep Learning
16 university lectures with additional practical lectures for hands-on exercises in context
The University of Iceland, School of Engineering and Natural Sciences
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science

Fall 2021

Course Outline

1. Cloud Computing & Big Data Introduction
2. Machine Learning Models in Clouds
3. Apache Spark for Cloud Applications
4. Virtualization & Data Center Design
5. Map-Reduce Computing Paradigm
6. Deep Learning driven by Big Data
7. Deep Learning Applications in Clouds
8. Infrastructure-As-A-Service (IAAS)
9. Platform-As-A-Service (PAAS)
10. Software-As-A-Service (SAAS)
11. Big Data Analytics & Cloud Data Mining
12. Docker & Container Management
13. OpenStack Cloud Operating System
14. Online Social Networking & Graph Databases
15. Big Data Streaming Tools & Applications
16. Epilogue


Lecture Outline

Part One: Basic Apache Spark Capabilities
Design Goals & Scalable Programming Model for Big Data
Resilient Distributed Datasets (RDDs) Concept & Example
Understanding Apache Spark RDD Transformations & Actions
Analysing Apache Spark vs. Apache Hadoop Parallel Performance
In-Memory Execution with Applications & AWS Costs Reviews

Part Two: Apache Spark Libraries for Advanced Applications
Structured Query Language (SQL) via PySpark in Jupyter Notebooks
Machine Learning Library (MLlib) & Selected Algorithm Examples
Streaming Library & GraphX Library with PageRank Application
Machine Learning Applications in Clouds & PySpark in Google Colab

Examples of Apache Spark in Business Applications & Ecosystem Examples