Comparing Apache Spark on Kubernetes to Kubeflow

Описание: Kubeflow is great for a lot of data science and machine learning problems, but is it always the best choice? In this talk, Salman takes a contrarian stance at looks at situations where alternatives like Apache Spark might be a better fit. Spark can perform machine learning tasks very quickly on large data sets. Kubernetes is an extensible platform for managing and orchestrating containers and services across cluster of multiple machines. In this talk you will see why running Spark on Kubernetes can be a winning combination for certain use cases.

You will learn what Spark is and how it utilises capabilities of Kubernetes to perform its tasks in a scalable and efficient manner. With the help of live demos you will also run how to install & manage Spark on Kubernetes cluster and how to submit and monitor Spark applications on Kubernetes.

Salman Iqbal works as an MLOps Engineer at Appvia and a Kuberenetes Instructor at Learnk8s. He has worked with a number of organisations in setting up Machine Learning platforms for teams to operate at scale. He is also a Certified Kubernetes Administrator and a strong advocate for Cloud Native technologies. He co-founded Cloud Native Wales, an initiative to bring together a community that shares ideas on how to use cloud native technologies effectively.

Recorded on Oct 7, 2021 at the Data Science, Machine Learning,
MLOps and Kubeflow Meetup

https://www.meetup.com/pro/sv-data-sc...


#machinelearning #datascience #kubeflow #mlops #spark