Mastering Argo Workflows at Scale: A Practical Guide to Scalability...- Tim Collins & Alec Stansell

Описание: Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Mastering Argo Workflows at Scale: A Practical Guide to Scalability Excellence - Tim Collins, Pipekit & Alec Stansell, Fetch Analytics

As your organization's data, CI and workflow demands grow, so does the need to scale your Argo Workflows infrastructure effectively. This talk will equip you with the knowledge and practical guidance to navigate the challenges of scaling Argo Workflows, ensuring your pipelines remain performant and resilient even at massive scale. Gain valuable insights from Fetch Analytics' firsthand experience scaling Argo Workflows from single-pod deployments to handling over 18,000 pods per workflow. We will cover the following considerations: - Infrastructure Optimization: Explore strategies for selecting the right (virtual) hardware for your workload. - Resource Management: Learn how to effectively manage resources across your cluster. - Workflow Design: Discover best practices for designing workflows for scalability, considering factors like concurrency and error handling. - Observability Stack: Equip yourself with an observability checklist to monitor and troubleshoot your workflows at scale.