Scale By The Bay 2020: Natan Silnitsky, 8 Lessons Learned from using Kafka with 1000 microservices

Описание: ai.bythebay.io Nov 2025, Oakland, full-stack AI conference Title:
8 Lessons Learned from using Kafka with 1000 Scala microservices

Kafka is the bedrock of Wix's distributed microservices system. For the last 5 years we have learned a lot about how to successfully scale our event-driven architecture to roughly 1500 microservices, mostly written in Scala. We’ve managed to achieve higher decoupling and independence for our various services and dev teams that have very different use-cases while maintaining a single uniform infrastructure in place. Our Kafka infrastructure is called Greyhound and was recently completely re-written using ZIO. In this talk you will learn about 8 key decisions and steps you can take in order to safely scale-up your Kafka-based system. These include:
How to increase dev velocity of event driven style code.
How to optimize working with Kafka in polyglot setting
How to support a growing amount of traffic and developers.

Natan Silnitsky
Wix.com
Backend Infra Developer
Websitehttps://natansil.com/
Natan Silnitsky is a backend-infra engineer @Wix.com. He is on the Data streaming team in charge of building event driven libraries and tools on top of Kafka and ZIO. Before that he was part of a task force that was responsible for building the next generation CI system at Wix on top of Google's Bazel build tool. Has many years of experience as a developer of large scale web services - First in .Net, later in Scala. Natan's passions include clean and functional code, dev velocity and great software design.