Data Monitoring at 250 Gbit/s with Facebook

Описание: Inside Facebook, the team has always provided monitoring as a service. This allows them to keep application monitoring both approachable and powerful to serve use cases of different complexity. They enable realtime analysis, regressions and anomaly detection, as well as root-causing site-level issues to specific applications and nodes causing them within minutes. Being a radar and powering automations for Facebook Infrastructure is a big scalability challenge. Learn how Facebook scaled its real-time monitoring system 20x and now peaking at 250 Gbit/s ingestion rate. They'll dive into the monitoring system's architecture evolution and some of the problems they faced along the way. They'll also discuss current challenges, including anomaly detection at scale, driving data exploration, and intelligent spam fighting.

By - Ostap Korkuna