Thundering Herd Problem and How not to do API retries

Описание: System Design for SDE-2 and above: https://arpitbhayani.me/masterclass
System Design for Beginners: https://arpitbhayani.me/sys-design
Redis Internals: https://arpitbhayani.me/redis

Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - https://app.codecrafters.io/join?via=...

In the video, I explained the Thundering Herd problem that occurs when numerous clients simultaneously retry API calls, overwhelming the server. I discussed the implications of this issue and presented a solution involving adding random jitter and exponentially spacing out retries. This strategy prevents server overload and allows for better recovery. It's crucial to implement these techniques in retry logic to avoid server strain. The video aimed to educate viewers on this common problem and offer practical solutions for effective system design.

Recommended videos and playlists

If you liked this video, you will find the following videos and playlists helpful

System Design:    • PostgreSQL connection management and per-c...  
Designing Microservices:    • Should You Adopt Microservices? Here’s Wha...  
Database Engineering:    • How nested loop, hash, and merge joins work.  
Concurrency In-depth:    • How to write efficient and fair multi-thre...  
Research paper dissections:    • The Google File System - Paper Explained  
Outage Dissections:    • Dissecting GitHub Outage and things to do ...  

Hash Table Internals:    • Internal Structure of a Hash Table  
Bittorrent Internals:    • Introduction to BitTorrent and the problem...  

Things you will find amusing

Knowledge Base: https://arpitbhayani.me/knowledge-base
Bookshelf: https://arpitbhayani.me/bookshelf
Papershelf: https://arpitbhayani.me/papershelf

Other socials

I keep writing and sharing my practical experience and learnings every day, so if you resonate then follow along. I keep it no fluff.

LinkedIn:   / arpitbhayani  
Twitter:   / arpit_bhayani  
Weekly Newsletter: https://arpit.substack.com

Thank you for watching and supporting! it means a ton.

I am on a mission to bring out the best engineering stories from around the world and make you all fall in
love with engineering. If you resonate with this then follow along, I always keep it no-fluff.