Abhishek Varshney - From Polling to Pushing: Going Realtime with Go, gRPC, and Redis

Описание: In this talk, we introduce Propeller—a solution that fundamentally changes how frontends and backends communicate by replacing the classic request-response model with a real-time, streaming approach. Built on Go, goroutines, and Redis (with optional NATS integration), Propeller enables backend services to push data directly to clients without polling, drastically reducing latency and load.

Discover how Propeller’s bidirectional gRPC connections let you seamlessly subscribe to default and custom topics, delivering messages whenever events occur. This design has proven its worth at scale, powering critical use cases such as onboarding flows, payment status updates, and social proofing, all while handling tens of thousands of concurrent users and hundreds of thousands of goroutines.

Key insights include:

Simplifying complex challenges with efficient, cost-effective solutions.
Harnessing Go’s concurrency model (goroutines) to manage massive scale.
Leveraging Redis Pub/Sub, Redis Streams, and NATS/NATS JetStream for messaging.
Lessons learned from operating bidirectional streaming gRPC services at high volume.

Watch this session to understand how Propeller’s architecture and design patterns can elevate your approach to real-time data delivery and significantly improve performance and user experience at scale.