8548 views • Designing μ-services
Microservices give us the flexibility to pick the best tech stack to solve the problem optimally. But one thing that ruins the real thrill is Timeouts.
Say we have a blogging website where a user can search for blogs. The request comes to the Search service, and it finds the most relevant blogs for the query.
In the response, a field called total_views should hold the total number of views the blog received in its lifetime. The search services should talk to the Analytics service synchronously to get the data. This synchronous dependency is the root of all evil.
The core problem: Delays can be arbitrarily large
Because the delay depending on service can be arbitrarily large, we know how long to wait for the response. We for sure cannot wait forever, and hence we introduce Timeout. Every time the Search service invokes the Analytics service, it starts a timer, and if it does not get a response in the stipulated time, it timeout and moves on.
There are 5 approaches to handling timeouts.
If you like what you read subscribe you can always subscribe to my newsletter and get the post delivered straight to your inbox. I write essays on various engineering topics and share it through my weekly newsletter.
A set of courses designed to make you a better engineer and excel at your career; no-fluff, pure engineering.
A masterclass that helps early engineers and product managers become great at designing scalable systems.
300+ learners
Details →A masterclass that helps you become great at designing scalable, fault-tolerant, and highly available systems.
1000+ learners
Details →Learn internals of Redis by re-implementing some of the core features in Golang.
98+ learners
Details →A free playlist to help you understand Microservices and their high-level patterns in depth.
823+ learners
Details →A free playlist to help you learn core engineering from outages that happened at GitHub.
651+ learners
Details →A free playlist to help you understand the internal workings and construction of Hash Tables.
1027+ learners
Details →A free playlist to help you understand the algorithms and strategies that power P2P networks and BitTorrent.
692+ learners
Details →Being a passionate engineer, I love to talk about a wide range of topics, but these are my personal favourites.
Arpit's Newsletter read by 38000+ engineers
Weekly essays on real-world system design, distributed systems, or a deep dive into some super-clever algorithm.