Zero-downtime node drains
Why replacing a node can cause 5xx errors, and the small set of settings that prevent it: the shutdown timers, PDBs, spread, readiness gates
I’m a software engineer. I build scalable, high-performance systems.
I write things up here as I work them out — mostly networking, systems and backend. Written first for me, published in case they’re useful to you.
Start with the engineering notes, or read more about me.
Why replacing a node can cause 5xx errors, and the small set of settings that prevent it: the shutdown timers, PDBs, spread, readiness gates
The AWS services that are critical or worth learning, each from first principles: the problem, the idea, how it works, and the traps
Firewalling pods from first principles: why IP rules fail, how NetworkPolicy works, how eBPF and Cilium enforce it, and what it costs in latency
How a packet actually moves in Kubernetes, built up from Linux primitives: namespaces, veth, routes, netfilter, CNI, Services, DNS
Node autoscaling from first principles: what it solves, how it decides, every knob, and how to run it safely
Event based scaling