Vertical vs horizontal scaling for a CPU-bound order service
Our order service runs on two c6i.2xlarge nodes and hits 80% CPU during the evening peak, which is about 4× the daily average. Option A: move to c6i.8xlarge. One config change, no code changes. Option B: go horizontal, more smaller nodes behind the load balancer with…