{"type":"excalidraw","version":2,"source":"https://AwesomeSystemDesign.dev","elements":[{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-1"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-1"},{"type":"arrow","id":"shape-10"}],"updated":0,"link":null,"locked":false,"id":"shape-0","type":"rectangle","seed":41,"x":36,"y":32.000000000000014,"width":390,"height":246.6,"customData":{"revealStep":1}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-1"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-1","type":"text","seed":114,"x":56,"y":50.000000000000014,"width":350,"height":210.6,"fontSize":18,"fontFamily":1,"text":"CACHE PROXY LAYER (optional)\n\n• Twemproxy / Envoy / mcrouter\n• Connection multiplexing (100K client\nconns → 1K backend)\n• Consistent hashing / slot routing\n• Hot key detection + local caching\n• Request pipeline batching\n• Statistics + observability","originalText":"CACHE PROXY LAYER (optional)\n\n• Twemproxy / Envoy / mcrouter\n• Connection multiplexing (100K client\nconns → 1K backend)\n• Consistent hashing / slot routing\n• Hot key detection + local caching\n• Request pipeline batching\n• Statistics + observability","textAlign":"center","verticalAlign":"middle","containerId":"shape-0","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":1}},{"angle":0,"strokeColor":"#628572","backgroundColor":"#edf5ee","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-2"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-3"}],"updated":0,"link":null,"locked":false,"id":"shape-2","type":"rectangle","seed":187,"x":538,"y":32,"width":390,"height":504,"customData":{"revealStep":2}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-2"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-3","type":"text","seed":260,"x":558,"y":50,"width":350,"height":468,"fontSize":18,"fontFamily":1,"text":"APPLICATION LAYER\n\n• App Server 1\nL1 In-Process Cache\n(Caffeine/Guava) 100 MB, TTL=10s\nClient Connection Pool (20\nconns/shard) Circuit Breaker Retry\nw/ backoff\n\n• App Server 2\nL1 In-Process Cache\n(Caffeine/Guava) 100 MB, TTL=10s\nClient Connection Pool (20\nconns/shard) Circuit Breaker Retry\nw/ backoff\n\n• App Server N\nL1 In-Proc Cache (100 MB, TTL=10s)\nClient Conn Pool (20/shard) Circ\nBreaker Retry","originalText":"APPLICATION LAYER\n\n• App Server 1\nL1 In-Process Cache\n(Caffeine/Guava) 100 MB, TTL=10s\nClient Connection Pool (20\nconns/shard) Circuit Breaker Retry\nw/ backoff\n\n• App Server 2\nL1 In-Process Cache\n(Caffeine/Guava) 100 MB, TTL=10s\nClient Connection Pool (20\nconns/shard) Circuit Breaker Retry\nw/ backoff\n\n• App Server N\nL1 In-Proc Cache (100 MB, TTL=10s)\nClient Conn Pool (20/shard) Circ\nBreaker Retry","textAlign":"center","verticalAlign":"middle","containerId":"shape-2","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":2}},{"angle":0,"strokeColor":"#7c899d","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.4,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-10","type":"arrow","seed":771,"x":231,"y":278.6,"width":0,"height":82.00000000000006,"points":[[0,0],[0,41],[0,82.00000000000006]],"lastCommittedPoint":null,"startBinding":{"elementId":"shape-0","focus":0,"gap":1},"endBinding":{"elementId":"shape-4","focus":0,"gap":1},"startArrowhead":null,"endArrowhead":"arrow","elbowed":false,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#a68a53","backgroundColor":"#fff7e6","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-5"},{"type":"arrow","id":"shape-10"},{"type":"arrow","id":"shape-11"}],"updated":0,"link":null,"locked":false,"id":"shape-4","type":"rectangle","seed":333,"x":36,"y":360.6000000000001,"width":390,"height":691.2,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-5","type":"text","seed":406,"x":56,"y":378.6000000000001,"width":350,"height":655.2,"fontSize":18,"fontFamily":1,"text":"REDIS CLUSTER (80 shards)\n\nAZ-a AZ-b AZ-c\n\n... (80 primary + 80 replica = 160\nnodes total)\n\nCross-AZ replica placement:\nPrimary in AZ-a → Replica in AZ-b\n(or AZ-c)\n→ Survives full AZ failure\n\nCluster Bus: gossip protocol on port\n+10000\n→ Node discovery, failure detection,\nslot migration\n\n• Primary 0 (64GB) Slots: 0-204\n\n• Primary 1 (64GB) Slots: 205-409\n\n• Primary 2 (64GB) Slots: 410-614\n\n• Replica 0 (AZ-b)\n\n• Replica 1 (AZ-c)\n\n• Replica 2 (AZ-a)","originalText":"REDIS CLUSTER (80 shards)\n\nAZ-a AZ-b AZ-c\n\n... (80 primary + 80 replica = 160\nnodes total)\n\nCross-AZ replica placement:\nPrimary in AZ-a → Replica in AZ-b\n(or AZ-c)\n→ Survives full AZ failure\n\nCluster Bus: gossip protocol on port\n+10000\n→ Node discovery, failure detection,\nslot migration\n\n• Primary 0 (64GB) Slots: 0-204\n\n• Primary 1 (64GB) Slots: 205-409\n\n• Primary 2 (64GB) Slots: 410-614\n\n• Replica 0 (AZ-b)\n\n• Replica 1 (AZ-c)\n\n• Replica 2 (AZ-a)","textAlign":"center","verticalAlign":"middle","containerId":"shape-4","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#7c899d","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.4,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-11","type":"arrow","seed":844,"x":231,"y":1051.8,"width":0,"height":112,"points":[[0,0],[0,56],[0,112]],"lastCommittedPoint":null,"startBinding":{"elementId":"shape-4","focus":0,"gap":1},"endBinding":{"elementId":"shape-6","focus":0,"gap":1},"startArrowhead":null,"endArrowhead":"arrow","elbowed":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#9180ac","backgroundColor":"#f4effb","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-7"},{"type":"arrow","id":"shape-11"}],"updated":0,"link":null,"locked":false,"id":"shape-6","type":"rectangle","seed":479,"x":36,"y":1163.8,"width":390,"height":106.2,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-7","type":"text","seed":552,"x":56,"y":1181.8,"width":350,"height":70.2,"fontSize":18,"fontFamily":1,"text":"PRIMARY DATABASE\n(Aurora / RDS / DynamoDB —\nseparate design)","originalText":"PRIMARY DATABASE\n(Aurora / RDS / DynamoDB —\nseparate design)","textAlign":"center","verticalAlign":"middle","containerId":"shape-6","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"transparent","backgroundColor":"#fbfbf8","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-12","type":"rectangle","seed":917,"x":241,"y":1092.8,"width":54.86848,"height":30,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-13","type":"text","seed":990,"x":241,"y":1096.8,"width":54.86848,"height":20.8,"fontSize":16,"fontFamily":1,"text":"miss","originalText":"miss","textAlign":"center","verticalAlign":"middle","containerId":null,"lineHeight":1.3,"autoResize":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-5"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-9"}],"updated":0,"link":null,"locked":false,"id":"shape-8","type":"rectangle","seed":625,"x":36,"y":1383.9999999999998,"width":390,"height":925.2,"customData":{"revealStep":5}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-5"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-9","type":"text","seed":698,"x":56,"y":1401.9999999999998,"width":350,"height":889.2,"fontSize":18,"fontFamily":1,"text":"MONITORING & OPERATIONS\n\nMetrics (Prometheus / Datadog):\n\nAlerts:\nRED — Hit ratio < 80% (sustained\n5 min)\nRED — Memory usage > 90% of\nmaxmemory\nRED — Replication lag > 10 seconds\nRED — Node unreachable for > 30\nseconds\nWARN — Eviction rate > 1000\nkeys/sec\nWARN — Slow log entries > 10/min\n(commands > 10ms)\nWARN — Connected clients > 80%\nof maxclients\nWARN — Fork duration > 5 seconds\n\n• Hit ratio per shard (target >\n95%)\n• Ops/sec per node (GET, SET,\nDEL)\n• Memory usage per node\n(used_memory vs maxmemory)\n• Connected clients per node\n• Keyspace size (total keys, expired\nkeys)\n• Replication lag (in bytes and\nseconds)\n• Latency percentiles (p50, p99,\np999) per command\n• Eviction rate (evicted_keys/sec)\n• Fork duration (for RDB/AOF\nrewrite)\n• Slow log entries\n• Network in/out per node","originalText":"MONITORING & OPERATIONS\n\nMetrics (Prometheus / Datadog):\n\nAlerts:\nRED — Hit ratio < 80% (sustained\n5 min)\nRED — Memory usage > 90% of\nmaxmemory\nRED — Replication lag > 10 seconds\nRED — Node unreachable for > 30\nseconds\nWARN — Eviction rate > 1000\nkeys/sec\nWARN — Slow log entries > 10/min\n(commands > 10ms)\nWARN — Connected clients > 80%\nof maxclients\nWARN — Fork duration > 5 seconds\n\n• Hit ratio per shard (target >\n95%)\n• Ops/sec per node (GET, SET,\nDEL)\n• Memory usage per node\n(used_memory vs maxmemory)\n• Connected clients per node\n• Keyspace size (total keys, expired\nkeys)\n• Replication lag (in bytes and\nseconds)\n• Latency percentiles (p50, p99,\np999) per command\n• Eviction rate (evicted_keys/sec)\n• Fork duration (for RDB/AOF\nrewrite)\n• Slow log entries\n• Network in/out per node","textAlign":"center","verticalAlign":"middle","containerId":"shape-8","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":5}},{"angle":0,"strokeColor":"#a68a53","backgroundColor":"#fff7e6","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-6"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-15"}],"updated":0,"link":null,"locked":false,"id":"shape-14","type":"rectangle","seed":1063,"x":36,"y":2349.2,"width":420,"height":68,"customData":{"revealStep":6}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-6"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-15","type":"text","seed":1136,"x":56,"y":2372.1499999999996,"width":380,"height":22.1,"fontSize":17,"fontFamily":1,"text":"v (cache miss)","originalText":"v (cache miss)","textAlign":"left","verticalAlign":"middle","containerId":"shape-14","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":6}}],"appState":{"viewBackgroundColor":"#fbfbf8","gridSize":null},"files":{}}