{"type":"excalidraw","version":2,"source":"https://AwesomeSystemDesign.dev","elements":[{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-1"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-1"}],"updated":0,"link":null,"locked":false,"id":"shape-0","type":"rectangle","seed":41,"x":16,"y":16,"width":288,"height":522.2,"customData":{"revealStep":1}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-1"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-1","type":"text","seed":114,"x":36,"y":34.00000000000003,"width":248,"height":486.2,"fontSize":22,"fontFamily":1,"text":"CACHE PROXY LAYER\n(optional)\n\n• Twemproxy / Envoy\n/ mcrouter\n• Connection\nmultiplexing (100K\nclient conns → 1K\nbackend)\n• Consistent hashing\n/ slot routing\n• Hot key detection\n+ local caching\n• Request pipeline\nbatching\n• Statistics +\nobservability","originalText":"CACHE PROXY LAYER\n(optional)\n\n• Twemproxy / Envoy\n/ mcrouter\n• Connection\nmultiplexing (100K\nclient conns → 1K\nbackend)\n• Consistent hashing\n/ slot routing\n• Hot key detection\n+ local caching\n• Request pipeline\nbatching\n• Statistics +\nobservability","textAlign":"left","verticalAlign":"middle","containerId":"shape-0","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":1}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-2"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-3"}],"updated":0,"link":null,"locked":false,"id":"shape-2","type":"rectangle","seed":187,"x":16,"y":582.2,"width":288,"height":865.4,"customData":{"revealStep":2}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-2"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-3","type":"text","seed":260,"x":36,"y":600.2,"width":248,"height":829.4,"fontSize":22,"fontFamily":1,"text":"APPLICATION\nLAYER\n\n• App Server 1\nL1 In-Process Cache\n(Caffeine/Guava)\n100 MB, TTL=10s\nClient Connection\nPool (20\nconns/shard) Circuit\nBreaker Retry w/\nbackoff\n\n• App Server 2\nL1 In-Process Cache\n(Caffeine/Guava)\n100 MB, TTL=10s\nClient Connection\nPool (20\nconns/shard) Circuit\nBreaker Retry w/\nbackoff\n\n• App Server N\nL1 In-Proc Cache\n(100 MB, TTL=10s)\nClient Conn Pool\n(20/shard) Circ\nBreaker Retry","originalText":"APPLICATION\nLAYER\n\n• App Server 1\nL1 In-Process Cache\n(Caffeine/Guava)\n100 MB, TTL=10s\nClient Connection\nPool (20\nconns/shard) Circuit\nBreaker Retry w/\nbackoff\n\n• App Server 2\nL1 In-Process Cache\n(Caffeine/Guava)\n100 MB, TTL=10s\nClient Connection\nPool (20\nconns/shard) Circuit\nBreaker Retry w/\nbackoff\n\n• App Server N\nL1 In-Proc Cache\n(100 MB, TTL=10s)\nClient Conn Pool\n(20/shard) Circ\nBreaker Retry","textAlign":"left","verticalAlign":"middle","containerId":"shape-2","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":2}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-5"},{"type":"arrow","id":"shape-6"}],"updated":0,"link":null,"locked":false,"id":"shape-4","type":"rectangle","seed":333,"x":16,"y":1491.6,"width":288,"height":93.2,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-5","type":"text","seed":406,"x":36,"y":1509.6,"width":248,"height":57.2,"fontSize":22,"fontFamily":1,"text":"CACHE PROXY LAYER\n(optional)","originalText":"CACHE PROXY LAYER\n(optional)","textAlign":"left","verticalAlign":"middle","containerId":"shape-4","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":2,"strokeStyle":"solid","roughness":0.4,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-6","type":"arrow","seed":479,"x":36,"y":1598.8,"width":0,"height":28,"points":[[0,0],[0,28]],"lastCommittedPoint":null,"startBinding":{"elementId":"shape-4","focus":0,"gap":14},"endBinding":{"elementId":"shape-7","focus":0,"gap":14},"startArrowhead":null,"endArrowhead":"arrow","elbowed":false,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#628572","backgroundColor":"#edf5ee","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-8"},{"type":"arrow","id":"shape-6"}],"updated":0,"link":null,"locked":false,"id":"shape-7","type":"rectangle","seed":552,"x":16,"y":1640.8,"width":288,"height":1122.8,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-3"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-8","type":"text","seed":625,"x":36,"y":1658.8,"width":248,"height":1086.8,"fontSize":22,"fontFamily":1,"text":"REDIS CLUSTER\n(80 shards)\n\nAZ-a AZ-b AZ-c\n\n... (80 primary + 80\nreplica = 160 nodes\ntotal)\n\nCross-AZ replica\nplacement:\nPrimary in AZ-a →\nReplica in AZ-b (or\nAZ-c)\n→ Survives full AZ\nfailure\n\nCluster Bus: gossip\nprotocol on port\n+10000\n→ Node discovery,\nfailure detection,\nslot migration\n\n• Primary 0 (64GB)\nSlots: 0-204\n\n• Primary 1 (64GB)\nSlots: 205-409\n\n• Primary 2 (64GB)\nSlots: 410-614\n\n• Replica 0 (AZ-b)\n\n• Replica 1 (AZ-c)\n\n• Replica 2 (AZ-a)","originalText":"REDIS CLUSTER\n(80 shards)\n\nAZ-a AZ-b AZ-c\n\n... (80 primary + 80\nreplica = 160 nodes\ntotal)\n\nCross-AZ replica\nplacement:\nPrimary in AZ-a →\nReplica in AZ-b (or\nAZ-c)\n→ Survives full AZ\nfailure\n\nCluster Bus: gossip\nprotocol on port\n+10000\n→ Node discovery,\nfailure detection,\nslot migration\n\n• Primary 0 (64GB)\nSlots: 0-204\n\n• Primary 1 (64GB)\nSlots: 205-409\n\n• Primary 2 (64GB)\nSlots: 410-614\n\n• Replica 0 (AZ-b)\n\n• Replica 1 (AZ-c)\n\n• Replica 2 (AZ-a)","textAlign":"left","verticalAlign":"middle","containerId":"shape-7","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":3}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-10"},{"type":"arrow","id":"shape-12"}],"updated":0,"link":null,"locked":false,"id":"shape-9","type":"rectangle","seed":698,"x":16,"y":2807.6,"width":288,"height":93.2,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-10","type":"text","seed":771,"x":36,"y":2825.6,"width":248,"height":57.2,"fontSize":22,"fontFamily":1,"text":"REDIS CLUSTER\n(80 shards)","originalText":"REDIS CLUSTER\n(80 shards)","textAlign":"left","verticalAlign":"middle","containerId":"shape-9","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-11","type":"text","seed":844,"x":58,"y":2914.7999999999997,"width":234,"height":28.6,"fontSize":22,"fontFamily":1,"text":"miss","originalText":"miss","textAlign":"left","verticalAlign":"middle","containerId":null,"lineHeight":1.3,"autoResize":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":2,"strokeStyle":"solid","roughness":0.4,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-12","type":"arrow","seed":917,"x":36,"y":2914.7999999999997,"width":0,"height":42.59999999999991,"points":[[0,0],[0,42.59999999999991]],"lastCommittedPoint":null,"startBinding":{"elementId":"shape-9","focus":0,"gap":14},"endBinding":{"elementId":"shape-13","focus":0,"gap":14},"startArrowhead":null,"endArrowhead":"arrow","elbowed":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#628572","backgroundColor":"#edf5ee","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-14"},{"type":"arrow","id":"shape-12"}],"updated":0,"link":null,"locked":false,"id":"shape-13","type":"rectangle","seed":990,"x":16,"y":2971.3999999999996,"width":288,"height":150.4,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-4"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-14","type":"text","seed":1063,"x":36,"y":2989.3999999999996,"width":248,"height":114.4,"fontSize":22,"fontFamily":1,"text":"PRIMARY DATABASE\n(Aurora / RDS /\nDynamoDB —\nseparate design)","originalText":"PRIMARY DATABASE\n(Aurora / RDS /\nDynamoDB —\nseparate design)","textAlign":"left","verticalAlign":"middle","containerId":"shape-13","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":4}},{"angle":0,"strokeColor":"#6577aa","backgroundColor":"#eef1fc","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-5"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-16"}],"updated":0,"link":null,"locked":false,"id":"shape-15","type":"rectangle","seed":1136,"x":16,"y":3165.7999999999997,"width":288,"height":1580.4,"customData":{"revealStep":5}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-5"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-16","type":"text","seed":1209,"x":36,"y":3183.7999999999997,"width":248,"height":1544.4,"fontSize":22,"fontFamily":1,"text":"MONITORING &\nOPERATIONS\n\nMetrics (Prometheus\n/ Datadog):\n\nAlerts:\nRED — Hit ratio <\n80% (sustained 5\nmin)\nRED — Memory\nusage > 90% of\nmaxmemory\nRED — Replication\nlag > 10 seconds\nRED — Node\nunreachable for > 30\nseconds\nWARN — Eviction\nrate > 1000\nkeys/sec\nWARN — Slow log\nentries > 10/min\n(commands > 10ms)\nWARN — Connected\nclients > 80% of\nmaxclients\nWARN — Fork\nduration > 5 seconds\n\n• Hit ratio per shard\n(target > 95%)\n• Ops/sec per node\n(GET, SET, DEL)\n• Memory usage per\nnode (used_memory\nvs maxmemory)\n• Connected clients\nper node\n• Keyspace size\n(total keys, expired\nkeys)\n• Replication lag (in\nbytes and seconds)\n• Latency percentiles\n(p50, p99, p999) per\ncommand\n• Eviction rate\n(evicted_keys/sec)\n• Fork duration (for\nRDB/AOF rewrite)\n• Slow log entries\n• Network in/out per\nnode","originalText":"MONITORING &\nOPERATIONS\n\nMetrics (Prometheus\n/ Datadog):\n\nAlerts:\nRED — Hit ratio <\n80% (sustained 5\nmin)\nRED — Memory\nusage > 90% of\nmaxmemory\nRED — Replication\nlag > 10 seconds\nRED — Node\nunreachable for > 30\nseconds\nWARN — Eviction\nrate > 1000\nkeys/sec\nWARN — Slow log\nentries > 10/min\n(commands > 10ms)\nWARN — Connected\nclients > 80% of\nmaxclients\nWARN — Fork\nduration > 5 seconds\n\n• Hit ratio per shard\n(target > 95%)\n• Ops/sec per node\n(GET, SET, DEL)\n• Memory usage per\nnode (used_memory\nvs maxmemory)\n• Connected clients\nper node\n• Keyspace size\n(total keys, expired\nkeys)\n• Replication lag (in\nbytes and seconds)\n• Latency percentiles\n(p50, p99, p999) per\ncommand\n• Eviction rate\n(evicted_keys/sec)\n• Fork duration (for\nRDB/AOF rewrite)\n• Slow log entries\n• Network in/out per\nnode","textAlign":"left","verticalAlign":"middle","containerId":"shape-15","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":5}},{"angle":0,"strokeColor":"#628572","backgroundColor":"#edf5ee","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-6"],"frameId":null,"roundness":null,"boundElements":[{"type":"text","id":"shape-18"}],"updated":0,"link":null,"locked":false,"id":"shape-17","type":"rectangle","seed":1282,"x":16,"y":4790.2,"width":288,"height":68,"customData":{"revealStep":6}},{"angle":0,"strokeColor":"#394557","backgroundColor":"transparent","fillStyle":"solid","strokeWidth":1.5,"strokeStyle":"solid","roughness":0.7,"opacity":100,"version":1,"versionNonce":1,"isDeleted":false,"groupIds":["step-6"],"frameId":null,"roundness":null,"boundElements":null,"updated":0,"link":null,"locked":false,"id":"shape-18","type":"text","seed":1355,"x":36,"y":4809.9,"width":248,"height":28.6,"fontSize":22,"fontFamily":1,"text":"v (cache miss)","originalText":"v (cache miss)","textAlign":"left","verticalAlign":"middle","containerId":"shape-17","lineHeight":1.3,"autoResize":false,"customData":{"revealStep":6}}],"appState":{"viewBackgroundColor":"#fbfbf8","gridSize":null},"files":{}}