Back to problems

Design a High-Throughput Distributed Cache

System Design · Salesforce · Hard

You are tasked with designing a cache system that sits in front of a primary database (either relational or NoSQL) for an application with extremely high read traffic. The cache must handle between fifty thousand and two hundred thousand operations per second per node. It needs to support core operations (get, set, delete) with optional batching (mget, mset). Memory on each cache node is limited, so an administrative policy for evicting old entries is required. A critical…

Checking your access…