Back to problems

Design Reliable Upload and Download for Very Large Files

System Design · Axon · Hard

A platform team wants a service through which clients can push and pull files that are far too large to move in one request-response exchange. Design that service. Your design has to cover interrupted-and-resumed transfers, verification that the bytes arrived intact, many clients operating at the same time, permission checks, and reclamation of space tied to uploads that were started but never finished. Take the following as given: Raw file content is kept in object storage,…

Checking your access…