Skip to main content

Courses About Pricing Educators

Sign in Get started

Courses About Pricing Educators

Get started Sign in

Loading courses

Loading lessons

Queues and Streams: System Design: Uncharted

Courses System DesignQueues and Streams

Queues and StreamsPro

Decouple rates, bound overload, make duplicate delivery safe, and replay ordered event logs.

System Design
Unit 6 of 12
20 lessons
154 min
420 XP

This unit is part of Pro. Upgrade to open every lesson in it.

Lessons

20 total

1The Ticket RailExplain how a durable queue decouples the rate producers submit work from the rate consumers finish it.ProInteractiveConcept7 min20 XPOpen
2Why Make Them WaitMove only independent follow-up work off the request path while keeping the immediate response truthful.ProInteractiveConcept7 min20 XPOpen
3First Queue BlueprintModel an account service handing durable email jobs to a queue shared by interchangeable workers.ProDiagramConcept10 min20 XPOpen
4Producers and ConsumersPredict queue-depth growth from the sustained difference between arrival and completion rates.ProInteractiveConcept7 min20 XPOpen
5Read the Queue DepthIdentify the first queue-depth threshold breach that marks consumers falling behind arrivals.ProInteractiveConcept8 min20 XPOpen
6Napkin: Worker CountCalculate the minimum workers needed from jobs per second and worker-seconds consumed by each job.ProInteractiveConcept7 min20 XPOpen
7BackpressureRespond to a full bounded queue by slowing admission, shedding work, or adding sustainable throughput.ProInteractiveConcept7 min20 XPOpen
8The Poison JobKeep a deterministic poison job from consuming the queue forever by capping retries and preserving it for inspection.ProInteractiveConcept7 min20 XPOpen
9Design the RetryConstruct a bounded retry lifecycle with recorded attempts, exponential backoff, jitter, and dead-letter handling.ProInteractiveConcept7 min20 XPOpen
10Delivered TwiceMake an external effect safe under redelivery by reusing a stable operation identity across worker attempts.ProInteractiveConcept7 min20 XPOpen
11Fan Out the NewsRepresent one published event reaching independent search, email, and analytics subscriber groups.ProDiagramConcept10 min20 XPOpen
12Queues or TopicsDistinguish competing consumers on a work queue from independent subscriber groups on a topic.ProInteractiveConcept7 min20 XPOpen
13The Replayable LogExplain how independent consumer offsets make an ordered log replayable at different reading speeds.ProInteractiveConcept7 min20 XPOpen
14Ordering GuaranteesPreserve per-key event order by routing every event for that key to the same log partition.ProInteractiveConcept7 min20 XPOpen
15Partitions and Hot KeysRecognize when a skewed partition key concentrates stream traffic and caps total throughput.ProInteractiveConcept7 min20 XPOpen
16Later, Not NeverKeep future work durable and observable in scheduled queue storage instead of one process timer.ProInteractiveConcept7 min20 XPOpen
17Pipeline the PhotoDesign an asynchronous photo path from upload through competing resize workers, variant storage, and completion notification.ProDiagramProject10 min20 XPOpen
18When Queues HurtKeep a dependency synchronous when the caller needs its result now and its latency already meets the promise.ProInteractiveConcept7 min20 XPOpen
19Explain BackpressureExplain how a bounded queue exposes overload and why slowing, shedding, or added throughput are the honest responses.ProInteractiveConcept8 min20 XPOpen
20Queues and Streams Mastery CheckBuild a durable broadcast path with independent consumers and an explicit destination for exhausted failures.ProDiagramMastery check10 min40 XPOpen

Consistency Inside Distributed Systems