Videos / Web Dev

Episode 16 of 16 · Web development, end to end

Queues and pub-sub: work that outlives the request

Chapters

1. Four jobs, one button0:00
2. One of these is yours0:17
3. Slow, flaky, retryable0:33
4. Half done, and stuck0:52
5. The tempting non-fix1:09
6. Record one fact, return1:26
7. Producer, broker, consumer1:44
8. Enqueue is a write2:01
9. What goes in a message2:19
10. Receive, work, acknowledge2:35
11. A promise at each hop2:55
12. Load levelling3:11
13. Divided, or copied3:27
14. Publish the fact, once3:46
15. Everyone has a cursor4:04
16. Rewind and replay4:23
17. The cost of not knowing4:40
18. Events, and commands4:56
19. Three named answers5:13
20. Ack, then work5:29
21. Work, then ack5:47
22. The ack is a message too6:04
23. Effectively once6:24
24. Other people's side effects6:42
25. The job comes back7:00
26. Back off, and jitter7:18
27. Transient, or permanent7:37
28. The poison message7:58
29. The dead letter queue8:15
30. Ordering, per key8:32
31. Depth, and age8:53
32. A level, not a rate9:07
33. The number users feel9:23
34. Depth into minutes9:41
35. Three honest options9:58
36. It was never the queue10:16
37. The whole thing10:34

Queues and pub-sub: work that outlives the request. You click sign up. The server creates your account, then sends a welcome email, then generates an avatar thumbnail, then pushes a record into the sales system. Only after all four

Mark as watchedSaved in this browser only.