Index

Data Systems · Stream processing: late events

The late tap

A tap from a phone in a tunnel arrives twenty seconds late. How long should the server wait before showing a count, and what does each extra second buy?

Phones send taps, and each tap carries the second it happened. Phone B goes into a tunnel, so its taps arrive long after the rest. The server counts taps in windows and must decide when a window is finished. Wait longer and fewer taps are thrown away, but every number reaches the screen later.

Board: Stream Processing →

On a narrow screen the three panels stack below the dials. Both tables scroll sideways.

try this Drag How long to wait for stragglers and watch Thrown away fall while Seconds waited climbs.

Included with a plan

This lab is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.

View plans →Already a member? Sign in

see also The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing in Papers.