Data Systems
log-based broker (Kafka)
append-only, retained, replayable log
Source board
This definition comes from the board below. Open it to see the term in context.
Stream ProcessingData SystemsMore terms from this board
- eventan immutable record of something that happened
- event sourcingevents as source of truth
- event time vs processing timewhen it happened vs when seen
- exactly-oncea replayed event has no extra effect (idempotence / transactions)
- load balancing vs fan-outshare work vs everyone-gets-all
- log compactionkeep latest value per key
- microbatch / checkpointrecovery techniques
- offseta consumer's position
- producer/consumerwriter/reader
- stragglera late event
- stream-stream / stream-table joinwindow-correlate / enrich
- watermark'seen everything up to T'
- windowtumbling/sliding/session bucket