log compaction

Source board

This definition comes from the board below. Open it to see the term in context.

Stream ProcessingData Systems

More terms from this board

• eventan immutable record of something that happened
• event sourcingevents as source of truth
• event time vs processing timewhen it happened vs when seen
• exactly-oncea replayed event has no extra effect (idempotence / transactions)
• load balancing vs fan-outshare work vs everyone-gets-all
• log-based broker (Kafka)append-only, retained, replayable log
• microbatch / checkpointrecovery techniques
• offseta consumer's position
• producer/consumerwriter/reader
• stragglera late event
• stream-stream / stream-table joinwindow-correlate / enrich
• watermark'seen everything up to T'
• windowtumbling/sliding/session bucket