Data Systems
narrow waist
the shared log/dataflow interface
Source board
This definition comes from the board below. Open it to see the term in context.
Where Data Systems Are HeadingData SystemsMore terms from this board
- algorithmic biasmodels encoding past discrimination
- auditingverify, don't trust
- consentmeaningful, revocable permission to use data
- data integrationkeeping many specialized stores in sync
- data minimizationcollect/keep less
- derivation functionapp as input-streams → output-streams
- derived viewa store computed FROM it (deterministic, rebuildable)
- dual writethe anti-pattern (drifts)
- end-to-end argumentenforce correctness at the endpoints, not just each hop
- feedback loopa prediction that makes itself come true
- idempotency ida request id that makes retries safe
- source of truththe one authoritative log
- timeliness vs integrityup-to-date vs uncorrupted
- unbundling the databasecompose storage/index/replication as separate tools over a log