Data Systems
end-to-end argument
enforce correctness at the endpoints, not just each hop
Source board
This definition comes from the board below. Open it to see the term in context.
Where Data Systems Are HeadingData SystemsMore terms from this board
- algorithmic biasmodels encoding past discrimination
- auditingverify, don't trust
- consentmeaningful, revocable permission to use data
- data integrationkeeping many specialized stores in sync
- data minimizationcollect/keep less
- derivation functionapp as input-streams → output-streams
- derived viewa store computed FROM it (deterministic, rebuildable)
- dual writethe anti-pattern (drifts)
- feedback loopa prediction that makes itself come true
- idempotency ida request id that makes retries safe
- narrow waistthe shared log/dataflow interface
- source of truththe one authoritative log
- timeliness vs integrityup-to-date vs uncorrupted
- unbundling the databasecompose storage/index/replication as separate tools over a log