Work #1085 · Late period

Noise: A Flaw in Human Judgment

Kahneman, Sibony, and Sunstein's 2021 study of inconsistency in expert judgment — co-equal partner to bias

Daniel Kahneman · 2021 · English · Trade non-fiction

Tradition: Behavioural decision science

Kahneman et al.'s 2021 study of noise — random variability — as the underappreciated partner of bias in judgment

Noise: A Flaw in Human Judgment (2021), co-written by Kahneman with Olivier Sibony and Cass Sunstein, develops the systematic study of "noise" — random, unwanted variability in judgments that should be identical. Where Thinking, Fast and Slow focused on bias (systematic deviation), Noise focuses on noise (random variability) and shows it is as substantial — and as costly — as bias in domains from criminal sentencing to medical diagnosis to insurance claims. Proposes "decision hygiene" measures.

Author

Editions cited

  • Noise: A Flaw in Human Judgment (Little, Brown Spark, 2021)

School Embodiments

Behavioral Economics · 30%
Cognitive Science · 20%
Analytic Metaphysics / Logical Atomism · 10%
Liberalism · 15%
Naturalism · 10%
Natural Law · 15%

Mature behavioural-economics statement — noise as the underappreciated counterpart to bias.

"Wherever there is judgment, there is noise — and more than you think." (Noise)

Empirically-grounded statement about systematic features of human judgment.

"Noise is the unwanted variability in judgments that should ideally be identical." (Noise)

Engages philosophical questions about the normative status of judgment.

"The judgment of the experienced expert is supposed to be more accurate than that of the novice; the data suggest experts are mainly more confident." (Noise)

Liberal-institutional implications — noise as an objection to discretionary judgment, support for algorithmic and rule-based decision-making.

"The case for replacing human judgment with rules or algorithms is at least as much about noise as about bias." (Noise)

Naturalises decision-making — noise is an empirical fact about cognitive systems.

"Noise is a fact about cognitive systems, not a moral failing." (Noise)

Major empirical case for noise in legal-judicial judgment.

"The same judge, on different days, sentences identical cases very differently — that is noise." (Noise)

Internal Tensions

The book's policy-prescriptive recommendations have been variously assessed — defenders see them as proper decision-hygiene, critics worry about the displacement of human judgment by algorithmic substitutes.

I. Time

The 2010s research programme; the 2021 contemporary moment of algorithmic-vs-human-judgment debate.

Attributes
Extent: Infinite Ontological Status: Substantival Grain: Continuous Freedom: Non-Deterministic Traversability: Linear Direction: Uni-directional Dimensionality: One

II. Space

The institutional decision-making contexts — courtrooms, hospitals, insurance offices — studied.

Attributes
Extent: Infinite Ontological Status: Substantival Curvature: Flat Dimensionality: Three Locality: Local

III. Matter

The embodied judgment-making humans whose noise is the topic.

Attributes
Extent: Infinite Ontological Status: Substantival Conservation: Conserved Dimensionality: Three Locality: Local

IV. Observer

The decision-maker as both subject and observer of noisy judgment.

Attributes
Time Instance: Single Space Instance: Single Knowledge Extent: Partial Knowledge Retainment: Partial Physicality: Embodied Agency: Active Number: Plural Metaphysical Agency: None

V. Energy

The cognitive energies of effortful expert judgment.

Attributes
Extent: Infinite Ontological Status: Substantival Conservation: Conserved Dispersibility: Irreversible

VI. Information

The institutional decision-information whose quality noise degrades.

Attributes
Ontological Status: Substantival Cosmic Conservation: Variable Personal Conservation: Variable Granularity: Discrete

Personas with the nearest attribute fingerprint

Historical figures whose own classification on the same six-dimensional grid lands closest to this work's. Computed by attribute-agreement on coordinates both address.

Computed school proximity

The work's attribute fingerprint scored against all schools using the same quiz scorer. Useful as a sanity check on the hand-curated embodiments above.

How Noise: A Flaw in Human Judgment resolves each dilemma

44 resolved positions across 4 dimensions, including 6 distinctive where the majority of schools go the other way · 13 unaligned.

Each dimension is sorted so minority positions come first. Mainstream positions are folded into an expandable list.

Time · 9 dilemmas · 3 distinctive

Persistence, the future, and the direction of becoming.

Distinctive · only 15% of schools agree (31/202)
Is the universe running out of usable energy?
The heat death of the universe — entropy maxed out, no further work possible — is among the more sobering implications of mainstream physics. Whether it is structurally inescapable depends on what kind of finitude the cosmos has.
Both time and matter are unbounded; 'running out' is misframed.
On this view, the cosmos has neither a temporal horizon nor a material exhaustion point. The framing of running out presupposes bounds that the cosmos doesn't have. Energy gradients perpetuate; new configurations emerge; the categories that make heat-death scary don't apply at the cosmic scale.
Roads not taken Time is unbounded but matter is finite; usable energy can fail without time failing. (47%) · Time both has and lacks bounds depending on the level you ask at; finitude is conventional. (26%) · The cosmos has bounds; heat death is a real horizon. (12%)
Distinctive · only 15% of schools agree (31/202)
Are natural resources fundamentally finite, or only practically so?
Whether we can grow our way out of resource constraints — or whether the cosmos sets limits the economy ultimately must obey — depends on what kind of finitude matter has.
Resources are practically inexhaustible on cosmic scales; terrestrial limits are engineering.
On this view, matter and time are both unbounded at the largest scales. Terrestrial resource limits are real engineering and political constraints but not metaphysical ones; the cosmos can in principle support whatever expansion intelligence is capable of.
Roads not taken Time goes on but matter is bounded; we are eventually constrained even with infinite time. (47%) · The finitude question is level-dependent; resource ethics happens at the level that constrains us. (26%) · Resources are finite in the strict sense; living well requires accepting the limit. (12%)
Distinctive · only 15% of schools agree (31/202)
Could we owe future generations more than is materially possible to provide?
If we owe future people a habitable planet and the material means to flourish, and the cosmos is bounded in ways that make those obligations impossible at some scale, the obligation and the possibility come apart. Where they come apart turns on what kind of finitude we live in.
Both time and matter are unbounded; we cannot in principle owe more than is possible.
On this view, the cosmos has the resources to support whatever flourishing future generations are capable of, given sufficient time and intelligence. The impossibility concern is misplaced; the real questions are about trajectories and choices, not about resource ceilings.
Roads not taken Time is unbounded but matter is not; we can owe more across long time than the matter can provide. (47%) · The owing-and-possibility question is level-dependent; we owe what is appropriate at the level we act on. (26%) · The cosmos is bounded; our obligations to future generations are bounded with it. (12%)
6 mainstream positions
Matter · 7 dilemmas, all mainstream

Observer · 37 dilemmas · 3 distinctive

Mind, agency, and the knower's relation to the known.

Distinctive · only 13% of schools agree (27/202)
Is reality fundamentally digital?
Pancomputationalism, Planck-scale quanta, simulation theory and Kabbalistic letter-mysticism all say yes — but for very different reasons. The rest of the atlas says no.
Yes — bits, quanta, computational substrate.
On this view, the world is at bottom discrete and law-governed, with no metaphysical agency above or behind the substrate. Reality reduces to bits or their physical analogues; the continuous appearance of fields and flows is coarse-graining over discrete underlying structure.
Roads not taken No — continuous divine sustaining act, the Tao that knows no joints, the One's self-disclosure. (44%) · No — continuous fields, classical limits, analog deep structure. (37%) · Yes — but divinely-discrete: divine letters, momentary cognitions, atomistic theism. (6%)
Distinctive · only 13% of schools agree (27/202)
Are there indivisible units of experience?
Whiteheadian actual occasions, Buddhist moments of mind, Kabbalistic letter-cognitions, IIT phi-units — or the unbroken Jamesian stream? The atomism of experience cuts across naturalism and theism alike.
Yes — naturalist quanta of experience.
On this view, experience comes in discrete units defined by the substrate: information-theoretic phi-units, computational frames, discrete neural events. There is no further metaphysical agency that knits them; the appearance of a stream is the way many discrete events present to introspection.
Roads not taken No — continuous divine presence; consciousness is the unbroken witness. (44%) · No — continuous Jamesian stream, phenomenological lived time. (37%) · Yes, theistic atomism — actual occasions, divine letters, momentary cognitions. (6%)
Distinctive · only 13% of schools agree (27/202)
Is memory stored or reconstructed?
Engrams and traces — or continuous re-narration each time you remember? The cognitive-science debate has a theological cousin: divine memory holding each hair, or the ancestors' continuous remembering.
Stored — discrete engrams, traces, weights.
On this view, memory is the readout of discrete information stored in the substrate: engrams, synaptic weights, file-like records. Reconstruction at retrieval is real but secondary; without the stored bits there would be nothing to reconstruct from.
Roads not taken Held in continuous divine or ancestral remembering — neither stored discretely nor purely reconstructed. (44%) · Reconstructed — continuous re-narrating, no fixed engrams. (37%) · Stored — in divine memory's discrete particulars, or in karmic-record units. (6%)
25 mainstream positions
Could causation work backwards? Causation runs one way — the arrow of time is real and structural. 68% Is the asymmetry between memory and anticipation a real feature of time, or just of us? The asymmetry is real because time itself has a real direction. 68% Is the arrow of time a real feature of the cosmos, or only of how we describe it? The arrow is real and structural; the asymmetry isn't an artifact of description. 68% Is environmental damage ever truly permanent? Damage is real and permanent on the relevant timescales. There is no recovery; there is only limitation. 66% Can a civilization recover from collapse? Civilizational complexity is hard to build and easy to lose; recovery is at best partial. 66% Does the second law of thermodynamics mean something morally? Entropy is what time is. The moral weight, if any, is the weight of working against the current. 66% When does a person begin? A person exists from conception — when a new being comes into existence. 54% What is marriage? Marriage has a given form — it’s a kind of thing we recognize, not make. 54% Does environmental harm in another country bind me morally? Moral obligation tracks the relations one is in; distance does matter, structurally. 50% Can prayer for someone far away affect them? Prayer changes the pray-er, not the prayed-for. 49% Are coincidences ever more than coincidence? Coincidence is exactly what the math says it is. The pattern is in the noticer. 49% What is our place in nature? Active in a real nature — we cultivate, steward, transform. 48% Should we colonize space? Cultivating worlds beyond Earth is the next form of stewardship. 48% Is genetic engineering of food stewardship or domination? Genetic modification is cultivation by other means. 48% Is divine omniscience compatible with human freedom? The observer is in time; foreknowledge across times raises real freedom problems. 46% Does meditation reveal something genuinely timeless? Meditators are bounded observers reporting unusual brain states; the 'timeless' is metaphorical. 46% Does prayer change God's mind? If there is an addressee at all, it is in time; prayer is communication, and may genuinely change what comes next. 46% Are the dead morally present to the living? Observers are bounded by their own moment, and no further agency makes the dead present. 44% Do animals have moral standing comparable to humans? Animal minds are real because biology is the substrate of mind. 32% Could a fetal brain organoid in a petri dish be conscious? Brain tissue can in principle do what brains do; the question is integration. 32% Should we trust expert testimony when we can't verify it? Trust expertise whose conclusions a competent mind can in principle reproduce. 32% Is religious revelation a real source of knowledge? Revelation is evaluable by reason — and not above it. 32% Does an LLM 'know' the things it correctly produces? An LLM can produce correct outputs but not reason to them; useful, not knowing. 32% What happens to "you" when you die? Death is genuinely the end. 30% Could an AI have a mind that matters? No — mind is what a biological brain does, and an LLM has no brain. 30%
9 unaligned
Information · 4 dilemmas, all mainstream
← #1084 Judgment Under Uncertainty All Works #1086 Words and Life →