Works › Superintelligence: Paths, Dangers, Strategies
Work #687 · Late period

Superintelligence: Paths, Dangers, Strategies

Nick Bostrom's 2014 foundational text of AI-existential-risk thought

Nick Bostrom · 2014 · English · Philosophical-technological treatise

Tradition: AI safety / existential risk analysis

Bostrom's 2014 foundational text on the prospect of artificial superintelligence

Superintelligence: Paths, Dangers, Strategies is Nick Bostrom's 2014 foundational text — central thesis: the development of artificial superintelligence may be the most important transition in human history; without proper alignment, it represents an existential risk; the work analyzes paths to superintelligence, strategies for control and value-loading, and the broader question of human-machine co-evolution. Foundational for AI safety / existential risk thought.

Editions cited

  • Superintelligence: Paths, Dangers, Strategies (Oxford UP, 2014)
Compare this work

School Embodiments

Analytic Metaphysics / Logical Atomism · 20%
Transhumanism / Posthumanism · 25%
Naturalism · 10%
Realism · 10%
Rationalism · 10%
Dataism / Information Ontology · 10%
Simulation Theory · 5%
Multiverse Theory · 5%
Pragmatic Realism · 5%
Analytic Metaphysics / Logical Atomism 20%

Analytic philosophy of AI and existential risk.

"Analytic philosophy of AI." (Superintelligence)
Transhumanism / Posthumanism 25%

Foundational AI-transhumanist analysis.

"AI-transhumanist." (Superintelligence)
Naturalism 10%

Naturalist scientific orientation.

"Naturalist scientific." (Superintelligence)
Realism 10%

Realist orientation to AI prospects.

"Realist AI prospects." (Superintelligence)
Rationalism 10%

Rationalist orientation.

"Rationalist." (Superintelligence)
Dataism / Information Ontology 10%

Information-ontological framework.

"Information-ontological." (Superintelligence)
Simulation Theory 5%

Engagement with simulation-hypothesis tradition.

"Simulation-hypothesis." (Superintelligence)
Multiverse Theory 5%

Engagement with multiverse framework.

"Multiverse framework." (Superintelligence)
Pragmatic Realism 5%

Pragmatic-realist orientation.

"Pragmatic-realist." (Superintelligence)

Internal Tensions

Bostrom's Superintelligence catalyzed the contemporary AI safety / existential-risk discourse.

⧖

I. Time

The future time of AI-superintelligence transition.

Attributes
Extent: Infinite Ontological Status: Substantival Grain: Continuous Freedom: Non-Deterministic Traversability: Linear Direction: Uni-directional Dimensionality: One
✦

II. Space

The cognitive-computational space.

Attributes
Extent: Infinite Ontological Status: Substantival Curvature: Flat Dimensionality: Three Locality: Local
◉

III. Matter

The material AI-computational substrate.

Attributes
Extent: Infinite Ontological Status: Substantival Conservation: Conserved Dimensionality: Three Locality: Local
◎

IV. Observer

The aligned-AI safety theorist.

Attributes
Time Instance: Single Space Instance: Single Knowledge Extent: Partial Knowledge Retainment: Total Physicality: Embodied Agency: Both Number: Plural Metaphysical Agency: None
⚡

V. Energy

Energies of cognitive superintelligence.

Attributes
Extent: Infinite Ontological Status: Substantival Conservation: Conserved Dispersibility: Irreversible
⧉

VI. Information

Foundational AI-superintelligence-risk framework.

Attributes
Ontological Status: Substantival Cosmic Conservation: Conserved Personal Conservation: Conserved Granularity: Continuous

Personas with the nearest attribute fingerprint

Historical figures whose own classification on the same six-dimensional grid lands closest to this work's. Computed by attribute-agreement on coordinates both address.

94%
Gottlob Frege
32/34
93%
Epicurus
28/30
91%
Brigham Young
31/34
91%
Derek Parfit
31/34
91%
Hilary Putnam
31/34
91%
Jürgen Habermas
31/34

Computed school proximity

The work's attribute fingerprint scored against all schools using the same quiz scorer. Useful as a sanity check on the hand-curated embodiments above.

68%
Christianity (Generic)
22/26
68%
Protestant Reformation (Magisterial)
22/26
68%
Islam (Generic)
22/26
68%
Pietism
22/26
68%
Anglican Broad-Church
22/26
68%
Pacifism
22/26
67%
LDS / Latter-day Saint Theology
22/26
65%
Thomism
22/26

How Superintelligence: Paths, Dangers, Strategies resolves each dilemma

48 resolved positions across 4 dimensions, including 3 distinctive where the majority of schools go the other way · 9 unaligned.

Each dimension is sorted so minority positions come first. Mainstream positions are folded into an expandable list.

Time · 9 dilemmas · 3 distinctive

Persistence, the future, and the direction of becoming.

Distinctive · only 15% of schools agree (31/202)
Is the universe running out of usable energy?
The heat death of the universe — entropy maxed out, no further work possible — is among the more sobering implications of mainstream physics. Whether it is structurally inescapable depends on what kind of finitude the cosmos has.
Both time and matter are unbounded; 'running out' is misframed.
On this view, the cosmos has neither a temporal horizon nor a material exhaustion point. The framing of running out presupposes bounds that the cosmos doesn't have. Energy gradients perpetuate; new configurations emerge; the categories that make heat-death scary don't apply at the cosmic scale.
Roads not taken Time is unbounded but matter is finite; usable energy can fail without time failing. (47%) · Time both has and lacks bounds depending on the level you ask at; finitude is conventional. (26%) · The cosmos has bounds; heat death is a real horizon. (12%)
Distinctive · only 15% of schools agree (31/202)
Are natural resources fundamentally finite, or only practically so?
Whether we can grow our way out of resource constraints — or whether the cosmos sets limits the economy ultimately must obey — depends on what kind of finitude matter has.
Resources are practically inexhaustible on cosmic scales; terrestrial limits are engineering.
On this view, matter and time are both unbounded at the largest scales. Terrestrial resource limits are real engineering and political constraints but not metaphysical ones; the cosmos can in principle support whatever expansion intelligence is capable of.
Roads not taken Time goes on but matter is bounded; we are eventually constrained even with infinite time. (47%) · The finitude question is level-dependent; resource ethics happens at the level that constrains us. (26%) · Resources are finite in the strict sense; living well requires accepting the limit. (12%)
Distinctive · only 15% of schools agree (31/202)
Could we owe future generations more than is materially possible to provide?
If we owe future people a habitable planet and the material means to flourish, and the cosmos is bounded in ways that make those obligations impossible at some scale, the obligation and the possibility come apart. Where they come apart turns on what kind of finitude we live in.
Both time and matter are unbounded; we cannot in principle owe more than is possible.
On this view, the cosmos has the resources to support whatever flourishing future generations are capable of, given sufficient time and intelligence. The impossibility concern is misplaced; the real questions are about trajectories and choices, not about resource ceilings.
Roads not taken Time is unbounded but matter is not; we can owe more across long time than the matter can provide. (47%) · The owing-and-possibility question is level-dependent; we owe what is appropriate at the level we act on. (26%) · The cosmos is bounded; our obligations to future generations are bounded with it. (12%)
6 mainstream positions
Do you really choose? The future is open and you are a genuine origin of it. 69% Are addicts responsible for their addiction? The addict could have chosen otherwise — that's why recovery is real. 69% Should we hold AI systems responsible for what they do? An AI without a free will is not the kind of thing that can be responsible. 69% How much weight do future people deserve? Future people are as real as you are — and their interests count for as much. 47% Is regret rational? The past is as real as the present; regret is a real attitude toward a real thing. 47% Do we owe extinct species something we cannot give them? Extinct species are as real as we are; they have standing. 47%
Matter · 7 dilemmas, all mainstream
Is the world created from nothing? Yes — matter was created and is conserved as a real substance. 55% Is the physical world fully real? Yes — the physical world is fully real, mind-independent, persisting. 55% Does matter have intrinsic moral standing? Matter is morally considerable insofar as it is created or conserved good. 55% What is money? Money is a real institution with intrinsic features. 54% What is a nation? A nation is a real moral community with intrinsic character. 54% What makes someone male or female? Sex is a real biological kind with given content. 54% Should we edit the human germline? Human nature is a real biological kind given by reproductive biology or by creation; editing the germline transgresses what is given. 54%
Observer · 37 dilemmas, all mainstream
Could causation work backwards? Causation runs one way — the arrow of time is real and structural. 68% Is the asymmetry between memory and anticipation a real feature of time, or just of us? The asymmetry is real because time itself has a real direction. 68% Is the arrow of time a real feature of the cosmos, or only of how we describe it? The arrow is real and structural; the asymmetry isn't an artifact of description. 68% Is environmental damage ever truly permanent? Damage is real and permanent on the relevant timescales. There is no recovery; there is only limitation. 66% Can a civilization recover from collapse? Civilizational complexity is hard to build and easy to lose; recovery is at best partial. 66% Does the second law of thermodynamics mean something morally? Entropy is what time is. The moral weight, if any, is the weight of working against the current. 66% When does a person begin? A person exists from conception — when a new being comes into existence. 54% What is marriage? Marriage has a given form — it’s a kind of thing we recognize, not make. 54% Does environmental harm in another country bind me morally? Moral obligation tracks the relations one is in; distance does matter, structurally. 50% Can prayer for someone far away affect them? Prayer changes the pray-er, not the prayed-for. 49% Are coincidences ever more than coincidence? Coincidence is exactly what the math says it is. The pattern is in the noticer. 49% What is our place in nature? Active in a real nature — we cultivate, steward, transform. 48% Should we colonize space? Cultivating worlds beyond Earth is the next form of stewardship. 48% Is genetic engineering of food stewardship or domination? Genetic modification is cultivation by other means. 48% Is divine omniscience compatible with human freedom? The observer is in time; foreknowledge across times raises real freedom problems. 46% Does meditation reveal something genuinely timeless? Meditators are bounded observers reporting unusual brain states; the 'timeless' is metaphorical. 46% Does prayer change God's mind? If there is an addressee at all, it is in time; prayer is communication, and may genuinely change what comes next. 46% Are the dead morally present to the living? Observers are bounded by their own moment, and no further agency makes the dead present. 44% Is reality fundamentally digital? No — continuous fields, classical limits, analog deep structure. 37% Are there indivisible units of experience? No — continuous Jamesian stream, phenomenological lived time. 37% Is memory stored or reconstructed? Reconstructed — continuous re-narrating, no fixed engrams. 37% Do animals have moral standing comparable to humans? Animal minds are real because biology is the substrate of mind. 32% Could a fetal brain organoid in a petri dish be conscious? Brain tissue can in principle do what brains do; the question is integration. 32% Should we trust expert testimony when we can't verify it? Trust expertise whose conclusions a competent mind can in principle reproduce. 32% Is religious revelation a real source of knowledge? Revelation is evaluable by reason — and not above it. 32% Does an LLM 'know' the things it correctly produces? An LLM can produce correct outputs but not reason to them; useful, not knowing. 32% What happens to "you" when you die? Death is genuinely the end. 30% Could an AI have a mind that matters? No — mind is what a biological brain does, and an LLM has no brain. 30% Does history have a direction or meaning? — — How is knowledge of reality produced? — — If a teleporter copied and destroyed you, would you have survived? — — Is salvation, liberation, or fulfillment individual or communal? — — Is the late-stage dementia patient still the person their spouse married? — — Is truth universal, tradition-bound, situated, or constructed? — — What kind of religious-theological authority does the tradition recognize? — — What makes someone the same person over time? — — Who is the moral primary — the individual, the community, the cosmos, the class, or the species? — —
Information · 4 dilemmas, all mainstream
Is anything truly lost when someone forgets? Information is conserved — the personal pattern is held even when an individual mind loses it. 39% Does deleting your data online destroy something real? Information at the cosmic level isn't destroyed; deletion only obscures access. 39% Could the dead, in principle, be brought back? The information that constitutes a person is conserved; restoration is in principle possible. 39% Is forgiveness ontologically possible? The offense persists ontologically; forgiveness is real moral work, but it doesn't erase what was. 39%
← #686 Animal Liberation All Works #688 Escape from Freedom →