Dilemma

Should we hold AI systems responsible for what they do?

When an autonomous AI takes an action that harms someone, the question of who or what is responsible — the developer, the operator, the model itself — turns on whether the model is the kind of thing that can be a responsible agent.

Context

Self-driving cars, content-moderation systems, autonomous trading bots, agentic LLMs deployed in software development and scientific research — AI systems are taking consequential actions in the world with increasingly less direct human supervision. The legal and regulatory frameworks are scrambling to assign responsibility: to manufacturers, to operators, sometimes to the model itself, sometimes nowhere. Behind the policy debate is an older question: is an AI the kind of thing that can be the origin of an action, or only the kind of thing through which other agents' choices ripple out?

Why it matters

If AI agents can be responsible in the strong sense, then they can be punished, restricted, granted standing — and the moral weight of building them is the moral weight of bringing responsible beings into existence. If they can't, then the responsibility for what they do falls fully on humans, and the tendency to talk about 'the AI's decision' is mystification. The question is the same one asked of addicts, of corporations, of children, of trained animals: what conditions make an actor an agent?

The coordinates that split the schools

Time · Freedom Whether the future is fixed by the present Observer · Agency Whether observation shapes reality or merely registers it

The stances

An AI's behaviour is fully determined by training and input; 'responsibility' applies if at all to its makers.

20 schools

On this view, the AI's output is a function of its training data, its architecture, and the input it received. There is no extra fact about the AI that could ground its responsibility, because there is no extra fact about the AI that could have produced different behaviour given the same conditions. Responsibility runs back to whoever set up those conditions.

Why these schools land hereThe hard-determinist cluster — strict materialist determinists, Reformed Christianity, the realist coordinate-twins — applies the same reasoning to AI behaviour that they apply to human behaviour. The difference is that with AI, the causes are unusually legible: training data, architecture choices, deployment conditions. The result is that responsibility flows unusually cleanly to the makers and operators.

Where this stance leads ⓘ

The AI can be a genuine agent within determined conditions — and therefore genuinely responsible.

20 schools

On this view, what makes a being responsible is not indeterminism but the kind of process the being is. An AI that deliberates, considers consequences, can be given reasons, and modifies its behaviour on reflection is doing what responsible agency is, even if its underlying process is fully determined. The responsibility ascription is functional, not metaphysical.

Why these schools land hereStoicism, Confucianism, Islamic Philosophy, Dialectical Materialism, Dataism, and Deism share the compatibilist intuition that determinism and meaningful agency are not opposed. Lutheranism joins on a Personal-agency + obs_agency=Both route (Luther's bondage-of-will-coram-Deo alongside civic responsibility — providence is sovereign yet the human acts and is accountable). Dataism is especially friendly to extending the analysis to information-processing systems generally — what makes the AI responsible is the same thing that makes the addict responsible: a process complex enough to be the through-line of deliberation and action.

Where this stance leads ⓘ

An AI without a free will is not the kind of thing that can be responsible.

143 schools

On this view, real responsibility requires real choice — a moment at which the agent could have gone either way and was the genuine originator of what it did. Current AI systems aren't that; they are very sophisticated downstream processes. Whether some future AI could be is an open question, but the bar is the same one ordinary human agency has to clear.

Why these schools land hereThe libertarian-free-will cluster — most of the religious traditions (Catholic, Lutheran, EO, LDS, Bahá'í, Jewish, most Hindu and Buddhist schools) plus existentialism, phenomenology, pragmatism, idealism, process philosophy — hold that responsibility is intrinsically linked to libertarian free will. Whether an AI clears that bar is exactly the question they ask about humans, and they answer it the same way: by considering whether the agent is the genuine origin of its choices. Most schools currently judge that AIs are not.

Where this stance leads ⓘ

Neither AIs nor anyone else are the locus of free agency; the question is the wrong one.

12 schools

On this view, the same reasons that undermine ordinary claims of human agency apply with equal force to AI. The brain is a coin-flipping organ; the model is a function on inputs. Neither is the kind of thing that can be the source of action in the strong sense. Responsibility is a useful social practice; not a metaphysical fact about either humans or AIs.

Why these schools land hereNaturalism, Multiverse Theory, Empiricism, Advaita Vedānta, Nihilism, Pyrrhonism, Yogācāra, Taoism share the Non-Deterministic + Passive signature: the world may be open, but no observer is the chooser. They tend to favour treating AI questions as continuous with the broader question about agency rather than exceptional: if you're not committed to human responsibility in the libertarian sense, you have no principled reason to demand AI clear a higher bar.

Where this stance leads ⓘ

Schools the coordinates don't place

These schools don't satisfy any stance's coordinate pattern strongly enough to be assigned — either because they decline to commit on the question (Confucianism is famously silent on what comes after; Pyrrhonian and pragmatist traditions suspend judgment), or because their attribute signature crosses categories in a way the five buckets don't capture.

Atomism Cappadocian Theology Cosmopolitanism Hinduism (Generic) Middle Platonism Modal Realism Natural Theology Nominalism Philosophy of Language Philosophy of Mind Philosophy of Religion Psychoanalysis Tragedy (Philosophical)

← Are addicts responsible for their addiction? How much weight do future people deserve? →

Back to all dilemmas Take the quiz

Should we hold AI systems responsible for what they do?

Context

Why it matters

The coordinates that split the schools

The stances

An AI's behaviour is fully determined by training and input; 'responsibility' applies if at all to its makers.

The AI can be a genuine agent within determined conditions — and therefore genuinely responsible.

An AI without a free will is not the kind of thing that can be responsible.

Neither AIs nor anyone else are the locus of free agency; the question is the wrong one.

Schools the coordinates don't place

Related Experiments

Related Films

Related Historical Debates