Loss of control · Economic and labor · Political and power concentration
Coupled gradual disempowerment
The economy, culture and the state stop needing humans to function, releasing the constraint that kept them aligned with human interests.
- Severity
- Irreversible
- Horizon
- 3–10 years
- Evidence
- Projected
- Consensus
- Low
This is the risk with no villain. Kulveit, Douglas, Ammann, Turan, Krueger and Duvenaud propose a catastrophe mechanism that does not require any AI system to be hostile, deceptive or superintelligent [618]Gradual Disempowerment: Systemic Existential Risks from Incremental AI DevelopmentView source ↗. The argument is about a constraint, not about an intention: the economy, culture and the state are aligned with human interests partly because they depend on humans —workers to produce, consumers with money, taxpayers, soldiers—. That dependence forces them to keep people alive, healthy, educated and able to buy, whether anyone wants it or not. If AI systems do that work, the constraint comes loose. The empirical anchor is that labour’s share of US GDP has been stable at around 60% for more than a century: that stability is what would be at stake.
It is the same shape Critch and Russell call diffusion of responsibility: automated processes can cause societal harm even when nobody in particular is chiefly responsible for creating or deploying them [288]TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AIView source ↗. And what is observed today is compatible with the first step: the youth employment gap in exposed occupations opens through less hiring, not through more layoffs [164]Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial IntelligenceView source ↗.
What this does not demonstrate. It is a conceptual argument, and its authors present it as one: there is no datum that confirms it or refutes it. The strongest counterargument starts from the same fact and reaches the opposite conclusion. Narayanan and Kapoor hold that diffusion is slow —generative AI is used in 0.5% to 3.5% of working hours, even though 40% of US adults have adopted it— and treat that institutional slowness as a buffer that gives time to adapt [773]AI as Normal TechnologyView source ↗. Kulveit and co-authors treat it as anaesthesia: if the change is diffuse, no institution detects the moment to resist it. There is no datum that arbitrates between the two.
Chain of materialisation
PreconditionObserved
Alignment of large systems rests on them needing people
An economy needs workers to produce and consumers with money to buy; a state needs taxpayers and soldiers. That dependence is not a moral value but a structural constraint, and its empirical anchor is that the US labour share of GDP has stayed near 60% for over a century.
Precedents: The youth employment gap in exposed occupations widens to 19%
TriggerLab
Substitution starts where work can be verified
Measured productivity effects are large and compress the skill distribution: 14% more cases resolved per hour in support and 34% for novices; 12.2% more tasks completed in consulting inside the capability frontier and 19 percentage points less accuracy outside it. The frontier is jagged and which side a task falls on is unknowable without trying.
Precedents: A randomized trial finds AI made experienced developers slower · METR publishes the first task time-horizon series
Observed and demonstrated evidence ends here. What follows is projection.
CascadeProjected
The three domains reinforce each other
Economic power shapes cultural narratives and political decisions, and cultural shifts alter economic and political behaviour. Kulveit and co-authors note that insofar as these systems already reward outcomes misaligned with human preferences, AI systems will optimise those outcomes more aggressively. It is a conceptual argument with no datum confirming or refuting it.
ImpactSpeculative
Loss of influence with no system misbehaving
The outcome they describe is an effectively irreversible loss of human influence over crucial societal systems. What distinguishes it from other control risks is that it requires no AI to be hostile, deceptive or superintelligent: there is nobody to blame and therefore no moment at which to resist.
Scenarios where it appears
Related measures
See on the map →Report a mistake in this entry →
Sources
- [618] Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development · Kulveit, Jan 2025
- [288] TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI · Critch, Andrew 2023
- [336] The Intelligence Curse · Drago, Luke 2025
- [773] AI as Normal Technology · Knight First Amendment Institute at Columbia University 2025
- [164] Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial Intelligence · Stanford Digital Economy Lab 2026
- [327] Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality · Harvard Business School 2026 verified through Crossref
- [163] Generative AI at Work · NBER 2025 verified through Crossref
- [15] The Simple Macroeconomics of AI · MIT / NBER 2025
- [538] International AI Safety Report 2026 · International AI Safety Report (panel con representantes nominados por más de 30 países) 2026
- [169] Tracking the Impact of AI on the Labor Market · The Budget Lab at Yale 2026