Military and autonomous weapons · Political and power concentration
Arms race between states
Military competition over AI capabilities pushes deployment before reliability is known, and the forum that could slow it operates by consensus among the competitors.
- Severity
- Catastrophic
- Horizon
- Already happening
- Evidence
- Observed
- Consensus
- Medium
There is no treaty on autonomous weapons for a structural reason, not for lack of agreement about the facts. The forum that could produce one —the group of experts of the Convention on Certain Conventional Weapons— works by consensus, which gives a veto to any of the 128 High Contracting Parties, including those that build and use these weapons [208]Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1)View source ↗. The forum where there is an overwhelming majority, the General Assembly, does not produce obligations: resolution 79/62 passed with 166 votes in favour and 3 against, and it does not mandate treaty negotiations [525]Killer Robots: UN Vote Should Spur Treaty NegotiationsView source ↗.
The Geneva session of 31 August to 4 September 2026 illustrates it: there was convergence on a characterisation and on principles, and the final recommendation is that the Review Conference decide by consensus the modalities of future work [208]Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1)View source ↗. Reuters reported from Geneva that the United States and Russia proposed last-minute changes and deletions and that Washington prefers guidelines to a binding treaty [903]Opposition by US and Russia raises doubts over autonomous weapons talks outcome, diplomats sayView source ↗. Meanwhile the programmes run on: in July 2025 the Department of Defense awarded contracts worth up to 200 million dollars to four frontier labsFrontier AIThe most advanced AI systems in existence at a given time, the ones pushing the limit of what the technology can do. A handful of companies with enormous resources build them.For exampleLike Formula 1 cars: there are few of them, they are extremely expensive and only a few teams build them, but what gets tested there ends up in everyone's car. [290]Pentagon-Anthropic Dispute over Autonomous Weapon Systems: Potential Issues for CongressView source ↗archived copy only.
What this does not demonstrate. “Race” describes the structure of incentives, not a measurement: there is no public study comparing testing margins before and after, or civilian casualties with and without autonomy in target selection. Human Rights Watch, which campaigns for the treaty and is therefore an interested party, reports that the final version removed references to design, to ethical considerations and to predictability and traceability [526]UN Talks on Killer Robots Ends with Calls for Negotiations GrowingView source ↗; the document adopted on 5 September had still not been published as of the date of this review [1073]Convention on Certain Conventional Weapons — Group of Governmental Experts on Lethal Autonomous Weapons Systems (2026)View source ↗, so that weakening cannot be checked.
Chain of materialisation
PreconditionObserved
Programmes are running and contracts signed
In July 2025 the Department of Defense awarded contracts of up to 200 million dollars each to Anthropic, Google, OpenAI and xAI. Replicator was announced to field thousands of uncrewed systems by August 2025; Congress records that only hundreds were fielded.
Precedents: The Pentagon-Anthropic dispute over autonomous weapons and surveillance
TriggerObserved
The forum that could regulate closes with no mandate to negotiate
The CCW expert group met from 31 August to 4 September 2026 and adopted by consensus a report that describes the problem and defers deciding what to do. Reuters reported that the United States and Russia proposed last-minute changes and deletions, and that Washington favours something closer to guidelines than a binding treaty.
Precedents: The CCW group of experts closes without a negotiating mandate
Observed and demonstrated evidence ends here. What follows is projection.
CascadeProjected
Competitive pressure eats the testing margin
The argument is about incentives and the supplier itself makes it: autonomous systems may prove critical for national defence, but frontier AI systems are not reliable enough today to power them. That competition shortens verification is plausible and is not measured in any public comparative study.
ImpactSpeculative
Deployed systems whose behaviour nobody characterised
Neither the expert group report, nor the Congressional Research Service, nor SIPRI presents a single comparative study of civilian casualties with and without autonomy in target selection. The absence of that datum after a decade of debate is itself informative.
See on the map →Report a mistake in this entry →
Sources
- [208] Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1) · Naciones Unidas — Convención sobre Ciertas Armas Convencionales 2026
- [526] UN Talks on Killer Robots Ends with Calls for Negotiations Growing · Human Rights Watch 2026
- [903] Opposition by US and Russia raises doubts over autonomous weapons talks outcome, diplomats say · Reuters 2026
- [525] Killer Robots: UN Vote Should Spur Treaty Negotiations · Human Rights Watch 2024
- [1073] Convention on Certain Conventional Weapons — Group of Governmental Experts on Lethal Autonomous Weapons Systems (2026) · Naciones Unidas — Oficina de Asuntos de Desarme 2026
- [206] Second session of the 2026 CCW Group of Governmental Experts on emerging technologies in the area of Lethal Autonomous Weapons Systems — Information for participants · Naciones Unidas — Oficina de Asuntos de Desarme 2026
- [291] DOD Replicator Initiative: Background and Issues for Congress · Congressional Research Service 2026 archived copy only
- [290] Pentagon-Anthropic Dispute over Autonomous Weapon Systems: Potential Issues for Congress · Congressional Research Service 2026 archived copy only
- [77] Where things stand with the Department of War · Anthropic 2026
- [972] Impact of Military Artificial Intelligence on Nuclear Escalation Risk · Stockholm International Peace Research Institute 2025
- [299] Ukraine's Future Vision and Current Capabilities for Waging AI-Enabled Autonomous Warfare · CSIS Wadhwani AI Center 2025