Skip to content
OGERIA — Observatory of Global Evidence on Risks in AISynthesis report · 2026 ed.
Updated 2 Oct 2026

Chapter 01 · Risk map

Military competition over AI capabilities pushes deployment before reliability is known, and the forum that could slow it operates by consensus among the competitors.

Severity
Catastrophic
Horizon
Already happening
Evidence
Observed
Consensus
Medium

There is no treaty on autonomous weapons for a structural reason, not for lack of agreement about the facts. The forum that could produce one —the group of experts of the Convention on Certain Conventional Weapons— works by consensus, which gives a veto to any of the 128 High Contracting Parties, including those that build and use these weapons [208]Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1)Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems · 2026 · official documentView source ↗Accessed on 9 September 2026. The forum where there is an overwhelming majority, the General Assembly, does not produce obligations: resolution 79/62 passed with 166 votes in favour and 3 against, and it does not mandate treaty negotiations [525]Killer Robots: UN Vote Should Spur Treaty NegotiationsHuman Rights Watch · 2024 · reportView source ↗Accessed on 9 September 2026.

The Geneva session of 31 August to 4 September 2026 illustrates it: there was convergence on a characterisation and on principles, and the final recommendation is that the Review Conference decide by consensus the modalities of future work [208]Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1)Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems · 2026 · official documentView source ↗Accessed on 9 September 2026. Reuters reported from Geneva that the United States and Russia proposed last-minute changes and deletions and that Washington prefers guidelines to a binding treaty [903]Opposition by US and Russia raises doubts over autonomous weapons talks outcome, diplomats sayLe Poidevin, Olivia · 2026 · pressView source ↗Accessed on 9 September 2026. Meanwhile the programmes run on: in July 2025 the Department of Defense awarded contracts worth up to 200 million dollars to four frontier labsFrontier AIThe most advanced AI systems in existence at a given time, the ones pushing the limit of what the technology can do. A handful of companies with enormous resources build them.For exampleLike Formula 1 cars: there are few of them, they are extremely expensive and only a few teams build them, but what gets tested there ends up in everyone's car. [290]Pentagon-Anthropic Dispute over Autonomous Weapon Systems: Potential Issues for CongressSayler, Kelley M. · 2026 · official documentView source ↗archived copy onlyAccessed on 9 September 2026.

What this does not demonstrate. “Race” describes the structure of incentives, not a measurement: there is no public study comparing testing margins before and after, or civilian casualties with and without autonomy in target selection. Human Rights Watch, which campaigns for the treaty and is therefore an interested party, reports that the final version removed references to design, to ethical considerations and to predictability and traceability [526]UN Talks on Killer Robots Ends with Calls for Negotiations GrowingHuman Rights Watch · 2026 · reportView source ↗Accessed on 9 September 2026; the document adopted on 5 September had still not been published as of the date of this review [1073]Convention on Certain Conventional Weapons — Group of Governmental Experts on Lethal Autonomous Weapons Systems (2026)United Nations Office for Disarmament Affairs · 2026 · webView source ↗Accessed on 9 September 2026, so that weakening cannot be checked.

Chain of materialisation

  1. PreconditionObserved

    Programmes are running and contracts signed

    In July 2025 the Department of Defense awarded contracts of up to 200 million dollars each to Anthropic, Google, OpenAI and xAI. Replicator was announced to field thousands of uncrewed systems by August 2025; Congress records that only hundreds were fielded.

    Precedents: The Pentagon-Anthropic dispute over autonomous weapons and surveillance

  2. TriggerObserved

    The forum that could regulate closes with no mandate to negotiate

    The CCW expert group met from 31 August to 4 September 2026 and adopted by consensus a report that describes the problem and defers deciding what to do. Reuters reported that the United States and Russia proposed last-minute changes and deletions, and that Washington favours something closer to guidelines than a binding treaty.

    Precedents: The CCW group of experts closes without a negotiating mandate

    Observed and demonstrated evidence ends here. What follows is projection.

  3. CascadeProjected

    Competitive pressure eats the testing margin

    The argument is about incentives and the supplier itself makes it: autonomous systems may prove critical for national defence, but frontier AI systems are not reliable enough today to power them. That competition shortens verification is plausible and is not measured in any public comparative study.

  4. ImpactSpeculative

    Deployed systems whose behaviour nobody characterised

    Neither the expert group report, nor the Congressional Research Service, nor SIPRI presents a single comparative study of civilian casualties with and without autonomy in target selection. The absence of that datum after a decade of debate is itself informative.

See on the map →Report a mistake in this entry →

Sources

  1. [208] Report of the 2024-2025-2026 sessions of the Group of Governmental Experts on Emerging Technologies in the Area of Lethal Autonomous Weapons Systems (CCW/GGE.1/2026/CRP.1/Rev.1) · Naciones Unidas — Convención sobre Ciertas Armas Convencionales 2026
  2. [526] UN Talks on Killer Robots Ends with Calls for Negotiations Growing · Human Rights Watch 2026
  3. [903] Opposition by US and Russia raises doubts over autonomous weapons talks outcome, diplomats say · Reuters 2026
  4. [525] Killer Robots: UN Vote Should Spur Treaty Negotiations · Human Rights Watch 2024
  5. [1073] Convention on Certain Conventional Weapons — Group of Governmental Experts on Lethal Autonomous Weapons Systems (2026) · Naciones Unidas — Oficina de Asuntos de Desarme 2026
  6. [206] Second session of the 2026 CCW Group of Governmental Experts on emerging technologies in the area of Lethal Autonomous Weapons Systems — Information for participants · Naciones Unidas — Oficina de Asuntos de Desarme 2026
  7. [291] DOD Replicator Initiative: Background and Issues for Congress · Congressional Research Service 2026 archived copy only
  8. [290] Pentagon-Anthropic Dispute over Autonomous Weapon Systems: Potential Issues for Congress · Congressional Research Service 2026 archived copy only
  9. [77] Where things stand with the Department of War · Anthropic 2026
  10. [972] Impact of Military Artificial Intelligence on Nuclear Escalation Risk · Stockholm International Peace Research Institute 2025
  11. [299] Ukraine's Future Vision and Current Capabilities for Waging AI-Enabled Autonomous Warfare · CSIS Wadhwani AI Center 2025

Ask OGERIA

It answers only with what the observatory publishes and can be wrong: check the entries it cites. Your questions are sent to an AI model, so don't write personal data. More in the privacy policy.

Up to 500 characters.

Support OGERIA on Ko-fi

The payment is processed by Ko-fi, not by this site. Open on ko-fi.com