The world stands closer than ever to crossing what senior international officials call a "moral red line": allowing machines to make independent decisions about harming human beings without meaningful human control. UN Secretary-General António Guterres and Mirjana Spoljaric, president of the International Committee of the Red Cross (ICRC), issued a joint appeal this week urging nations to urgently establish binding international rules against lethal autonomous weapons.
According to the two leaders, autonomous weapon systems are no longer science fiction. "The race toward greater autonomy in weapons systems is already underway," their statement warned. While defensive autonomous systems, such as missile interception platforms, are already deployed by various militaries, the primary concern centers on developing systems capable of independently locating, identifying, and attacking human targets.
UN officials and human rights organizations caution that artificial intelligence cannot replace human judgment on the battlefield. An autonomous system might misidentify targets, for instance, classifying a wounded soldier, someone surrendering, or a civilian uninvolved in combat as a legitimate target. Such scenarios also raise accountability questions: who bears responsibility when an algorithm makes a fatal error, the commander, the operator, the manufacturer, or the state that developed the system?
Mélanie Régimbal, who heads the UN's disarmament affairs division in Geneva, reiterated Guterres's position that systems capable of taking human life without human control are "politically unacceptable, morally repugnant, and should be prohibited under international law."
The appeal comes ahead of the seventh Review Conference of the Convention on Certain Conventional Weapons (CCW), scheduled for November in Geneva. Member states are expected to decide whether to begin formal negotiations on an international treaty regulating or restricting autonomous weapons use, following more than a decade of discussions on the issue.
Guterres and Spoljaric urged nations to move from incremental discussions to concrete decisions. They warned that failure to establish clear rules in time could allow military realities to outpace legal frameworks—leaving the ultimate decision of who lives and who dies in the hands of machines.
