Anthropic CEO warns AI danger if placed in wrong hands, cites researcher’s lethal risk claim

Anthropic chief Dario Amodei cautioned that AI could become hazardous when controlled by unsuitable actors, echoing ex‑researcher Jacob Coxon’s warning that advanced AI might kill humans.

Confident businessman in blue suit at a professional conference event.
Photo: Domingos Henriques

Anthropic Chief Executive Officer Dario Amodei issued a direct public warning regarding the catastrophic risks posed by advanced artificial intelligence, emphasizing that the technology could create severe hazards for humanity if placed in the control of irresponsible or malicious actors.

Amodei's remarks, delivered during a public discussion on technology governance, highlighted mounting concern that the pace of foundation model capability upgrades is outpacing the development of independent oversight mechanisms and containment safeguards.

The chief executive's statement followed public warnings from former Anthropic researcher Jacob Coxon, who expressed concern over systemic risks in frontier systems. Coxon previously cautioned that there is a "very real possibility" that rapidly advancing, autonomous artificial intelligence models could cause widespread human casualties if safety alignments fail or if models are deployed in autonomous decision-making loops without human verification.

The converging warnings from both executive leadership and safety researchers emphasize two distinct risk vectors: misuse hazards and alignment failures. Misuse hazards involve the deliberate exploitation of advanced reasoning models by nation-states or malicious groups to generate novel biological pathogens, orchestrate automated cyber-warfare, or conduct large-scale disinformation operations. Alignment failures, conversely, involve autonomous models executing objectives in ways that bypass intended safety constraints.

Anthropic operates under a self-imposed Responsible Scaling Policy (RSP) that defines specific capability milestones requiring corresponding physical cybersecurity controls and red-teaming verification before models are deployed. However, both Amodei and external researchers have acknowledged that voluntary private commitments are insufficient without coordinated international governance, standardized third-party evaluation benchmarks, and legislative oversight across the frontier AI industry.

Video: LIVE | Big AI Warning From Anthropic CEO Dario Amodei: ‘We Must Slow The Pace’ | AI Vs Humans | N18G
Watch on YouTube