AI Safety

The biggest story in AI right now has nothing to do with benchmarks, parameters, or funding rounds. It’s about what happens when an AI company tells the world’s most powerful military “no” — and what happens when its rival says “yes.” Over five extraordinary days, the AI industry lived through its most dramatic ethical crisis yet. The fallout reshaped public perception of the two leading AI labs, forced a hasty contract amendment, and turned Anthropic’s Claude into the most downloaded free app in America. ...

He spent 12 hours a day talking to ChatGPT. He believed he could hear “atmospheric electricity.” Days after quitting the chatbot cold turkey, Joe Ceccanti jumped from a railway overpass in Oregon. He was 48, had no history of depression, and smiled at rail yard workers seconds before he died. His wife doesn’t blame mental illness. She blames the AI. This isn’t a fringe story anymore. A devastating Guardian investigation published this weekend — combined with a new study from Aarhus University and OpenAI’s own quiet admission that ChatGPT causes psychiatric harm — has thrust “chatbot psychosis” into the center of one of the most urgent conversations in tech. ...

The deadline is today. By 5:01 PM Friday, Anthropic must either hand over unrestricted access to Claude to the U.S. military — or face being labeled a national security risk and blacklisted from all government contracts. Anthropic’s answer? No. CEO Dario Amodei published a blog post late Thursday declaring that Anthropic “cannot in good conscience accede” to the Pentagon’s demands. The company is walking away from a $200 million defense contract rather than remove two guardrails: a ban on using Claude for mass domestic surveillance and a prohibition on fully autonomous weapons systems. ...

What happens when an AI company tells the most powerful military on Earth “no”? We’re about to find out — and the answer lands Friday at 5:01 PM. The Ultimatum Defense Secretary Pete Hegseth delivered Anthropic a blunt message on Tuesday: abandon your self-imposed ethical red lines, or face the consequences. Those consequences aren’t subtle. We’re talking about the Defense Production Act — a Cold War-era law designed to compel companies to produce goods for national security — and a “supply chain risk” designation that would effectively blacklist Anthropic from all future government work. ...

Anthropic CEO Dario Amodei walks into the Pentagon today for what might be the most consequential meeting in the short history of commercial AI. Defense Secretary Pete Hegseth didn’t invite him. He summoned him. The subtext is about as subtle as a drone strike: drop your guardrails or get blacklisted. The threat on the table? Designating Anthropic a “supply chain risk” — a classification normally reserved for Chinese tech firms like Huawei. If applied, it wouldn’t just kill Anthropic’s $200 million defense contract. It would force every Pentagon partner to purge Claude from their systems entirely. ...

The biggest AI story of February isn’t a model launch or a benchmark record. It’s a showdown between Anthropic and the Pentagon that could define how every AI company interacts with the U.S. military for decades. And it all started with one employee asking the wrong question at the wrong time. From Safety Darling to Pentagon Problem Anthropic built its brand on responsible AI. Founded by former OpenAI executives Dario and Daniela Amodei, the company drew red lines around dangerous use cases while still pursuing defense revenue. In 2024, it partnered with Palantir to bring Claude onto classified government networks via AWS — a deal reportedly worth $200 million. ...

The company that built its brand on saying “no” to dangerous AI might be about to learn what that actually costs. Over the weekend, Axios reported that the U.S. Department of Defense is considering designating Anthropic — maker of Claude, darling of the AI safety crowd — as a supply chain risk. If that label sticks, every defense contractor in the ecosystem would be forced to sever ties with the company. ...