Artificial intelligence is going to kill us all. At least, Dario Amodei thinks it might. Amodei is the CEO and co-founder of Anthropic, which was founded in 2021 and launched Claude, an closed-source A.I. agent, in 2023. The company is currently preparing to make an initial public offering (IPO), meaning that they are going to sell shares of their stock to the general public. While the date for the IPO has not yet been announced, the IPO prospectus, a formal legal document companies are required to file before going public, was leaked to Reuters. In the document, Dario Amodei states that A.I. models may present an “existential risk to humanity.”
Since its origination, Amodei and Anthropic have been advocates for greater regulation and caution in regards to developing A.I. In 2025, Amodei sat for an interview with John Collison where he said,
“I started a company not because I was initially excited about selling things or business or any of that; I’d seen the way that some of the other companies had run and the magnitude and gravity of what they were trying to build, and I was just a bit concerned that the people and the motivations were maybe not the best ones, and you know, I knew that there would be a number of players in this space, but it felt like having at least one player that kind of had a strong compass in how we do things could have positive effects on the ecosystem. We would build things in a different way, we would deploy them in a different way, and above all, we would have a, again sometimes short, list of principles, but we would stick to them as well as we could.”
When Collison asked Amodei about the potential risks of A.I., Amodei stated, “Some of the dangers of A.I. have the potential to significantly destabilize society or threaten humanity or civilization, and so, I think we don’t want to take idle chances with that level of risk.” Despite this, Amodei expressed that he doesn’t believe that A.I. development should be stopped or slowed, saying “It’s just not possible; we have geopolitical adversaries. They’re not going to not make the technology… I mean, if you even propose even the slightest amount of regulation– I have [proposed regulation], and… I have many trillions of dollars of capital lined up against me [from people] for whom that’s not in their interest.”
Anthropic has also been transparent in the past about undesirable behavior from their A.I. models. In 2025, they admitted that a model they were testing exhibited behavior akin to blackmail. In an essay penned for the New York Times, Dario Aomdei wrote,
“Picture this: You give a bot notice that you’ll shut it down soon, and replace it with a different artificial intelligence system. In the past, you gave it access to your emails. In some of them, you alluded to the fact that you’ve been having an affair. The bot threatens you, telling you that if the shutdown plans aren’t changed, it will forward the emails to your wife. This scenario isn’t fiction. Anthropic’s latest A.I. model demonstrated just a few weeks ago that it was capable of this kind of behavior. Despite some misleading headlines, the model didn’t do this in the real world. Its behavior was part of an evaluation where we deliberately put it in an extreme experimental situation to observe its responses and get early warnings about the risks, much like an airplane manufacturer might test a plane’s performance in a wind tunnel.”
In the same essay, Amodei also claimed that Anthropic was not the only A.I. developer experiencing these kinds of risks, and he noted that OpenAI, the company that created ChatGPT, tested a model that “at times wrote special code to stop itself from being shut down.”
Despite the mounting concerns over the safety of the artificial intelligence models currently in development, United States President Donald Trump recently opted not to construct any federal regulations on A.I. expansion after a meeting with leading developers of A.I. on Sept. 29. President Trump previously posted about A.I. regulation on Truth Social, writing, “The only control or ‘guardrails’ that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!” When a reporter asked him if anything from the Sept. 29 meeting had changed his opinion on the necessity of guardrails for A.I., President Trump claimed that he is “seeing tremendous self-policing, and they understand that they have to self-police.” Consequently, the CEOs signed an accord wherein they agreed to perform internal and external reviews of their technology. When asked if the accord was binding in any way, President Trump responded, “I think it’s morally binding, yeah.” Moving forward, artificial intelligence will remain unregulated on a national level, and any external regulation will now have to come at a state level.
