Photo Credit: Getty Images
New warnings from within the artificial intelligence industry have revived a long-running debate over whether advanced AI could escape human control and ultimately threaten humanity’s survival, and whether the companies developing the technology are doing enough to prevent such a scenario.
The CEO of Anthropic, the San Francisco company behind Claude, said he thought the industry needed to reduce the speed of its work, cautioning Saturday that a swarm of AI agents might be able to take over the internet in six months to a year unless companies devoted more time to putting safeguards in place.
Dario Amodei outlined a plan for companies like his and governments around the world to ensure that increasingly capable AI models remain aligned with the commands and values of responsible people days after two former Anthropic safety researchers publicly aired concerns that the existential threats AI might pose to humanity were receiving too little attention.
Sam Altman, CEO of ChatGPT maker OpenAI, said this weekend that companies should start coordinating on AI safety without waiting for the government to introduce legislation. The “pacing” of AI development doesn’t mean stopping, Altman wrote on X. “But it should be slower than it otherwise could be.”
Here’s what to know about the recent dire predictions and whether any brakes might be put on AI advancement:
AI models are becoming more powerful
Concerns over the potential risks of the technology are rising as new AI models become more powerful, heightening both the potential for misuse by people with criminal aims, such as creating and spreading a disease that kills most of the world’s population, and the risk of AI systems going rogue in a dangerous way.
