Britain's King Charles spoke to leaders in the artificial intelligence industry on Thursday. He warned them about the risks the technology could pose if misused.
The king hosted a summit at his Dumfries House estate in Cumnock, Scotland. Attendees included cofounders of Nvidia and Google DeepMind.
Leaders from OpenAI and Anthropic also joined the gathering. The event brought together government officials and other thought leaders as well.
Charles said there is urgency in addressing the dangers of the technology. He said this needs attention before it is "too late" to manage.
"There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands," Charles told guests at the opening of the conference. He added that the technology could be used in "potentially catastrophic ways."
King Charles Calls for Safety Focus
The king said people who value humanity are looking for reassurance. He said they want to know that control over the future will not be lost.
Charles pointed out that some creators of AI technology are now warning about its darker sides. He said this includes concerns that AI could even be used to take life.
He urged industry leaders to develop the technology "with safety at its heart." He also asked them to keep AI in service of humanity, community, and the natural world.
Charles described the pace of AI development as both interesting and worrying. He said these two feelings exist in equal measure.
Global Leaders Weigh In on AI Risks
Other public figures have also commented on AI regulation in recent months. Pope Leo XIV said in May that the world does not need an AI that diminishes humanity.
US President Donald Trump has taken a different stance. He has called concerns about the technology a "hoax."
Last week, two Anthropic researchers issued a warning about the technology. They said it could lead to human extinction if development continues at its current pace.
Anthropic Chief Executive Dario Amodei has also spoken out. He has called for companies to slow down the pace of AI development.
Some observers have questioned the motives behind these warnings. They suggest executives may be trying to get ahead of government rules that could affect their companies.
There is an ongoing debate about whether the AI industry should regulate itself. The alternative is for governments to set guidelines for how the technology develops.
The summit in Scotland is not expected to produce any binding agreements. No formal commitments were announced by the end of Thursday's meeting.
