King Charles Warns AI Leaders: Don't Let Humanity Lose Control

King Charles III opened an artificial intelligence summit at Dumfries House in Ayrshire, Scotland, calling on technology industry leaders to ensure humanity does not lose control of its destiny. The event drew Nvidia CEO Jensen Huang and other senior figures from the AI industry.

The British monarch made clear that the accelerated development of the technology raises concern alongside great interest. "The development of artificial intelligence, its content and pace, arouses equal measures of interest and deep concern," the King said, adding that "the decisions taken in this formative period will shape the world that future generations will inherit."

King Charles asked those present for clear assurances "that we do not choose to lose control of our destiny," emphasizing the magnitude of responsibility resting on the shoulders of industry leaders. He stressed that "the task before you is not merely to advance technology, but to ensure it remains in the service of humanity, community, and the natural world."

The King's remarks come against the backdrop of an unusual wave of warnings that has accumulated in recent days about the dangers of artificial intelligence. Researchers from the technology industry, executives of major companies, and public figures are warning that the rapid development of advanced systems could spiral out of control.

Jacob Coaxon, a 27-year-old researcher who previously worked at Anthropic and OpenAI, resigned from his position and published a stark warning that the people building AI systems seriously believe the technology could kill humanity by the end of the decade. According to him, companies are racing toward systems capable of improving themselves, while safety measures are not advancing at the same pace.

Dario Amodei, CEO of Anthropic, joined the warnings and called for slowing the pace of development of advanced AI systems. He cautioned that the rate of progress could outpace humanity's ability to understand and control the systems, and proposed external oversight and cooperation between companies and nations.

OpenAI CEO Sam Altman (Photo: Shutterstock)

Sam Altman, CEO of OpenAI, also acknowledged that concern about the risks of artificial intelligence is justified. "The world is right. You should be afraid of this," Altman said, adding that certain accidents may be inevitable as the technology develops rapidly. According to him, companies in the field must be prepared to slow down and even stop when they cannot guarantee that continued development is safe.

The Scotland summit includes other prominent figures from the technology industry and government, among them AI Minister Kanishka Narayan and the Vatican's technology advisor. The gathering aims to examine how technology can be harnessed for the benefit of society while maintaining public security.