King Charles Warns Of ‘Existential Danger’ From AI

King Charles III has warned that artificial intelligence could pose an “existential danger” if advanced technologies fall into the wrong hands.

The King made the remarks at an AI summit he convened at Dumfries House in Ayrshire, Scotland, bringing together government representatives, technology executives and other experts to discuss how AI can be developed and used responsibly.

Participants included UK AI Minister Kanishka Narayan, Pope Leo XIV’s adviser, and senior figures from companies including Nvidia, OpenAI and Anthropic.

Charles said people developing AI were increasingly warning about its potential to acquire dangerous capabilities, stressing the need to consider the consequences of misuse.

“The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity,” he told attendees.

Nvidia CEO Jensen Huang said safety should remain a priority, arguing that companies should continue developing a product if it was not yet safe enough to release.

Meanwhile, DeepMind co-founder Sir Demis Hassabis said artificial general intelligence could be only a few years away and potentially have an impact far greater than the Industrial Revolution. He added that the possibility of something going wrong was “definitely non-zero”.

OpenAI Chief Financial Officer Sarah Friar also acknowledged the need to address safety concerns, saying no single company or government could tackle the challenges alone.

The summit is considering whether a shared set of principles can be developed to guide the future use of AI as debate grows over the technology’s benefits, risks and regulation.