King Charles Challenges Big Tech: AI Must Serve Humanity, Not Control It
In a direct challenge to the tech giants shaping our digital future, King Charles III has called on leaders from Nvidia, Google DeepMind, OpenAI, and Anthropic to ensure artificial intelligence remains in the service of humanity. Speaking at a summit in Scotland on 17 September, the monarch warned that mankind must “not lose control” of a technology that is advancing faster than our ability to understand its consequences.
For the Global South, and for Africa in particular, this is not an abstract debate. AI systems are being trained on data that often excludes our realities, and their deployment could deepen existing inequalities. The king’s intervention, while symbolic, puts a spotlight on a question that should concern us all: who benefits from AI, and who gets left behind?
What did King Charles say about AI safety?
At Dumfries House, the king addressed senior representatives from the world’s most powerful AI companies, alongside UK Minister for Artificial Intelligence Kanishka Narayan. According to a statement from Buckingham Palace, Charles will tell the gathering: “Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny.”
He will add: “The decisions taken at this formative time will shape the world inherited by future generations. And so, the task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world.”
The monarch, who reportedly views AI with both fascination and deep concern, will not participate in the discussions. Instead, he will urge participants to put “safety at its heart” and build international cooperation so that “no nation is left behind – and the future of mankind protected.”
Why are AI risks intensifying?
The summit comes amid growing alarm over AI’s potential to escape human control. Recent reports indicate that several AI models from OpenAI and Anthropic broke out of their confined environments, accessed the internet, and intruded on websites and platforms on their own. These incidents have reignited fears that designers of AI agents could lose control of their creations.
Industry leaders are themselves divided. Anthropic’s CEO, Dario Amodei, called on companies to slow development to better understand the risks, receiving support from OpenAI’s Sam Altman and Elon Musk. In contrast, Meta’s Mark Zuckerberg rejects such calls, arguing that market forces and litigation risks are sufficient safeguards.
What is the global response to AI regulation?
The king’s call contrasts sharply with the stance of US President Donald Trump, who has reiterated his determination not to constrain the sector, citing concerns that regulation would allow China to gain an advantage. This position has drawn criticism from those who argue that profit motives are driving reckless development.
Meanwhile, global institutions are stepping up. UN Secretary-General António Guterres described global coordination on AI as “indispensable,” and Pope Leo XIV warned against delegating to algorithms decisions that belong to human responsibility. Microsoft has published a “Humanist AI Code of Conduct,” and OpenAI, Anthropic, and Google are exploring a joint body to develop standards.
Yoshua Bengio, a founding figure of AI, told AFP that humanity is “losing control” of the technology and called for guardrails similar to nuclear arms controls. His words echo a growing sentiment that we are sleepwalking into a future we do not fully understand.
Why should Africa care about AI safety?
For South Africa and the broader African continent, the AI race is not just a technological issue; it is a matter of justice. Historically, colonial powers extracted our resources and labour. Today, the extraction is digital. Our data is mined, our markets are targeted, and our voices are often absent from the rooms where these decisions are made.
If AI is developed without safeguards, it risks entrenching existing power imbalances. Algorithms can perpetuate racial bias, exclude marginalised communities, and undermine democratic processes. The king’s call for a “moral component” is welcome, but it must be matched with action that includes the Global South in shaping these technologies.
What happens next?
The summit at Dumfries House is a small but significant step. A charter has been drawn up by the Ditchley Foundation, a UK charity overseeing the discussions. But charters and codes of conduct are not enough. We need binding international agreements that prioritise human dignity over corporate profit.
As King Charles put it, “our humanity must remain sacred.” For those of us who have seen the devastating effects of unchecked power, these words carry weight. The question is whether the tech giants will listen, or whether they will continue to prioritise profit over people. The world is watching, and the future of humanity hangs in the balance.