King Charles has issued a formal warning regarding the “existential dangers” associated with artificial intelligence, cautioning that the technology could lead to catastrophic outcomes if it falls into the wrong hands. The monarch addressed a gathering of industry leaders, government officials, and experts at Dumfries House in Ayrshire, emphasizing that the primary objective for developers must be to ensure AI remains a tool for the benefit of humanity and the natural world.

The summit included prominent figures such as UK AI Minister Kanishka Narayan, representatives from the Vatican, and executives from major firms including Nvidia, OpenAI, and Anthropic. Discussions centered on the development of a shared set of principles to guide the future of AI, as industry insiders continue to express concerns over the rapid evolution of “frontier” models.

Nvidia CEO Jensen Huang, whose company is currently valued at approximately $5.15 trillion, advocated for a “responsible” approach to development. Huang suggested that if a product is not sufficiently safe, companies should delay releases to continue engineering. He also championed the use of open models to ensure that researchers and smaller entities are not excluded from the technological advancement.

Advertisement

Other attendees offered varying perspectives on the timeline and severity of potential risks. Sir Demis Hassabis, co-founder of DeepMind, noted that artificial general intelligence could arrive within a few years, potentially carrying an impact greater than the Industrial Revolution. While acknowledging that the risk of failure is “non-zero,” he argued that a “sensible middle way” could allow society to mitigate these dangers.

OpenAI’s chief financial officer, Sarah Friar, echoed the need for collaborative oversight, stating that no single government or corporation can address these safety challenges in isolation. The meeting follows a period of intense debate within the tech sector, with some researchers warning of extreme risks, while critics argue that focusing on hypothetical future threats may distract from immediate issues, such as the environmental impact of large-scale computing.

Source: BBC News