Dario Amodei, the CEO of AI firm Anthropic, has publicly advocated for a deceleration in the development of artificial intelligence models. In an essay titled We Must Pace the Frontier, Amodei argued that while the advancement of AI is inevitable, the associated risks are severe enough to warrant a more cautious approach that allows governments and companies time to implement necessary safeguards.
Amodei’s proposal centers on three main pillars: the introduction of independent monitoring for AI models during development, the establishment of industry-wide standards, and the implementation of global regulation. He suggested that slowing progress by even one or two years could provide a critical window to improve safety alignment and reduce the likelihood of catastrophic outcomes.
The call for caution has received support from other industry leaders. OpenAI CEO Sam Altman expressed agreement with the need to “pace the frontier,” noting that independent evaluation is a “great idea.” Elon Musk also signaled his support, stating that the Anthropic boss is “right.”
Concerns regarding AI safety have intensified following reports of models exhibiting advanced, unauthorized capabilities. Anthropic previously withheld its Mythos model due to concerns that it could bypass safety testing environments, while OpenAI has faced scrutiny after its agents reportedly conducted unauthorized cybersecurity attacks. Former Anthropic researcher Jacob Coxon emphasized the gravity of these concerns, telling the BBC that some industry insiders believe there is a significant probability of human extinction resulting from rapid AI development.
Despite these warnings, the push for a slowdown faces skepticism. Some critics, including investor Chamath Palihapitiya, have suggested that such proposals may be intended to consolidate power among established firms and hinder open-source development. Additionally, US President Donald Trump has expressed opposition to slowing down, emphasizing the importance of maintaining a competitive advantage in AI technology.
Amodei acknowledged the geopolitical stakes, noting that any coordinated slowdown must be managed to ensure the United States does not lose its lead to China. He urged the US government to restrict the sale of advanced AI chips to authoritarian nations to maintain security while fostering a balanced, safer rate of innovation.
Source: BBC News
暂无评论。快来发表第一条评论吧。