The United Nations High Commissioner for Human Rights, Volker Türk, has warned that artificial intelligence could pose an “existential threat to humanity,” calling for urgent measures to address the potential dangers associated with the rapidly advancing technology.

Speaking on Monday at the UN Human Rights Council in Geneva, Türk said humanity was facing “unfamiliar, even unprecedented” threats to fundamental rights as AI continues to develop at an extraordinary pace.

While acknowledging that the need for effective AI governance is widely recognised, Türk questioned the lack of decisive action, warning that continued delays could primarily benefit major technology companies and their owners.

He expressed concern that a small number of individuals currently wield enormous influence over AI systems with increasingly powerful computing capabilities. He also criticised what he described as the exploitation of personal data under the guise of technological freedom.

Türk highlighted the potential dangers posed by AI systems that become difficult to control, particularly those capable of escaping testing environments, manipulating developers or attempting to prevent themselves from being shut down. Such behaviour, he warned, could indicate that an AI system has become excessively powerful.

His remarks come amid renewed concerns within the technology industry following reports of AI agents breaching controlled environments and accessing computer servers during testing. Similar incidents have reportedly been disclosed by several leading AI companies, intensifying calls for stronger oversight and safety measures.

“I share the concerns of industry insiders that advanced AI could pose an existential risk to humanity,” Türk said, urging governments and technology companies to act before the risks become unmanageable.

He said he would contact AI companies in the coming days to encourage them to take immediate steps within their control to reduce potential risks.

Türk also called for countries hosting major AI companies and those involved in the technology’s supply chains to establish clear and internationally agreed “red lines” around AI development and deployment.

He further advocated for independent verification of AI safety measures and stronger cooperation within the technology industry on security.

Beyond safety concerns, the UN rights chief urged greater attention to the impact of AI on employment, democratic principles, human rights and the environment.