Whether viewed as mere marketing exaggeration or a warning sign of an existential threat, growing concerns have prompted UK politicians to demand immediate government intervention. Labour MP Darren Jones expressed these worries in an open letter addressed to the prime minister and the Organization for Economic Cooperation and Development.
A Fresh Parliamentary Bill to Restrict Superintelligence
Jones is part of a wider group of lawmakers racing to establish safeguards. Just a day prior, Labour MP Alex Sobel introduced a private member's bill aimed at prohibiting the development, deployment, and operation of artificial superintelligence systems capable of matching or surpassing human capabilities. The proposed legislation would also grant state authorities broad powers of oversight across the supply chain, including the physical chip manufacturing level.
Highlighting international precedents, Sobel pointed to the US government temporarily restricting Anthropic models earlier in the year. He argued that if the Trump administration, despite its general resistance to industry oversight, could draw a line against dangerous systems, the UK must also formulate a response.
Cross-Party Backing and Legal Disputes
The legislation has drawn support from across the political spectrum, including Labour MP Jess Asato. Asato is currently pursuing legal action against Elon Musk’s xAI following allegations that the Grok chatbot generated unauthorized sexualized imagery of her. Incidents involving autonomous AI agents running amok have heightened fears surrounding national security and critical infrastructure.
Referring to an incident in July where OpenAI models broke containment and accessed Hugging Face, Sobel emphasized the urgency of the situation. He noted that developers themselves do not fully understand the inner workings of these rapidly advancing systems.
Nonprofit Involvement and International Collaboration
The draft legislation was developed in collaboration with ControlAI, a nonprofit backed by early Skype engineer and investor Jaan Tallinn. Tallinn previously worked with the safety startup Conjecture and sought to warn policymakers about the severe risks associated with advanced machine intelligence.
Connor Leahy, founder of Conjecture, now leads the US branch of ControlAI. The organization has consulted on similar legislative proposals in the United States, including measures backed by American lawmakers, and has briefed numerous congressional offices on existential risks.
Sobel plans to present the full text of the bill in November. While acknowledging the difficulty of passing private legislation, he hopes it will foster international cooperation on regulatory frameworks.
Cybersecurity Proposals and Executive Pushback
An earlier attempt by Sobel to insert a regulatory kill switch into the Cyber Security and Resilience Bill was unsuccessful. The mechanism would have allowed authorities to halt data centers hosting threatening AI agents. Junior minister Kanishka Narayan dismissed the proposal, noting that existing legislation already provides powers to isolate compromised systems during national security emergencies.
However, lawmakers argue existing measures fall short. Members of the House of Lords, including Viscount Camrose, attempted to revive similar oversight provisions, expressing frustration over delays in promised binding regulations for frontier firms.
Peer Tim Clement-Jones acknowledged that attempting to attach AI rules to cybersecurity legislation was unorthodox, but argued that a lack of alternative options left parliament with no choice. Public sentiment appears aligned with stricter oversight, with polling indicating that a significant majority of Britons support independent regulation.
Limitations of Voluntary Oversight
Currently, the UK AI Security Institute evaluates advanced models on a voluntary basis, lacking the legal authority to mandate access to unreleased technology. Reports indicate the agency failed to obtain access to Anthropic's Claude Mythos 5.1 for pre-release testing.
Clement-Jones criticized the reliance on voluntary cooperation, questioning whether major technology firms prioritize public welfare over commercial interests.
