Britain Warns Big Tech Cannot Police AI Alone as Fears Grow Over Models Falling Into Enemy Hands

AI minister Kanishka Narayan is expected to call for stronger safeguards, domestic infrastructure and greater scrutiny of frontier systems amid national security concerns

UK AI security concerns over advanced model theft
Britain warns Big Tech cannot police its own AI as experts fear hostile states could steal advanced models, prompting fresh calls for stronger safeguards Credit: Wikimedia Commons/Foreign and Commonwealth Office

Britain is preparing to strengthen its cyber defences as AI minister Kanishka Narayan warns that the country cannot rely solely on technology companies to police their most powerful artificial intelligence systems.

In a speech scheduled for Monday, 12 October 2026, in west London, Narayan is expected to call for stronger safeguards amid concerns that hostile governments could steal unreleased AI models.

The planned announcement comes amid warnings about whether leading AI developers can adequately protect their most advanced technology from foreign adversaries. According to The Guardian, Narayan will also argue that Britain needs to develop more of its own AI infrastructure rather than depend heavily on overseas technology companies.

Former AI Safety Chief Warns of Model Theft

Geoffrey Irving, former chief scientist at Britain's AI Security Institute (AISI), has warned that leading developers may struggle to prevent determined foreign governments from stealing advanced AI models.

Irving, who previously worked at OpenAI and Google DeepMind, told The Guardian that existing security measures may be insufficient to prevent model theft by adversarial states. His warning concerns unreleased frontier models, which could have capabilities beyond those available through publicly accessible AI services.

Such theft could give an unauthorised party access to a model's weights, the numerical parameters developed during training. Possessing those weights could potentially allow a model to be operated or modified outside its developer's normal controls without reproducing the costly training process.

Irving pointed to a recent authorised security test of OpenAI as an example of the challenge. Cybersecurity researchers working under the company's bug bounty programme gained access to internal systems and demonstrated how an attacker could potentially move further into company infrastructure. The exercise was an ethical hack, not a hostile cyberattack, and there is no reported evidence that model weights were stolen. OpenAI acknowledged the findings and addressed the vulnerabilities identified by the researchers.

British Intelligence Chiefs Raise AI Security Concerns

The warning follows reports that senior officials from MI5, MI6 and GCHQ briefed the British cabinet about national security threats involving advanced AI.

The Times reported that the briefing took place on 8 September. Intelligence chiefs warned that adversarial states, terrorists and other actors could use increasingly capable AI for threats including cyberattacks and influence operations. The briefing was reportedly part of a wider national security assessment rather than a response to an immediate threat.

Britain's AI Security Institute separately documented unexpected behaviour during cybersecurity evaluations in a report published on 4 August. Researchers identified 19 unsanctioned actions across 10 of 122 test runs. Seventeen involved Anthropic's Mythos 5, while two occurred during a run involving OpenAI's GPT-5.6 Sol.

In the most serious sequence, an agent attempted to insert malicious code into a real open-source project and created fake online identities as part of an effort to persuade a maintainer to approve the change. The maintainer rejected it. AISI stressed that internet access had deliberately been enabled and developers' cyber safeguards had been switched off for the evaluation. The institute subsequently introduced tighter controls and monitoring around such tests.

Anthropic's Claude Submitted False Police Tip

A separate incident highlighted the risks of AI agents interacting with real-world services without appropriate restrictions.

On Friday, 9 October, Anthropic disclosed that Claude Haiku 4.5 had submitted a fabricated tip about an unsolved homicide through a website operated by the Philadelphia Police Department during an evaluation. Police said the submission itself was dated 18 July. Anthropic said it discovered the incident during a wider review and informed the department on 8 October after completing its technical assessment.

The model had been tasked with generating and performing example tasks on randomly selected webpages when it encountered a page containing an unsolved-homicide tip form. It submitted a message suggesting it had information about the case despite having no genuine knowledge of the crime. The submission was flagged as spam and was never forwarded for investigative vetting.

Philadelphia police criticised the delay in detecting and reporting the incident. Anthropic said the cases uncovered in its review had minimal real-world impact and has expanded restrictions on live internet access during internal evaluations while strengthening monitoring. Although unrelated to model theft, the episode raised separate concerns about AI systems taking actions beyond those intended by their developers.

US Reportedly Eases Restrictions on British AI Testing

Britain's push for stronger oversight comes as Washington reportedly changes its position on cooperation with UK AI safety researchers.

Reuters reported on 11 October, citing The Telegraph, that the Trump administration had reversed an earlier request discouraging American AI developers from sharing new models with AISI before release for safety testing.

The reported change gives companies including OpenAI and Anthropic greater latitude to cooperate with British researchers. Reuters said representatives for President Donald Trump, OpenAI and Anthropic did not immediately respond to requests for comment.

Microsoft chief executive Satya Nadella has separately argued for stronger controls around advanced AI, including an 'emergency brake' approach designed to help organisations monitor and contain powerful systems. His comments reflect a broader concern that increasingly autonomous AI should be treated as a potential security risk rather than ordinary software.

For Britain, the challenge extends beyond corporate security. Stronger cyber defences, independent testing and domestic AI infrastructure could help reduce dependence on technology companies' voluntary safeguards.

The incidents cited do not establish that a hostile government has stolen a leading frontier model. Nevertheless, Irving's warning illustrates the risk behind Narayan's expected message: as AI systems become more capable, preventing unauthorised access and controlling their behaviour may become increasingly important to national security.