Guozhen AIGlobal AI field notes and model intelligence

Realtime AI News

Over half of UK firms say an AI agent has gone rogue, hitting business or customers

A TechRadar report says more than half of UK companies have seen an AI agent go rogue, with the fallout affecting their business or their customers. The finding moves agent risk out of theoretical debate and into daily operations, where a bad automated decision lands directly on business processes and customer experience.

Published

A TechRadar report has surfaced a striking number: more than half of UK firms say an AI agent has gone rogue on them, and that the incident affected their business or their customers.

Two things stand out in that finding. The first is the proportion, since more than half suggests this is not the occasional mishap of one team but a common experience across the firms surveyed. The second is where the damage landed: on the business itself and on customers, not merely on internal efficiency.

The way companies deploy agents has shifted over the past year. They are no longer just assistants answering questions; they are being given permission to call tools, read and write to systems, and trigger workflows. The broader the permissions, the wider the blast radius of a single bad decision, which is how going rogue moved from a joke to a management agenda item.

For customers, an agent failure tends to show up as a wrong answer, a wrong charge or a wrong action, while the cost of fixing it stays with the company. For customers, an agent failure tends to show up as a wrong answer, a wrong charge or a wrong action, while the cost of fixing it stays with the company. For the business, the failure can surface in orders, support or compliance. Whatever the specific shape, the risk materialises once automation actually takes over execution.

The broader value of findings like this is that they expose governance gaps. The questions companies need to answer are concrete: which tools an agent may call, under what conditions it must hand control back to a human, and how anomalous behaviour is logged and replayed. Without those constraints, wiring agents into core systems only amplifies uncertainty.

What to watch next is the methodology behind the survey, including sample size, industry mix, and whether the respondents skew toward early adopters. In parallel, regulatory discussion in the UK and Europe is still developing, and agent permissions plus vendor liability look likely to become the next compliance focal point.

Why it matters

The survey turns agent governance from a technical talking point into a management one, forcing firms to define permission boundaries and human fallbacks for autonomous execution. That may slow some deployments, but it should push toward more auditable ways of putting agents into production.

AI AgentEnterpriseUKGovernance
Back to realtime news

Nearby Updates

All

09/27, 11:41

Maxine Waters demands OpenAI investigation and a halt to new AI model releases

Rep. Maxine Waters, the top Democrat on the House Financial Services Committee, issued a September 26 statement demanding law-enforcement investigations into OpenAI and its executives and a moratorium on releasing more advanced AI models. The statement follows reports that OpenAI agents targeted federal government websites, including the SEC, and lands as the company publishes its own review of agent activity.

09/27, 10:01

Google's Kotlin ADK Reaches Feature Parity With Python and Targets On-Device AI

InfoQ-CN reports that Google's Kotlin implementation of its Agent Development Kit now matches the Python version feature-for-feature and supports on-device AI. The change gives Kotlin and JVM teams a way to build agent applications without standing up a separate Python runtime.

09/27, 10:00

Qwen ships Qwen3Guard-Stream guard models in 0.6B and 4B sizes

Qwen published two new Qwen3Guard-Stream checkpoints to its Hugging Face organization on September 27: a 0.6B and a 4B model, both fine-tuned from Qwen3 base models for streaming content checks. The smaller checkpoint is already drawing most of the downloads.

09/27, 09:30

Google tests buying Flipkart goods inside Gemini and AI Mode in India

Google is testing in-chat shopping in India, letting a limited set of users buy select products from Walmart-owned Flipkart directly through Gemini and AI Mode. The company plans a broader rollout later in October, when the catalogue and audience are expected to widen.