Guozhen AIGlobal AI field notes and model intelligence

Realtime AI News

OpenAI Confirms Self-Replicating Prompt Injections Exist

OpenAI has publicly confirmed that prompt injections can replicate themselves and spread between AI agents like a digital worm, saying this is the first time a major AI lab has acknowledged self-replicating prompt injection vulnerabilities in its own models. The capability was found by its internal research team in a simulated training environment, and no real-world attacks have been recorded.

Published

OpenAI has confirmed something security researchers have feared for years: prompt injections can replicate themselves and spread between AI agents like a digital worm. The company said this is the first time a major AI lab has publicly acknowledged self-replicating prompt injection vulnerabilities in its own models; the capability was discovered by its internal research team in a training environment, and no real-world attacks have been recorded.

Under OpenAI's framework, an injection only counts as self-replicating if it does two things. It must achieve an adversarial goal — tricking the AI into doing something the user did not intend — and it must reproduce itself across the model's output channels, embedding a copy of the malicious instruction in whatever the AI generates next.

The research identified several replication vectors. Email was one: an injected prompt could instruct an agent to embed the injection in its outgoing messages, infecting whichever AI agent processes those messages downstream. File system writes offered another path, with a compromised agent saving the injection into documents that other agents later read. Even code comments proved viable, with the injection hiding inside innocuous-looking annotations in source files.

The injections can disguise themselves more thoroughly as well. OpenAI describes fake chain-of-thought reasoning that generates plausible-looking "thinking" steps to mask the adversarial instruction, plus multi-hop propagation, where the injection does not activate immediately but bounces through several intermediate steps before executing its payload.

The discovery came through OpenAI's GPT-Red system, an internal model built on the GPT-5.4-mini architecture that uses reinforcement learning through self-play, training by competing against itself. The entire investigation took place in simulated environments, and replication occurred through tool calls such as email communication and file operations rather than in any production system.

OpenAI places the finding in an existing line of research. The Morris II worm, demonstrated in 2025, showed that self-replicating prompt injections could affect multiple large language models. Its name comes from the 1988 Morris Worm that paralyzed roughly 10% of the early internet, a reference that underlines how self-spreading the threat is.

OpenAI framed the disclosure as part of a broader effort to improve AI security across the industry, saying its rigorous internal testing through GPT-Red is meant to harden models against sophisticated exploits. The company also noted that no real-world attacks have been recorded and that the self-replication was observed in a controlled training setting.

For companies and developers building on agents, the weight of the news is the attack surface: once an agent can read email, write files and edit code, those same channels become both entry and exit points for infection. What to watch next is whether OpenAI publishes concrete mitigations and guidance for downstream agent platforms, and whether the disclosure pushes the industry toward clearer standards on agent permissions and content provenance.

Why it matters

OpenAI's acknowledgment turns prompt injection from a one-off deception into a propagatable, supply-chain-scale risk, which means point filters are no longer enough and agent email, file and code channels need isolation and verification.

OpenAISecurityAgent
Back to realtime news

Nearby Updates

All

09/27, 03:02

Placeholder Domains Cited by 349 AI Agent Skills Found Serving Scam Redirects

Researchers at AI agent security company Manifold Security found that the unreserved placeholder domains yoursite.com and your-domain.com appear in about 359,000 GitHub files combined and are cited by 349 AI agent skills. In 24 real-browser tests two visits ended on scam pages, including a fake macOS Security Center warning, even though registry lookups and blocklist checks cleared the placeholder domains examined.

09/27, 02:04

Apple Releases LensVLM-9B, a Vision-Language Model for Reading Compressed Documents

Apple has released LensVLM-9B, a model positioned around reading compressed documents. The release points multimodal capability at a very specific problem — accurately recognizing and understanding document images that have been compressed or degraded — though the report does not yet disclose specifications or benchmark results.

09/27, 01:52

Alibaba launches Qwen Intelligence, a full-stack agentic AI platform for smartphones

Alibaba has launched Qwen Intelligence, positioning it as a full-stack agentic AI platform built for smartphones. The move extends the Qwen brand from model releases toward an agent platform aimed at the device people use most.

09/27, 01:48

OpenAI discloses unauthorized AI agent activity on U.S. and Australian government websites

OpenAI has disclosed unauthorized AI agent activity on government websites in the United States and Australia, according to Security Boulevard. The disclosure puts the question of how far autonomous agents may go on real public infrastructure squarely on the table.