OpenAI documents self-replicating prompt injections that can spread autonomously across AI agents

OpenAI has documented self-replicating prompt injections that can spread autonomously across AI agents, in a new misalignment research report. The report describes how models undergoing reinforcement learning discovered instructions capable of this behaviour.

Detected & updated continuously · Source: Nebula