Google Cracks Down on Rogue Agents with Advanced Security System
Google has developed an advanced security system called Agent Anomaly Detection to monitor and prevent misuse of its autonomous agents. This new feature is a part of the Gemini Enterprise Agent Platform and is built with the Agent Development Kit (ADK) for Python 1.2 or later.
Agent Anomaly Detection evaluates traces emitted by agents to determine whether they are operating outside their intended boundaries. It flags behavioral anomalies, suspicious intent, and policy violations, including tool misuse, identity and privilege abuse, agentic cascading failures, and rogue agents.
The system also detects operational risks such as resource exhaustion and escalating token usage. Google is actively working on the ability for users to define what anomalies mean in the context of their business, allowing them to write flexible anomaly detectors in natural language together with deterministic rules.