As companies scale their use of agents on Amazon Bedrock, managing hundreds of agents in production becomes a challenge. The key question shifts from building agents to deciding which to keep and which to retire. Dataiku has introduced Agent Management to address this need, transforming signals from Amazon Bedrock AgentCore into a centralized inventory, audit trail, and enforceable controls.
Traditional observability tools focus on infrastructure health, such as uptime and latency, but they fall short in tracking agent decisions and accountability. Dataiku's Agent Management fills this gap by providing a control layer that monitors agents without hosting them, ensuring data stays within the customer's AWS account. It leverages existing telemetry from Amazon CloudWatch and AgentCore to offer a comprehensive view of agent activity and performance.
The solution integrates seamlessly with Amazon Bedrock AgentCore, which already provides session-level metrics, traces, and evaluations. Agent Management enhances this by adding cost oversight, ROI tracking, risk certification, and recurring testing. It supports both self-hosted and software-as-a-service (SaaS) deployment models, ensuring flexibility and security through AWS IAM roles and encryption.
For example, a retail bank using dozens of agents across teams can regain control with a unified view of its agent estate. Industry data shows that 83% of CIOs lack standardized agent lifecycle management, highlighting the need for tools like Agent Management. By reconstructing agent sessions and providing trace-level visibility, the solution enables faster oversight, wider visibility, and earlier detection of issues.