Skip to content

AIP-C01 · Study Guide

← Domain 3: AI Safety, Security, and Governance

3.3.4 · Lesson 12 of 15

Continuous Monitoring & Drift Detection

Monitor live model deployments for bias drift, prompt injection spikes, and guardrail violations with automated alerts.

WHAT

Monitor live model deployments for bias drift, prompt injection spikes, and guardrail violations.

HOW

  • Set up Amazon SageMaker Clarify continuous monitoring for bias drift on endpoints.
  • Configure CloudWatch Alarms on Bedrock Guardrail metrics (e.g., InvocationsIntervened).
  • Use metric filters on invocation logs and Amazon SNS for automated alerts.
Guardrail INTERVENED events
        ↓
CloudWatch Metric Filter / Alarm
        ↓
SNS → Security / Compliance

EXAM TRAP

A weekly Glue ETL to QuickSight for human review is not continuous automated monitoring.

Key points

  • SageMaker Clarify continuous monitoring
  • CloudWatch alarms on Guardrail metrics
  • InvocationsIntervened
  • SNS automated alerts
  • Metric filters on invocation logs

Exam focus

Combine Clarify for bias drift with CloudWatch alarms/SNS on Guardrail interventions — weekly manual dashboard reviews are not continuous monitoring.

View progress