3.3.4 · Lesson 12 of 15
Continuous Monitoring & Drift Detection
Monitor live model deployments for bias drift, prompt injection spikes, and guardrail violations with automated alerts.
WHAT
Monitor live model deployments for bias drift, prompt injection spikes, and guardrail violations.
HOW
- Set up Amazon SageMaker Clarify continuous monitoring for bias drift on endpoints.
- Configure CloudWatch Alarms on Bedrock Guardrail metrics (e.g.,
InvocationsIntervened). - Use metric filters on invocation logs and Amazon SNS for automated alerts.
Guardrail INTERVENED events
↓
CloudWatch Metric Filter / Alarm
↓
SNS → Security / ComplianceEXAM TRAP
A weekly Glue ETL to QuickSight for human review is not continuous automated monitoring.
Key points
- SageMaker Clarify continuous monitoring
- CloudWatch alarms on Guardrail metrics
- InvocationsIntervened
- SNS automated alerts
- Metric filters on invocation logs
Exam focus
Combine Clarify for bias drift with CloudWatch alarms/SNS on Guardrail interventions — weekly manual dashboard reviews are not continuous monitoring.