1.6.4 · Lesson 26 of 28
Prompt quality assurance
Test prompts systematically before and after deployment.
WHAT
Test prompts systematically before and after deployment.
QA dimensions
- correctness
- consistency
- safety
- formatting
- regression
- edge cases
Architecture
Prompt Version
↓
Test Dataset
↓
Invocation
↓
Output Validation
↓
Metrics
↓
Pass / FailAWS
- AWS Lambda
- AWS Step Functions
- Amazon CloudWatch
- Amazon Bedrock
Regression testing
When prompt version B replaces A:
Test Dataset ↓ Prompt A ↓ Prompt B ↓ Compare
EXAM TRAP
A prompt that works for one example is not necessarily production-ready.
---
Key points
- Test prompts systematically before and after deployment.
Exam focus
A prompt that works for one example is not necessarily production-ready.