Troubleshooting FM Applications

Production AI applications require observability.

Three important tools/concepts in this outline:

CloudWatch
    +
X-Ray
    +
Amazon Q Developer

Useful for analyzing logs.

Example:

Request
 ↓
Lambda
 ↓
Bedrock
 ↓
Error
 ↓
CloudWatch Logs
 ↓
Logs Insights

You can investigate patterns such as:

• failures
• latency
• request behavior
• application errors
• model interaction logs

Use X-Ray to trace service interactions.

API Gateway
     ↓
Lambda
     ↓
Bedrock
     ↓
Other Service

X-Ray helps determine where the request spent time or failed.

Can assist with understanding and recognizing development/error patterns.

Conceptually:

Error / Logs
     ↓
Developer
     ↓
Q Developer
     ↓
Diagnosis / Suggested Fix