2.2.1 · Lesson 8 of 25
Deploy Based on Application Requirements
Different workloads need different deployment approaches.
Overview
Different workloads need different deployment approaches.
Lambda
Lambda is useful for on-demand execution.
Request ↓ Lambda ↓ FM/API ↓ Response
Useful when:
- execution is event-driven
- workload is intermittent
- server management should be minimized
Bedrock Provisioned Throughput
Provisioned throughput can be considered when predictable capacity/performance is important.
Conceptually:
Application
↓
Amazon Bedrock
↓
Provisioned Capacity
↓
FMThink:
predictable workload → predictable model capacity requirement.
SageMaker AI Endpoints
SageMaker AI endpoints can be used when deploying models with greater control over the serving environment.
Application
↓
SageMaker Endpoint
↓
ModelUseful when deployment requires more control over model serving.
High-Yield Comparison
| Option | Think about |
|---|---|
| Lambda | On-demand/serverless execution |
| Bedrock | Managed FM access |
| Bedrock Provisioned Throughput | Predictable model capacity |
| SageMaker AI endpoint | More control over model deployment/serving |
Key points
- execution is event-driven
- workload is intermittent
- server management should be minimized
- Lambda
- Bedrock Provisioned Throughput
- SageMaker AI Endpoints
Exam focus
Know when and how to apply Deploy Based on Application Requirements in production GenAI implementations.