Flexible Model Interaction

The application waits for the model response.

Client
 ↓
API
 ↓
FM
 ↓
Response
 ↓
Client

Good when the response is expected quickly.

The application submits work and processes it later.

Client
 ↓
API
 ↓
Queue
 ↓
Worker
 ↓
FM
 ↓
Result

Amazon SQS can support asynchronous processing.

Applications can interact with foundation models through Amazon Bedrock APIs.

The AWS SDK can be used from different programming languages.

Conceptually:

Application
 ↓
AWS SDK
 ↓
Bedrock API
 ↓
Foundation Model

API Gateway can validate incoming requests before they reach the backend.

Client
 ↓
API Gateway
 ↓
Validate
 ├── Invalid → Reject
 └── Valid
       ↓
     Backend

This prevents malformed requests from unnecessarily reaching model infrastructure.