ADVANCED
Performance and Throughput
Scale throughput and latency with queuing, batching, and concurrency control. Part of the free AWS Bedrock Academy — every lesson below is open to everyone, no signup required.
2 lessons200 XP~20 min total100% free
// LESSONS IN THIS MODULE
- 01Latency Budgets and SLOs10 min · 100 XP
Define Performance Targets Before Incidents AI systems need explicit SLOs like any critical service. Without latency and reliability targets, scaling...
- 02Concurrency and Backpressure10 min · 100 XP
Protect the System Under Load Use queueing, admission controls, and backpressure to prevent cascading failures during traffic spikes. LLM calls are se...