An application handles bursts poorly because scaling follows average CPU, while the actual bottleneck is queued work per worker. What is the best improvement?

Published
  1. Scale only when the monthly bill increases.
  2. Set the maximum capacity to one to avoid scaling fluctuations.
  3. Scale on an appropriate backlog-per-instance metric tied to processing latency.
  4. Increase the queue retention period as the only latency fix.

Comments — 0