This website uses cookies to ensure you get the best experience.
Learn more.
Bedrock requests receive transient throttling during bursts. Which two changes most appropriately improve stability? Select 2 answers.
Published
- Double concurrent requests after every throttle.
- Suppress throttle metrics and declare all requests successful.
- Retry every AccessDenied response indefinitely with unchanged credentials.
- Control concurrency and review the applicable model request and token quotas.
- Use bounded backoff with jitter for retryable throttling responses.
Comments — 0
Sign in to comment