This website uses cookies to ensure you get the best experience.
Learn more.
An online endpoint handles variable demand and should add capacity based on supported serving metrics. Which approach best fits?
Published
- Configure suitable autoscaling and validate peak-load behavior.
- Use an appropriately provisioned online prediction endpoint.
- Load and reuse model state appropriately within the serving runtime.
- Use supported batch prediction.
Comments — 0
Sign in to comment