An online endpoint handles variable demand and should add capacity based on supported serving metrics. Which approach best fits?

Published
  1. Configure suitable autoscaling and validate peak-load behavior.
  2. Use an appropriately provisioned online prediction endpoint.
  3. Load and reuse model state appropriately within the serving runtime.
  4. Use supported batch prediction.

Comments — 0