An application requires a prediction in the user's request path within a bounded latency target. Which approach best fits?

Published
  1. Use an appropriately provisioned online prediction endpoint.
  2. Configure suitable autoscaling and validate peak-load behavior.
  3. Load and reuse model state appropriately within the serving runtime.
  4. Use supported batch prediction.

Comments — 0