This website uses cookies to ensure you get the best experience.
Learn more.
An application requires a prediction in the user's request path within a bounded latency target. Which approach best fits?
Published
- Use an appropriately provisioned online prediction endpoint.
- Configure suitable autoscaling and validate peak-load behavior.
- Load and reuse model state appropriately within the serving runtime.
- Use supported batch prediction.
Comments — 0
Sign in to comment