This website uses cookies to ensure you get the best experience.
Learn more.
A serving model is slow because it reloads large artifacts for every request. Which approach best fits?
Published
- Use an appropriately provisioned online prediction endpoint.
- Load and reuse model state appropriately within the serving runtime.
- Configure suitable autoscaling and validate peak-load behavior.
- Use supported batch prediction.
Comments — 0
Sign in to comment