This website uses cookies to ensure you get the best experience.
Learn more.
A small model has intermittent traffic and can tolerate startup latency. The team wants to avoid managing a continuously running instance fleet. Which option should be evaluated if its constraints fit?
Published
- A batch-only job while promising synchronous submillisecond startup.
- A training cluster kept running as an undocumented HTTP server.
- SageMaker Serverless Inference.
- The largest dedicated endpoint permanently, regardless of utilization.
Comments — 0
Sign in to comment