This website uses cookies to ensure you get the best experience.
Learn more.
Model evaluation shows a smaller model meets quality and latency goals at lower cost for a classification task. What is the strongest deployment choice?
Published
- Choose the largest model regardless of measured requirements
- Change model IDs randomly per request
- Ignore the measured quality results and compare names only
- Use the measured smaller model with regression evaluation and monitored rollout
Comments — 0
Sign in to comment