Model evaluation shows a smaller model meets quality and latency goals at lower cost for a classification task. What is the strongest deployment choice?

Published
  1. Choose the largest model regardless of measured requirements
  2. Change model IDs randomly per request
  3. Ignore the measured quality results and compare names only
  4. Use the measured smaller model with regression evaluation and monitored rollout

Comments — 0