A workload can use several models with different cost and latency. Which selection process is appropriate?

Published
  1. Evaluate representative tasks against quality, safety, latency, and operating cost targets
  2. Pick whichever model is alphabetically first
  3. Judge only a single ideal sample response
  4. Always choose the largest model regardless of evaluation

Comments — 0