This website uses cookies to ensure you get the best experience.
Learn more.
A workload can use several models with different cost and latency. Which selection process is appropriate?
Published
- Evaluate representative tasks against quality, safety, latency, and operating cost targets
- Pick whichever model is alphabetically first
- Judge only a single ideal sample response
- Always choose the largest model regardless of evaluation
Comments — 0
Sign in to comment