Two prompts achieve similar correctness, but one returns twice as many tokens and often repeats source passages. What should the developer evaluate next?

Published
  1. Constrain unnecessary verbosity and compare quality, latency, and token cost on the same test set.
  2. Select the prompt based only on which contains more examples.
  3. Assume longer answers must always be more correct.
  4. Stop measuring correctness and optimize only output length.

Comments — 0