A team adds a long system-prompt section intended to improve tool selection. Evaluation shows no tool-selection gain and higher latency. What should it do?

Published
  1. Keep the section permanently because every added instruction must improve quality.
  2. Change the evaluation questions until the longer prompt wins.
  3. Add the same section to every retrieved document as well.
  4. Ablate or shorten that section and compare against the same evaluation cases.

Comments — 0