This website uses cookies to ensure you get the best experience.
Learn more.
A developer tunes a prompt repeatedly against one benchmark and then reports that same benchmark as final quality. What should be added?
Published
- Only a longer system prompt.
- A separately held-out representative evaluation set not used for prompt selection.
- Only the best response from several repeated attempts.
- More tuning against the same examples while calling them unseen.
Comments — 0
Sign in to comment