A team changes the generator, embedding model, and chunking policy simultaneously and sees worse answers. What practice would make future regressions easier to diagnose?

1. Compare only one successful demonstration prompt.
2. Retain only the final average score and delete component versions.
3. Change every component again before collecting failure examples.
4. Version all pipeline components and evaluate controlled changes against a fixed held-out suite.