Hyperparameter experiments are expensive and the team has a fixed compute budget. Which design should be evaluated?

1. Judge candidates only by their names
2. Search every possible value with no bound
3. An appropriate search space, trial limits, and supported early termination
4. Choose parameters from the final test labels during deployment