Two models have similar average quality, but one performs poorly on an important low-volume customer cohort. Which selection process is appropriate?

1. Ignore the cohort because it contributes few examples to the average.
2. Evaluate meaningful cohort slices and enforce the relevant acceptance criteria before selection.
3. Choose only by the model artifact size.
4. Remove the cohort from the final test set after seeing poor results.