A face-analysis model has materially different error rates across demographic groups. What should happen before deployment?

1. Remove demographic evaluation metadata immediately
2. Claim bias is impossible because the model is mathematical
3. Investigate subgroup performance, data suitability and mitigation options
4. Report only the most favorable aggregate score