A deployed model performs much worse for an important user subgroup than its aggregate score suggests. Which approach best fits?

Published
  1. Monitor feature distribution drift and investigate its impact.
  2. Monitor serving reliability separately from model-quality metrics.
  3. Evaluate and monitor relevant subgroup metrics.
  4. Monitor task-quality metrics using the delayed ground truth.

Comments — 0