An endpoint returns errors after clients send a new unsupported feature shape. What should be implemented?

Published
  1. Mark every failed request as a successful prediction.
  2. Validate the input contract and return clear safe errors for incompatible data.
  3. Increase endpoint replicas as the only response.
  4. Silently reorder and drop arbitrary features until the tensor fits.

Comments — 0