A training run produces unstable loss after the learning rate is increased substantially. What should the engineer test first?

Published
  1. A suitable smaller learning rate and validated optimization settings.
  2. A much larger learning rate without observing gradients or validation.
  3. A longer object retention period as the only optimizer fix.
  4. A different endpoint DNS name.

Comments — 0