This website uses cookies to ensure you get the best experience.
Learn more.
Which two resources typically grow during large-model training compared with serving a small fixed model? Select 2 answers.
Published
- A mandatory public address for every training worker
- An exclusive requirement for a separate physical GPU per output class
- Compute for backward propagation
- Memory for gradients and optimizer state
- A requirement to keep every training example in GPU memory simultaneously
Comments — 0
Sign in to comment