This website uses cookies to ensure you get the best experience.
Learn more.
A fine-tuning run exceeds GPU memory limits. Which two changes can reduce training memory requirements while keeping adaptation feasible? Select 2 answers.
Published
- Increase the number of optimizer states per trainable parameter.
- Keep every intermediate tensor permanently for debugging.
- Reduce the per-device microbatch size.
- Double the sequence length for every example.
- Use a parameter-efficient adapter method supported by the model.
Comments — 0
Sign in to comment