This website uses cookies to ensure you get the best experience.
Learn more.
A large model performs a narrow task well but has unacceptable serving cost. The team considers training a smaller supported model using outputs or other teaching signals from the larger model. What is this technique called?
Published
- Token truncation.
- Prompt caching.
- Model distillation.
- Retrieval Augmented Generation.
Comments — 0
Sign in to comment