This website uses cookies to ensure you get the best experience.
Learn more.
A supported model repeatedly receives the same long instruction prefix followed by a different user question. The provider offers prompt caching for qualifying prefixes. Which statement best describes the potential benefit?
Published
- It automatically removes all authorization requirements for the cached source content.
- It guarantees that every different user question receives a precomputed final answer.
- Eligible repeated prefix processing can be reused under the supported cache rules, potentially reducing input-processing cost or latency.
- It permanently fine-tunes the model weights with the cached instruction prefix.
Comments — 0
Sign in to comment