This website uses cookies to ensure you get the best experience.
Learn more.
A model produces correct short answers but is prompted to explain every simple extraction in several paragraphs. Cost and completion latency are excessive. Which change should be tested first?
Published
- Use a concise task-specific response contract and appropriate output token limits.
- Increase the maximum output tokens for every request.
- Remove the required extraction fields from the answer.
- Use only a longer client timeout.
Comments — 0
Sign in to comment