This website uses cookies to ensure you get the best experience.
Learn more.
An assistant must answer questions about a large document collection that cannot fit in one model request. What is the most appropriate conceptual approach for supplying relevant information within the model context limit?
Published
- Fine-tune once and assume every future document will automatically be available to the model.
- Split the text into smaller font sizes before sending it as the same text prompt.
- Increase temperature until the same model accepts an unlimited number of tokens.
- Retrieve relevant passages and include a bounded amount of that material with the instructions and user question.
Comments — 0
Sign in to comment