This website uses cookies to ensure you get the best experience.
Learn more.
A RAG corpus contains duplicate copies of the same policy in several folders. The top results repeat those passages and crowd out complementary evidence. Which ingestion improvement is best?
Published
- Use a larger output limit as the only ingestion correction.
- Increase every duplicate similarity score.
- Deduplicate by stable document identity or content and preserve useful provenance metadata.
- Remove all document identifiers and ingest every copy as new content.
Comments — 0
Sign in to comment