A RAG index embeds documents with one model but queries with an unrelated embedding model. Similarity results become unreliable. What should change?

Published
  1. Mix all embedding versions without recording their source model.
  2. Sort vectors by the source filename instead of similarity.
  3. Use compatible document and query embeddings and rebuild the index when the representation changes.
  4. Change only the generator output length.

Comments — 0