A Python application embeds every document separately on each request even though documents rarely change. Which improvement avoids repeated work?

Published
  1. Replace all document embeddings with the same constant vector.
  2. Remove the query text from the retrieval request.
  3. Precompute document embeddings and update affected entries when content changes.
  4. Create a new full index for every generated token.

Comments — 0