A chat application needs to retain useful conversation context but has a fixed token budget. What is the best state-management design?

Published
  1. Store only the last assistant sentence regardless of the user task.
  2. Use bounded recent history and validated summaries while retaining authoritative facts and required instructions.
  3. Mix histories from different users to increase contextual diversity.
  4. Append every conversation forever and ignore the model context limit.

Comments — 0