This website uses cookies to ensure you get the best experience.
Learn more.
A support-ticket dataset contains repeated conversations from the same customer. What split best measures generalization to customers the model has never seen?
Published
- Evaluate only on the messages used for training.
- Randomly distribute individual messages from each conversation across all splits.
- Choose the split with the highest test score after many attempts.
- Keep every conversation from a customer entirely within one split.
Comments — 0
Sign in to comment