This website uses cookies to ensure you get the best experience.
Learn more.
A summarization team measures ROUGE against reference summaries. A candidate receives a high score, but a reviewer finds an incorrect claim. Which conclusion is most appropriate?
Published
- A high ROUGE score guarantees every statement in the summary is supported by the source.
- Text-overlap metrics can be useful signals but do not by themselves prove factual correctness; grounded or human quality checks are still needed.
- Replacing ROUGE with a single token-count total guarantees that factual errors will disappear.
- ROUGE measures only network latency, so it cannot say anything about generated text.
Comments — 0
Sign in to comment