Better Metrics to Automatically Predict the Quality of a Text Summary

Loading...
Thumbnail Image

Files

Publication or External Link

Date

2012-09-26

Advisor

Citation

Rankel, P.A.; Conroy, J.M.; Schlesinger, J.D. Better Metrics to Automatically Predict the Quality of a Text Summary. Algorithms 2012, 5, 398-420.

Abstract

In this paper we demonstrate a family of metrics for estimating the quality of a text summary relative to one or more human-generated summaries. The improved metrics are based on features automatically computed from the summaries to measure content and linguistic quality. The features are combined using one of three methods—robust regression, non-negative least squares, or canonical correlation, an eigenvalue method. The new metrics significantly outperform the previous standard for automatic text summarization evaluation, ROUGE.

Notes

Rights