Evaluating Content Selection in Summarization: The Pyramid Method release_bfy66trlvnclhibre6tn2vwtj4

by Ani Nenkova, Rebecca Passonneau

Published by Columbia University.

2017  

Abstract

We present an empirically grounded method for evaluating content selection in summarization. It incorporates the idea that no single best model summary for a collection of documents exists. Our method quantifies the relative importance of facts to be conveyed. We argue that it is reliable, predictive and diagnostic, thus improves considerably over the shortcomings of the human evaluation method currently used in the Document Understanding Conference.
In text/plain format

Archived Files and Locations

application/pdf  128.5 kB
file_eiypt5ydqzgzlle6oor72hwnym
academiccommons.columbia.edu (web)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2017-06-19
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 4ba1e90e-a444-43b4-9e76-66a1ea09edbe
API URL: JSON