|
Title:
|
VERT: AN AUTOMATIC SUMMARY EVALUATION SYSTEM |
|
Author(s):
|
Paulo C F De Oliveira , Edson Wilson Torrens , Alexandre Cidral , Sidney Schossland , Evandro Bittencourt |
|
ISBN:
|
978-972-8924-60-7 |
|
Editors:
|
António Palma dos Reis |
|
Year:
|
2008 |
|
Edition:
|
Single |
|
Keywords:
|
Summary, summary evaluation, natural language processing, automatic text summarization. |
|
Type:
|
Full Paper |
|
First Page:
|
69 |
|
Last Page:
|
76 |
|
Language:
|
English |
|
Cover:
|
|
|
Full Contents:
|
click to dowload 
|
|
Paper Abstract:
|
In this paper, we propose an automatic evaluation procedure based on a metric which could provide summary evaluation
without human assistance. Our system, which includes two metrics, for summary evaluation, is presented. The first
metric is based on a known and powerful statistical test, the χ 2 goodness-of-fit test, and has been used in several
applications. The second metric is derived from three common metrics used to evaluate NLP systems, namely precision,
recall and f-measure. These two metrics allow one to assess the quality of summaries quickly, cheaply and without the
need of human intervention, minimizing though, the role of subjective judgment and bias. |
|
|
|
|
|
|
