|
Title:
|
AN APPROACH FOR EVALUATING EMOTION TAGGED CORPUS |
|
Author(s):
|
Kazuyuki Matsumoto , Junko Minato , Seiji Tsuchiya , Fuji Ren |
|
ISBN:
|
978-972-8924-59-1 |
|
Editors:
|
Katherine Blashki |
|
Year:
|
2008 |
|
Edition:
|
Single |
|
Keywords:
|
Emotion Tagged Corpus, Emotion Recognition, Corpus Evaluation |
|
Type:
|
Short Paper |
|
First Page:
|
258 |
|
Last Page:
|
263 |
|
Language:
|
English |
|
Cover:
|
|
|
Full Contents:
|
click to dowload 
|
|
Paper Abstract:
|
This paper proposes a method for evaluating our emotion corpus and describes the result of evaluation. The emotion
corpus was originally created in Japanese and English to be used for emotion recognition research and consisted of
dialogue sentences including emotional expressions. To ensure the reliability and use the corpus as the standard of
emotion evaluation, the objective evaluation is necessary because single person annotated tags on the corpus. For
Japanese part of corpus evaluation, we conducted a questionnaire to the several examinees. The examinees were asked to
tag arbitrarily emotion categories on the sentences in the corpus. The obtained sentence emotion tags were classified then
the match rate of the initial tag and the tags annotated by the examinees. Reliability of each emotion tag annotated on the
sentence was calculated and added as emotional weight on each sentence emotion tag. The 10-fold cross validation test
was conducted using the weight added corpus to estimate sentence emotion and obtained recall of 0.62 on average. |
|
|
|
|
|
|
