Title:
|
HOW DO WE PERCEIVE EMOTION
FROM A 3-D VIRTUAL TALKING HEAD: EVIDENCE
FROM FUNCTIONAL NEAR-INFRARED SPECTROSCOPY |
Author(s):
|
Jianying Wang, Jiangtao Chen, Nan Yan, Lan Wang and Lawrence Ng |
ISBN:
|
978-989-8533-91-3 |
Editors:
|
Katherine Blashki and Yingcai Xiao |
Year:
|
2019 |
Edition:
|
Single |
Keywords:
|
Human-Computer Interaction, Emotional Perception, Function Near-Infrared Spectroscopy, 3-D Virtual Talking Head,
Dorsolateral Prefrontal Cortex |
Type:
|
Full Paper |
First Page:
|
115 |
Last Page:
|
122 |
Language:
|
English |
Cover:
|
|
Full Contents:
|
click to dowload
|
Paper Abstract:
|
Emotional interaction plays an important role in human-computer interaction. Although more and more virtual heads are
endowed with a series of facial expressions under the conversational scenarios, the similarities and differences in neural
mechanism underlying emotional perception between virtual head and human are still largely unknown. In the present
study, we investigated the activation of emotional perception activities in the dorsolateral prefrontal cortex (DLPFC) region
associated with when humans when beings perceiving emotions from 3-D virtual talking heads by using functional
near-infrared spectroscopy (fNIRS). Three dynamic emotional stimuli were consisting of 3-D virtual talking head and
human face with mute mode or voice presented by twenty participants. The behavioral results showed that participants had
lower accuracy watching mute 3-D virtual talking head videos (3DMute) than watching human face videos with voice
(HFMute) especially for in anger and happiness stimuli except for neutral emotion. The fNIRS results observed that there
was no difference in DLPFC activity area for the observation of 3-D virtual talking head and human face. However, it was
found that a stronger DLPFC region had stronger activation was observed for 3-D virtual talking head videos with voice
(3DVoice) than 3DMute. In addition, the a stronger activation in DLPFC activation region for affectively angry emotion
was videos observed in females was demonstrated, but yet there was no gender difference was found in gender during
watching both types for happiness videos. The present results work provided preliminary evidence in physiology
mechanism in human-computer interaction. |
|
|
|
|