A study on production mechanism and modeling of emotional speech

In this study, we investigated production mechanism of emotional speech and its modeling based on articulatory movements, neurological activities and behavioral observations. Articulation analysis showed that the position of the tongue dorsum moves lower and backward for sad speech, while the dorsum moves forward for happiness. We used eye movement and EEG to observe the brain activations in the full time scale during continuously oral reading. Analysis of the brain networks reconstructed based on EEG showed that the speech planning network acts for each word, and the semantic processing network is more active in the first half of reading, while the grammar processing network becomes more active in the second half. This suggests that the semantic processing gets easier since the context information becomes rich in the second half of the continuous reading.