The Reading Everyday Emotion Database (REED): a set of audio-visual recordings of emotions in music and language

Ong, J. H. ORCID: https://orcid.org/0000-0003-1503-8311, Leung, F. Y. N. and Liu, F. ORCID: https://orcid.org/0000-0002-7776-0222 (2025) The Reading Everyday Emotion Database (REED): a set of audio-visual recordings of emotions in music and language. Language Resources and Evaluation, 59. pp. 27-49. ISSN 1574-020X doi: 10.1007/s10579-023-09698-5

Abstract/Summary

Most audio-visual (AV) emotion databases consist of clips that do not reflect real-life emotion processing (e.g., professional actors in bright studio-like environment), contain only spoken clips, and none have sung clips that express complex emotions. Here, we introduce a new AV database, the Reading Everyday Emotion Database (REED), which directly addresses those gaps. We recorded the faces of everyday adults with a diverse range of acting experience expressing 13 emotions—neutral, the six basic emotions (angry, disgusted, fearful, happy, sad, surprised), and six complex emotions (embarrassed, hopeful, jealous, proud, sarcastic, stressed)—in two auditory domains (spoken and sung) using everyday recording devices (e.g., laptops, mobile phones, etc.). The recordings were validated by an independent group of raters. We found that: intensity ratings of the recordings were positively associated with recognition accuracy; and the basic emotions, as well as the Neutral and Sarcastic emotions, were recognised more accurately than the other complex emotions. Emotion recognition accuracy also differed by utterance. Exploratory analysis revealed that recordings of those with drama experience were better recognised than those without. Overall, this database will benefit those who need AV clips with natural variations in both emotion expressions and recording environment.