Facial expressions elicit multiplexed perceptions of emotion categories and dimensions

Abstract

Human facial expressions are complex, multi-component signals that can communicate rich information about emotions,^1-5 including specific categories, such as "anger," and broader dimensions, such as "negative valence, high arousal."^6-8 An enduring question is how this complex signaling is achieved. Communication theory predicts that multi-component signals could transmit each type of emotion information-i.e., specific categories and broader dimensions-via the same or different facial signal components, with implications for elucidating the system and ontology of facial expression communication.⁹ We addressed this question using a communication-systems-based method that agnostically generates facial expressions and uses the receiver's perceptions to model the specific facial signal components that represent emotion category and dimensional information to them.^10-12 First, we derived the facial expressions that elicit the perception of emotion categories (i.e., the six classic emotions¹³ plus 19 complex emotions³) and dimensions (i.e., valence and arousal) separately, in 60 individual participants. Comparison of these facial signals showed that they share subsets of components, suggesting that specific latent signals jointly represent-i.e., multiplex-categorical and dimensional information. Further examination revealed these specific latent signals and the joint information they represent. Our results-based on white Western participants, same-ethnicity face stimuli, and commonly used English emotion terms-show that facial expressions can jointly represent specific emotion categories and broad dimensions to perceivers via multiplexed facial signal components. Our results provide insights into the ontology and system of facial expression communication and a new information-theoretic framework that can characterize its complexities.

Keywords: affective dimensions; communication; data-driven methods; emotion categories; facial expressions; information theory; perception; reverse correlation.