Nonverbal Synchrony in Technology-Mediated Interviews: A Cross-Cultural Study

Ken Fujiwara; Christopher D Otmar; Norah E Dunbar; Mohemmad Hansia

doi:10.1007/s10919-022-00416-3

Nonverbal Synchrony in Technology-Mediated Interviews: A Cross-Cultural Study

J Nonverbal Behav. 2022;46(4):547-567. doi: 10.1007/s10919-022-00416-3. Epub 2022 Sep 15.

Authors

Ken Fujiwara¹, Christopher D Otmar², Norah E Dunbar², Mohemmad Hansia²

Affiliations

¹ Department of Psychology, National Chung Cheng University, No.168, Sec. 1, University Rd., Minhsiung, 621301 Taiwan, ROC.
² Department of Communication, University of California, Santa Barbara, Santa Barbara, USA.

Abstract

Technology-mediated communication has changed the way we interact. Since the onset of the COVID-19 pandemic in March 2020, this trend became even more pronounced. Media interviews are no exception. Yet, studies on nonverbal behaviors, especially nonverbal synchrony during such mediated settings, have been scarce. To fill the research gap, this study investigated synchronized patterns between interview hosts' and guests' facial emotional displays and upper body movement during mediated interviews recorded in the countries in Western (mainly the US, with the addition of the UK) and Eastern cultures (Japan). The interviews were categorized into information- or entertainment-driven interviews, depending on the social attributes of the guest. The time series of the valence in facial displays and upper body movement was automatedly measured using FaceReader and Motion Energy Analysis software, respectively, which was analyzed in terms of simultaneous movements, a primary component of synchrony. As predicted, facial synchrony was more prevalent in information-driven interviews, supporting the motivational and strategic account of synchrony. In addition, female-hosted interviews had a higher degree of synchrony, especially in information-driven interviews. Similar patterns were seen in movement synchrony, although not significant. This study is the first evidence of synchrony in technology-mediated interviews in which a host and a guest appear on split-screen to inform or entertain audiences. However, no cultural differences in synchrony were observed. Situational demands in front of the interactants and the goal-driven nature of communication seemed to play a more prominent role than cultural differences in nonverbal synchrony.

Supplementary information: The online version contains supplementary material available at 10.1007/s10919-022-00416-3.

Keywords: Cross-Culture; Dynamic time warping; Facial expressions; Nonverbal synchrony; Technology-mediated interview; Thin slice.

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022, Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.