Evaluating the validity of computerized content analysis programs for identification of emotional expression in cancer narratives

Psychol Assess. 2009 Mar;21(1):79-88. doi: 10.1037/a0014643.

Abstract

Psychological interventions provide linguistic data that are particularly useful for testing mechanisms of action and improving intervention methodologies. For this study, emotional expression in an Internet-based intervention for women with breast cancer (n = 63) was analyzed via rater coding and 2 computerized coding methods (Linguistic Inquiry and Word Count [LIWC] and Psychiatric Content Analysis and Diagnosis [PCAD]). Although the computerized coding methods captured most of the emotion identified by raters (LIWC sensitivity = .88; PCAD sensitivity = .83), both over-identified emotional expression (LIWC positive predictive value = .31; PCAD positive predictive value = .19). Correlational analyses suggested better convergent and discriminant validity for LIWC. The results highlight previously unrecognized deficiencies in commonly used computerized content-analysis programs and suggest potential modifications to both programs that could improve overall accuracy of automated identification of emotional expression. Although the authors recognize these limitations, they conclude that LIWC is superior to PCAD for rapid identification of emotional expression in text. (PsycINFO Database Record (c) 2009 APA, all rights reserved).

Publication types

  • Randomized Controlled Trial

MeSH terms

  • Adaptation, Psychological
  • Anxiety / diagnosis
  • Anxiety / etiology
  • Anxiety / therapy
  • Breast Neoplasms / complications
  • Breast Neoplasms / psychology*
  • Depression / diagnosis
  • Depression / etiology
  • Depression / therapy
  • Discriminant Analysis
  • Electronic Data Processing / methods*
  • Electronic Data Processing / statistics & numerical data
  • Expressed Emotion*
  • Female
  • Humans
  • Middle Aged
  • Psychiatric Status Rating Scales / statistics & numerical data
  • Psycholinguistics / statistics & numerical data
  • Quality of Life
  • Reproducibility of Results
  • Self Disclosure
  • Sensitivity and Specificity
  • Signal Detection, Psychological
  • Social Support
  • Stress, Psychological / diagnosis
  • Stress, Psychological / etiology
  • Stress, Psychological / therapy