Strong claims and weak evidence: reassessing the predictive validity of the IAT

J Appl Psychol. 2009 May;94(3):567-82; discussion 583-603. doi: 10.1037/a0014665.

Abstract

The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.

Publication types

  • Comment

MeSH terms

  • Adult
  • African Continental Ancestry Group / psychology*
  • Bias
  • European Continental Ancestry Group / psychology*
  • Female
  • Humans
  • Interpersonal Relations
  • Job Application
  • Judgment
  • Male
  • Nonverbal Communication
  • Observer Variation
  • Prejudice*
  • Psychometrics / statistics & numerical data
  • Race Relations*
  • Reproducibility of Results
  • Unconscious, Psychology*
  • Word Association Tests / statistics & numerical data*