A semi-parametric within-subject mixture approach to the analyses of responses and response times

Br J Math Stat Psychol. 2018 May;71(2):205-228. doi: 10.1111/bmsp.12117. Epub 2017 Oct 17.

Abstract

In item response theory, modelling the item response times in addition to the item responses may improve the detection of possible between- and within-subject differences in the process that resulted in the responses. For instance, if respondents rely on rapid guessing on some items but not on all, the joint distribution of the responses and response times will be a multivariate within-subject mixture distribution. Suitable parametric methods to detect these within-subject differences have been proposed. In these approaches, a distribution needs to be assumed for the within-class response times. In this paper, it is demonstrated that these parametric within-subject approaches may produce false positives and biased parameter estimates if the assumption concerning the response time distribution is violated. A semi-parametric approach is proposed which resorts to categorized response times. This approach is shown to hardly produce false positives and parameter bias. In addition, the semi-parametric approach results in approximately the same power as the parametric approach.

Keywords: item response theory; mixture modelling; response times.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Bias
  • Computer Simulation
  • Data Interpretation, Statistical*
  • False Positive Reactions
  • Humans
  • Models, Psychological
  • Models, Statistical
  • Psychometrics / methods*
  • Reaction Time*