Detecting Differential Item Functioning Using Multiple-Group Cognitive Diagnosis Models

Appl Psychol Meas. 2021 Jan;45(1):37-53. doi: 10.1177/0146621620965745. Epub 2020 Oct 21.

Abstract

This study proposes a multiple-group cognitive diagnosis model to account for the fact that students in different groups may use distinct attributes or use the same attributes but in different manners (e.g., conjunctive, disjunctive, and compensatory) to solve problems. Based on the proposed model, this study systematically investigates the performance of the likelihood ratio (LR) test and Wald test in detecting differential item functioning (DIF). A forward anchor item search procedure was also proposed to identify a set of anchor items with invariant item parameters across groups. Results showed that the LR and Wald tests with the forward anchor item search algorithm produced better calibrated Type I error rates than the ordinary LR and Wald tests, especially when items were of low quality. A set of real data were also analyzed to illustrate the use of these DIF detection procedures.

Keywords: DIF; Wald test; cognitive diagnosis; differential item functioning; forward anchor item search; likelihood ratio.