Objective: Diagnoses play an important role in treatment planning and monitoring, but extensive research has shown low agreement between clinician-generated diagnoses and those from structured diagnostic interviews. However, most prior studies of agreement have not used research diagnoses based on gold standard methods, and researchers need to identify characteristics of diagnostically challenging clients. This study examined agreement between youth diagnoses generated through the research-based LEAD (Longitudinal, Expert, and All Data) standard to clinician diagnoses.
Method: Participants were 391 families seeking outpatient community mental health services for youths ages 6-18 (39.1% female, 88.2% African American). Youths and parents completed research interviews and clinic diagnoses were extracted from clinic records. LEAD diagnoses synthesized results of the Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime (KSADS-PL) and the youth's developmental, family, and psychiatric history.
Results: Agreement between the LEAD and chart diagnoses was low, not exceeding "poor" agreement for most diagnostic categories (κs = .10-.46, median = .37). Disagreement was largely driven by missed diagnoses, although clinicians also did assign extra diagnoses for some clients. Fewer diagnostic errors occurred when the youth's clinical picture was more clear (e.g., high or low symptom severity, lower comorbidity), when the youth was older, when the family was higher functioning, and when the parent had more depression. However, youth and family characteristics explained very little of the variability in diagnostic errors.
Conclusions: RESULTS support the need to investigate strategies to improve clinician diagnostic accuracy.