Rating scales are useful for evidence-based assessment of youth psychopathology. However, it is not known whether these scales contribute information beyond that which clinicians gather without them. This study examined agreement between chart diagnoses and the Child Behavior Checklist (CBCL) for 82 community mental health clinic clients. Agreement was low, suggesting that the CBCL was not redundant with clinicians' clinical impressions. These findings suggest that use of an instrument like the CBCL could potentially improve clinician diagnostic accuracy; future research should examine how best to utilize these scales in the diagnostic process and how to train clinicians in their use.