Objective: To investigate the validity of using electronic medical records (EMR) database in a large health organization for identifying patients with clinical depression.
Method: The Massachusetts General Hospital EMR system was used to generate a sample of primary care patients seen in the primary care clinic in 2007. Using this sample, the validity of using certain fields in the EMR database (i.e., billing diagnosis, problem list, and medication list) to identify patients with clinical depression was compared to primary care physician (PCP) assessment by a written questionnaire. Based on this standard, the sensitivity, specificity, positive predictive value, negative predictive value, and the areas under receiver operating characteristic curve (AUC) of three specific EMR fields - individually and in combination - were calculated to identify which EMR field best predicted PCP classification.
Results: The EMR fields "billing diagnosis", "problem list" and antidepressant in "medication list", were all able to identify patients' diagnosis of depression by their PCPs reasonably well. Having one or more "billing diagnosis" of depression had the highest sensitivity and highest AUC (77% sensitivity, 76% specificity, AUC 0.77) among any of the fields used alone.
Conclusion: The AUC for "billing diagnosis" of depression performed the best of the three single fields tested, with an AUC of 0.77, corresponding to a test with moderate accuracy. This analysis demonstrates that specific EMR fields can be used as a proxy for PCP assessment of depression for this EMR system. Limitations to our analysis include the physician response rate to our survey as well as the quality of the data, which is collected primarily for administrative and clinical purposes. When using administrative and clinical data in mental health studies, researchers must first assess the accuracy of choosing specific fields within their EMR system in order to determine the level of accuracy for them to be used as proxies for clinical diagnoses.
Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.