Machine-learning-based identification of patients with IgA nephropathy using a computerized medical billing database

PLoS One. 2024 Dec 5;19(12):e0312915. doi: 10.1371/journal.pone.0312915. eCollection 2024.

Abstract

The billing database of the universal healthcare system in Japan potentially includes large-cohort data of patients with immunoglobulin A nephropathy, diagnosis codes aimed at billing should not be directly used for clinical research because of the risk of misdiagnosis. To solve this problem, we aimed to develop a novel method for identifying patients with immunoglobulin A nephropathy from billing data using machine learning. The medical records and bills of 3,743 patients who consulted nephrologists at a single center were extracted. Patients were labeled to have been diagnosed with immunoglobulin A nephropathy through a review of medical records. A manual analysis of the diagnostic accuracy and machine learning was performed. For machine learning, the datasets were preprocessed in three patterns and assigned to the XGBoost program using five-fold cross-validation. Of all the participants, 437 were labeled as having been diagnosed with immunoglobulin A nephropathy. Bill codes for immunoglobulin A nephropathy were provided to approximately half of them. The manually created criteria consisting of the recommended examinations and treatments in the Japanese guidelines for immunoglobulin A nephropathy showed both specificity and sensitivity < 0.8. In contrast, with the receiver operating characteristic curve analysis, the machine learning process yielded area under the curve values over 0.9 with preprocessing from the clinical viewpoint. Applying machine learning technology to a dataset preprocessed from a clinical viewpoint achieved a high performance in detecting patients with immunoglobulin A nephropathy. This methodology contributes to the construction of a disease-specific cohort using big bill data.

MeSH terms

  • Adult
  • Databases, Factual*
  • Female
  • Glomerulonephritis, IGA* / diagnosis
  • Humans
  • Japan / epidemiology
  • Machine Learning*
  • Male
  • Middle Aged
  • ROC Curve

Grants and funding

This study is supported by funds below. Japan Society for the Promotion of Science KAKENHI, JP19H04114 Japan Society for the Promotion of Science KAKENHI, JP21K08220 Japan Society for the Promotion of Science KAKENHI, JP19K19347 Japan Agency for Medical Research and Development, JP21zf0127005 Japan Science and Technology Agency -Mirai Program, JPMJMI19G8 programs for Progress of the next Cross-ministerial Strategic Innovation Promotion Program (SIP) on “Integrated Health Care System(C-1)”, Cabinet Office, Government of Japan, JPJ012425 The recipient of all funds is Kunihiro Yamagata, M.D.,Ph.D‥ The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.