Predicting self-harm within six months after initial presentation to youth mental health services: A machine learning study

PLoS One. 2020 Dec 31;15(12):e0243467. doi: 10.1371/journal.pone.0243467. eCollection 2020.

Abstract

Background: A priority for health services is to reduce self-harm in young people. Predicting self-harm is challenging due to their rarity and complexity, however this does not preclude the utility of prediction models to improve decision-making regarding a service response in terms of more detailed assessments and/or intervention. The aim of this study was to predict self-harm within six-months after initial presentation.

Method: The study included 1962 young people (12-30 years) presenting to youth mental health services in Australia. Six machine learning algorithms were trained and tested with ten repeats of ten-fold cross-validation. The net benefit of these models were evaluated using decision curve analysis.

Results: Out of 1962 young people, 320 (16%) engaged in self-harm in the six months after first assessment and 1642 (84%) did not. The top 25% of young people as ranked by mean predicted probability accounted for 51.6% - 56.2% of all who engaged in self-harm. By the top 50%, this increased to 82.1%-84.4%. Models demonstrated fair overall prediction (AUROCs; 0.744-0.755) and calibration which indicates that predicted probabilities were close to the true probabilities (brier scores; 0.185-0.196). The net benefit of these models were positive and superior to the 'treat everyone' strategy. The strongest predictors were (in ranked order); a history of self-harm, age, social and occupational functioning, sex, bipolar disorder, psychosis-like experiences, treatment with antipsychotics, and a history of suicide ideation.

Conclusion: Prediction models for self-harm may have utility to identify a large sub population who would benefit from further assessment and targeted (low intensity) interventions. Such models could enhance health service approaches to identify and reduce self-harm, a considerable source of distress, morbidity, ongoing health care utilisation and mortality.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Antipsychotic Agents / therapeutic use
  • Area Under Curve
  • Bipolar Disorder / drug therapy
  • Bipolar Disorder / psychology
  • Child
  • Female
  • Humans
  • Machine Learning*
  • Male
  • Mental Health Services*
  • Psychotic Disorders / drug therapy
  • Psychotic Disorders / psychology
  • ROC Curve
  • Self-Injurious Behavior / prevention & control*
  • Self-Injurious Behavior / psychology
  • Suicidal Ideation
  • Young Adult

Substances

  • Antipsychotic Agents

Grants and funding

This work was partially supported by grants from the National Health & Medical Research Council including: Centre of Research Excellence (No. 1171910), and Australia Fellowship (No. 511921 awarded to Prof Hickie). The funding sources of this study have had no input into the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.