How well do network models predict observations? On the importance of predictability in network models

Behav Res Methods. 2018 Apr;50(2):853-861. doi: 10.3758/s13428-017-0910-x.

Abstract

Network models are an increasingly popular way to abstract complex psychological phenomena. While studying the structure of network models has led to many important insights, little attention has been paid to how well they predict observations. This is despite the fact that predictability is crucial for judging the practical relevance of edges: for instance in clinical practice, predictability of a symptom indicates whether an intervention on that symptom through the symptom network is promising. We close this methodological gap by introducing nodewise predictability, which quantifies how well a given node can be predicted by all other nodes it is connected to in the network. In addition, we provide fully reproducible code examples of how to compute and visualize nodewise predictability both for cross-sectional and time series data.

Keywords: Clinical relevance; Network analysis; Network models; Predictability.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Humans
  • Models, Theoretical*
  • Predictive Value of Tests
  • Psychology / methods*