Bias and asymmetric loss in expert forecasts: a study of physician prognostic behavior with respect to patient survival

J Health Econ. 2008 Jul;27(4):1095-1108. doi: 10.1016/j.jhealeco.2008.02.011. Epub 2008 Mar 18.

Abstract

We study the behavioral processes undergirding physician forecasts, evaluating accuracy and systematic biases in estimates of patient survival and characterizing physicians' loss functions when it comes to prediction. Similar to other forecasting experts, physicians face different costs depending on whether their best forecasts prove to be an overestimate or an underestimate of the true probabilities of an event. We provide the first empirical characterization of physicians loss functions. We find that even the physicians subjective belief distributions over outcomes are not well calibrated, with the loss characterized by asymmetry in favor of over-predicting patients' survival. We show that the physicians' bias is further increased by (1) reduction of the belief distributions to point forecasts, (2) communication of the forecast to the patient, and (3) physicians own past experience and reputation.

MeSH terms

  • Aged
  • Aged, 80 and over
  • Behavior*
  • Bias*
  • Chicago
  • Cohort Studies
  • Female
  • Humans
  • Male
  • Middle Aged
  • Models, Statistical
  • Physicians*
  • Prognosis
  • Prospective Studies
  • Reproducibility of Results
  • Survivors*