Validity and reliability reporting practices in the field of health education and behavior: a review of seven journals

Health Educ Behav. 2014 Feb;41(1):12-8. doi: 10.1177/1090198113483139. Epub 2013 Apr 3.

Abstract

Health education and behavior researchers and practitioners often develop, adapt, or adopt surveys/scales to quantify and measure cognitive, behavioral, emotional, and psychosocial characteristics. To ensure the integrity of data collected from these scales, it is vital that psychometric properties (i.e., validity and reliability) be assessed. The purpose of this investigation was to (a) determine the frequency with which published articles appearing in health education and behavior journals report the psychometric properties of the scales/subscales employed and (b) outline the methods used to determine the reliability and validity of the scores produced. The results reported herein are based on a final sample of 967 published articles, spanning seven prominent health education and behavior journals between 2007 and 2010. Of the 967 articles examined, an exceedingly high percentage failed to report any validity (ranging from 40% to 93%) or reliability (ranging from 35% to 80%) statistics in their articles. For health education/behavior practitioners and researchers to maximize the utility and applicability of their findings, they must evaluate the psychometric properties of the instrument employed, a practice that is currently underrepresented in the literature. By not ensuring the instruments employed in a given study were able to produce accurate and consistent scores, researchers cannot be certain they actually measured the behaviors and/or constructs reported.

Keywords: health behavior; health education; psychometric properties; reliability; validity.

Publication types

  • Review

MeSH terms

  • Bibliometrics*
  • Data Interpretation, Statistical
  • Health Behavior*
  • Health Education / statistics & numerical data*
  • Humans
  • Periodicals as Topic / standards
  • Periodicals as Topic / statistics & numerical data
  • Psychometrics / methods
  • Psychometrics / standards*
  • Reproducibility of Results
  • Research Design / standards*