Validity and reliability of the rapid assessment for adolescent preventive services adolescent health risk assessment

J Adolesc Health. 2012 Jun;50(6):595-9. doi: 10.1016/j.jadohealth.2011.10.015. Epub 2012 Feb 3.

Abstract

Purpose: Seventy-five percent of adolescent morbidity and mortality is a result of risky behaviors. The Rapid Assessment for Adolescent Preventive Services (RAAPS) is a 21-question adolescent risk screening tool developed to identify the behaviors contributing most to adolescent morbidity, mortality, and social problems. The aim of this study was to evaluate the validity and reliability of the RAAPS.

Methods: This study used psychometric methods to establish face-, content-, and criterion-related validity and inter-rater and equivalence reliability. Focus groups with adolescents (n = 21) and health care professionals (n = 7) were facilitated to establish face validity. Adolescent expert review (n = 10) was gathered to establish content validity and reliability. A retrospective chart audit of adolescents (n = 263) who completed both the RAAPS and the Guidelines for Adolescent Preventive Services risk questionnaire was conducted to assess criterion-related validity and equivalence between paired question responses using Cohen kappa measure, percent agreement, and Fisher exact test.

Results: Face validity was established by consensus of focus group. Adolescent expert content validity index scores ranged from 0.825 to 1.0, and inter-rater content agreement ranged from 0.9 to 1.0. Cohen kappa ranged from 0.44 to 0.99; percent agreement ranged from 0.71 to .99; Fisher exact test resulted in all p > 0.05 establishing criterion-related validity and equivalence.

Conclusion: Validity and reliability of the RAAPS as a measure of adolescent risk behaviors was established. Results indicate RAAPS is an acceptable screening tool in identifying adolescent risk behaviors, contributing most to morbidity, mortality, and social problems.

Publication types

  • Validation Study

MeSH terms

  • Adolescent
  • Adolescent Health Services / statistics & numerical data*
  • Child
  • Female
  • Focus Groups
  • Health Status Indicators*
  • Humans
  • Male
  • Mass Screening / statistics & numerical data*
  • Michigan
  • Observer Variation
  • Preventive Health Services / statistics & numerical data*
  • Psychometrics / statistics & numerical data
  • Reproducibility of Results
  • Retrospective Studies
  • Risk-Taking*
  • School Health Services
  • Surveys and Questionnaires*
  • Young Adult