Development of an appraisal tool to evaluate strength of an instrument or outcome measure

Nurse Res. 2012;20(2):13-9. doi: 10.7748/nr2012.11.20.2.13.c9436.

Abstract

Aim: To devise a framework to enable the grading of the psychometric strength of instruments and questionnaires.

Background: Clinicians and researchers use a range of instruments and questionnaires to evaluate the outcomes of their research or clinical practice. To date, there has been no quantitative framework designed to determine the validity of these measurement tools.

Review methods: The psychometric grading framework (PGF) consists of two scales: scale one is a matrix for assigning a level (A-D) to each of six psychometric properties, based on the strength of any measures reported; scale two grades the overall psychometric strength of the instrument by combining the number and level of psychometric measures arising from the first scale.

Conclusion: The PGF uses a simple matrix that combines results from psychometric measures into an overall grading of an instrument's strength. The flexibility of the framework enables consistent determination of strength across a range of instruments.

Implications for research/practice: The PGF provides a preliminary evaluation (or grading) of the psychometric properties of an instrument based on the number and strength of reported psychometric scores. Its use may reduce the subjective judgements about the quality of instruments and outcome measures.

MeSH terms

  • Guidelines as Topic
  • Outcome Assessment, Health Care*
  • Psychometrics