Assessing the Validity and Reliability of the Pharmacist Interprofessional Competencies Tool

Abstract

Objective. To determine the validity and reliability of the Pharmacist Interprofessional Competencies Tool (PICT). Methods. Faculty members at Ferris State University, College of Pharmacy developed the PICT, which has five interprofessional criterion (collaboration, ownership, respect, engagement, and application) and four competency levels (unacceptable, novice, competent, and proficient) to assess the interprofessional competencies of pharmacy students. Fourteen pharmacy faculty members were trained in how to use the PICT and then used it to assess students' behaviors in four to six video-recorded interprofessional education (IPE) learning activities. A subset of these faculty members evaluated the video-recorded IPE learning activities using two other previously validated interprofessional assessment tools. Psychometric analysis of the PICT, including internal consistency and inter-rater reliability, was conducted, along with a correlation analysis and factor analysis, and the results were compared to those from the other validated assessment tools. Results. The overall rating of the internal consistency of the PICT was excellent and item-total correlations of the individual criterion were fair to good, with the exception of the respect criterion. The PICT demonstrated excellent overall inter-rater reliability, and individual criterion rated as fair to excellent with the exception of the respect criterion. Specific dimensions of the PICT showed high convergence with previously validated interprofessional assessment tools. Conclusion. The PICT exhibited overall validity and reliability as an assessment tool for measuring the interprofessional competencies of pharmacy students. In establishing the overall validity and reliability of the assessment tool, the respect criterion was not proved to be reliable or valid. Additional training and slight modifications to the PICT and associated IPE learning activities are planned to assist with longitudinal assessment of student performance across the curriculum.

Keywords: assessment; assessment tool; interprofessional education; reliability; validation.