Use of a computer-based simulated consultation tool to assess whether doctors explore sociocultural factors during patient evaluation

J Eval Clin Pract. 2009 Dec;15(6):1190-5. doi: 10.1111/j.1365-2753.2009.01302.x.


Rationale, aims and objectives: The delivery of patient-centred care to diverse populations requires that doctors identify sociocultural factors that may affect care. We adapted a computer-based simulated consultation tool and tested its utility for assessing whether doctors explore sociocultural factors during a patient evaluation, and whether they include such information in their case conclusions and follow-up recommendations.

Methods: We developed two detailed patient 'stories' that involved sociocultural issues that doctors needed to identify and consider for adequate clinical management. They were incorporated into an existing 'Virtual Internet Patient Simulation' (VIPS) program designed to test clinical reasoning skills. Doctors and medical students (n = 618) were invited to access the program via Internet. For each consultation, participants were assigned a sociocultural score, corresponding to the number of sociocultural domains explored. Scores were then compared with subjective ratings of participants' performance by expert doctors.

Results: 118 respondents completed at least one virtual consultation (19%), 92 conducted both. The mean number of sociocultural dimensions explored by doctors (i.e. sociocultural score) was 3.9 (standard deviation 2.6) for case 1, and 5.2 (standard deviation 2.3) for case 2. The two sociocultural scores were moderately correlated (Spearman r = 0.65, P < 0.001). Sociocultural scores correlated positively with experts' subjective ratings of participants' performance (Spearman r = 0.84 for case 1 and 0.78 for case 2, both P < 0.001).

Conclusions: The adapted computer-based simulated consultation tool provided a feasible means to assess doctors' exploration of sociocultural issues during a clinical evaluation. Further validation of this method should be conducted by comparing VIPS results with other skills assessment methods such as objective structured clinical examination or direct observation of clinical performance.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Analysis of Variance
  • Clinical Competence / standards*
  • Computer-Assisted Instruction / methods*
  • Cultural Characteristics*
  • Humans
  • Logistic Models
  • Patient Simulation*
  • Patient-Centered Care*
  • Physicians / standards*
  • Referral and Consultation*
  • Socioeconomic Factors
  • User-Computer Interface*