You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation

Demography. 2021 Feb 1;58(1):1-29. doi: 10.1215/00703370-8932274.

Abstract

Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.

Keywords: Interviewer effects; Risk beliefs; Spillovers; Subjective expectations; Survey methodology.

Publication types

  • Randomized Controlled Trial
  • Research Support, N.I.H., Extramural

MeSH terms

  • Humans
  • Motivation*
  • Surveys and Questionnaires