An Examination of Within-Interviewer Continuity and Change in the Use of Standardized Interviewing Following Repeated Corrective Feedback
Fahrney, K. M., Cohen, D. L., & Burke, A. M. (2010, May). An Examination of Within-Interviewer Continuity and Change in the Use of Standardized Interviewing Following Repeated Corrective Feedback. Presented at AAPOR 2010, .
Although standardized interviewing practices are widely advocated in order to reduce interviewer-related measurement error, audio recordings of interviewers’ work reveal interviewers’ sometimes persistent tendency to paraphrase or reword questions. This presentation includes interviewer performance data obtained through CARI (computer recorded audio interviewing) monitoring on two separate face-to-face surveys. The first is a mid-sized study that employs approximately 85 interviewers who administer an approximately 60-minute computer assisted interview. Most interviewers were monitored at least 3 times during the 3 month period of survey production. Our analysis of this data will focus specifically on quantifying the proportion of interviewers who show improvement in reading questions verbatim after receiving corrective feedback. The second survey employs a small number of interviewers (~13) who administered a complex 90-minute computer assisted interview. Interviewers received feedback 3 times over the course of 6 months. The small size of this team allowed us to capture rich descriptive data on whether or not there was improvement in their use of standardized interviewing techniques following corrective feedback. A brief anonymous survey administered to these interviewers sheds light on competing priorities (e.g. need to follow protocols vs. need to be mindful of the respondent’s time or interest level) and is suggestive of ways that researchers can frame corrective feedback to be more persuasive to field staff.