The effect of interviewer image in a virtual-world survey

By Joseph Murphy, Elizabeth Dean, Sarah Cook, Michael Keating

When survey respondents are consciously or unconsciously influenced by the characteristics of the interviewer, bias in the survey estimates may result. The effects of interviewer characteristics such as gender and race on survey estimates have been considered previously, but isolating and experimentally manipulating a single interviewer characteristic has been infeasible. With the advent of online virtual worlds, it is now possible to conduct experiments focusing on individual physical interviewer characteristics. We conducted an exploratory study, surveying 60 individuals in Second Life, an online virtual-world community in which the respondent and interviewer were both represented as avatars—three-dimensional representations of real-life individuals. To explore the effect of interviewer appearance on reported health behaviors and attitudes, we randomly assigned half of the survey respondents to a “thin” interviewer and half to a “heavy” interviewer. The data suggest that those who reported to the heavy interviewer were less likely to say their own avatar was attractive, reported less frequent real-life exercise, and reported a higher real-life body mass index, although because of the small number of participants, we did not detect statistically significant differences. The findings suggest that interviewer appearance may have a biasing effect on reports in virtual-world surveys—and perhaps in real-world surveys. Despite the lack of statistically significant findings, the study illustrates the future potential, benefits, and challenges to surveying and conducting methodological research in a virtual world.

Bibliography

Murphy, J., Dean, E., Cook, S., & Keating, M. (2010). The effect of interviewer image in a virtual-world survey. (RTI Press Publication No. RR-0014-1012). Research Triangle Park, NC: RTI Press. DOI: 10.3768/rtipress.2010.rr.0014.1012

© 2018 RTI International. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Authors

Joseph MurphyJoseph J. Murphy, MA, is a senior survey methodologist in RTI’s Center for Survey Methodology. His research focuses on the development and application of new technologies and modes of communication to improve the survey research process.

Elizabeth DeanElizabeth Dean, MA, is a survey methodologist at RTI who designs survey instruments and qualitative assessments, including usability testing and cognitive interviewing.

Sarah CookSarah Cook, MA, is survey methodologist at RTI specializing in the review and refinement of questionnaires and materials.

Michael KeatingMichael Keating, MA, is a survey specialist at RTI who manages survey data collection and quality control efforts.

Contact RTI Press

To contact an author, request an exam or review copy, or seek permission to use copyrighted content, contact our editorial team.