Evaluating the Impact on Data Quality of Conversion from PAPI to the iPAQ Handheld Computer for In-person Data Collection
Keesling, S., & Bell, S. (2005, May). Evaluating the Impact on Data Quality of Conversion from PAPI to the iPAQ Handheld Computer for In-person Data Collection. Presented at American Association for Public Opinion Research 60th Annual Conference, Miami Beach, FL.
The National Household Enumeration Survey, an in-person interview conducted in English or Spanish annually since 1994, has been evaluating the idea of converting its current paper-based instrument to computer driven systems. A primary concern in considering conversion to the technology is the potential effect of the data collection device on data quality. This presentation will focus on procedures and software features that were developed and evaluated for their impact on data quality. There were concerns that the accuracy of the recorded responses my decrease given the fact that, with the PAPI questionnaire, data recorded on the paper form were key-entered by two professional data entry operators while running a software program that would detect any keying errors. Using the handheld computer, the function of the two keyers would be replaced with a single field interviewer entering the data once with no obvious check for keying errors. Additionally, there were questions regarding the possible impact on response rates and/or the data being provided by a respondent given the presence of the handheld device in place of the paper form. Would the responses differ or be skewed relative to the data collected previously via PAPI? The objective of the evaluations was to identify and quantify the level of impact the change in data collection media had on data quality; specifically regarding completeness and accuracy. Data will be presented comparing responses collected with the handheld computer with that of the PAPI approach. Implications and recommendations for converting from PAPI to electronic field data collection will be discussed.