These exploratory analyses were initiated to determine the impact on 2006 achievement estimates of an error in the printing PISA booklets for the 2006 survey. As a result of this error, extra page turns to reference introductory materials were required in order to answer some achievement items. The booklets were examined and items were classified into three categories based on judgments about the likelihood the printing error caused additional difficulty in responding to the item. Table 1 shows this “page problem” classification for items administered in both 2003 and 2006 mathematics, science, and reading assessments.
Exploratory analyses of PISA estimates for 2003 and 2006
Chromy, J., Kline, T., & Dalton, B. (2007). Exploratory analyses of PISA estimates for 2003 and 2006. RTI International.