OBJECTIVE: To describe the development, implementation and reliability and validity testing of the inpatient rehabilitation facility (IRF) Change in Self-Care and Change in Mobility quality measures.
DESIGN: We describe the activities involved in developing and implementing the 2 facility-level quality measures, including public comment opportunities. We examined facility-level reliability using split-half testing and Pearson product-moment correlations, Spearman rank correlations, and intraclass correlation coefficients (ICC 2,1). We examined validity by comparing facility-level quality measure scores and facility disease-specific certification status.
SETTING: All 1117 IRFs in the United States with at least 20 Medicare stays that ended in 2017.
PARTICIPANTS: Facility-level quality measure scores (N=1117) were derived from data from 427,517 (self-care) and 427,956 (mobility) Medicare fee-for-service and Medicare Advantage IRF patient stays in 2017.
INTERVENTIONS: Not applicable.
MAIN OUTCOME MEASURES: Facility-level Change in Self-Care and Change in Mobility quality measure scores and facility Disease-Specific Certification for Stroke Rehabilitation from The Joint Commission were used in validity analysis.
RESULTS: The split-half quality measure scores showed strong, positive correlations for the facility-level self-care (Pearson=0.903, Spearman=0.884, ICC=0.903, P<.0001) and mobility (Pearson=0.903, Spearman=0.884, ICC= 0.903, P<.0001) quality measure scores, providing evidence of reliability. ICCs remained strong when stratifying by provider volume. IRFs with stroke certification had slightly higher mean and median quality measure scores than IRFs without certification, and IRFs with the higher quality measure scores tended to have a higher percentage of certified IRFs.
CONCLUSIONS: Our analyses support the reliability and validity of the Change in Self-Care and Change in Mobility quality measure scores in IRFs.