RTI uses cookies to offer you the best experience online. By clicking “accept” on this website, you opt in and you agree to the use of cookies. If you would like to know more about how RTI uses cookies and how to manage them please view our Privacy Policy here. You can “opt out” or change your mind by visiting: http://optout.aboutads.info/. Click “accept” to agree.
Greedy caliper propensity score matching can yield variable estimates of the treatment-outcome association-A simulation study
Komen, J. J., Belitser, S. V., Wyss, R., Schneeweiss, S., Taams, A. C., Pajouheshnia, R., Forslund, T., & Klungel, O. H. (2021). Greedy caliper propensity score matching can yield variable estimates of the treatment-outcome association-A simulation study. Pharmacoepidemiology and Drug Safety, 30(7), 934-951. https://doi.org/10.1002/pds.5232
PURPOSE: Greedy caliper propensity score (PS) matching is dependent on randomness, which can ultimately affect causal estimates. We sought to investigate the variation introduced by this randomness.
METHODS: Based on a literature search to define the simulation parameters, we simulated 36 cohorts of different sizes, treatment prevalence, outcome prevalence, treatment-outcome-association. We performed 1:1 caliper and nearest neighbor (NN) caliper PS-matching and repeated this 1000 times in the same cohort, before calculating the treatment-outcome association.
RESULTS: Repeating caliper and NN caliper matching in the same cohort yielded large variations in effect estimates, in all 36 scenarios, with both types of matching. The largest variation was found in smaller cohorts, where the odds ratio (OR) ranged from 0.53 to 10.00 (IQR of ORs: 1.11-1.67). The 95% confidence interval was not consistently overlapping a neutral association after repeating the matching with both algorithms. We confirmed these findings in a noninterventional example study.
CONCLUSION: Caliper PS-matching can yield highly variable estimates of the treatment-outcome association if the analysis is repeated.