Skip to Main Content

RTI uses cookies to offer you the best experience online. By clicking “accept” on this website, you opt in and you agree to the use of cookies. If you would like to know more about how RTI uses cookies and how to manage them please view our Privacy Policy here. You can “opt out” or change your mind by visiting: http://optout.aboutads.info/. Click “accept” to agree.

Accept
RTI International
  • About
    • Office Locations
    • Executive Leadership
    • Corporate Governance
    • Partner with Us
      • U.S. Government
      • Clients and Funding Agencies
      • Industry and Commercial Clients
      • Foundations and Associations
      • Bilateral Agencies and Multilateral Banks
      • Universities and Academic Research Institutions
      • Suppliers and Small Businesses
    • Commitment to Quality
      • RTI's Client Listening Program
    • Ethics and Human Research Protection
    • Living Our Mission
    • Open Science Initiative
    • Veteran Opportunities at RTI

    About

  • Practice Areas
    • Health
      • Public Health and Well-Being
      • Health Care Transformation
      • Behavioral Health
      • Health Behavior Change
      • Precision Medicine
      • RTI Health Solutions (RTI-HS)
      • Health Equity
      • Community & Workplace Health
      • Public Health Economics
      • Child and Adolescent Research and Evaluation Program
      • RTI Health Advance
    • Transformative Research Unit for Equity​
      • Equity Capacity Building Hub
      • Social and Economic Justice Research Collaborative
      • Narrative Research and Community Engagement Lab
    • Education and Workforce Development
      • Early Childhood
      • K-12 Education
      • Postsecondary Education
      • Career and Adult Education and Workforce Development
      • Education Policy, Systems, and Governance
      • Education Research Methodologies
      • Education Technologies
      • International Education
    • International Development
      • Climate Change
      • Energy for Development
      • Environment
      • Global Food Security, Agriculture, and Nutrition
      • Global Health
      • International Education
      • Monitoring, Evaluation, Research, Learning, and Adapting (MERLA)
      • Youth and Economic Opportunity
      • Water, Sanitation, and Hygiene (WASH)
      • RTI Center for Global Noncommunicable Diseases
      • RTI Center for Governance
      • RTI Center for Thriving Children
    • Climate Change
      • Clean Energy Technology and Renewables
      • Climate Finance
      • Climate Justice and Equity
      • Climate Planning, Preparedness and Resilience
      • Climate Policy
      • Climate Vulnerability, Adaptation, and Mitigation
      • Economic Impacts of Climate Change
    • Water
      • Food-Energy-Water Nexus
      • Water Quality
      • WASH (Water, Sanitation, Hygiene)
      • Water Resources Management
    • Energy Research
      • Carbon Capture and Utilization
      • Biomass Conversion
      • Natural Gas
      • Energy Efficiency
      • Industrial Water
      • Syngas Processing
    • Environmental Sciences
      • Air Quality
      • RTI Center for Water Resources
      • Urban Sustainability
      • Toxics
      • Building Resiliency in the FEW Nexus
      • Climate Change Sciences and Analysis
      • Environmental Policy
      • Environmental Justice
      • Sustainable Materials & Waste Management Solutions
    • Justice Research and Policy
      • RTI Center for Community Safety and Crime Prevention
      • RTI Center for Policing Research and Investigative Science
      • Child Well-Being and Family Strengthening
      • RTI Center for Forensic Sciences
      • Evidence-Based Strategies to Reduce Firearm Violence
    • Food Security and Agriculture
      • Food Security and Food Assistance
      • Nutrition, Physical Activity, & Obesity
      • Food Safety
      • Food Systems and Policy Analysis
      • Food Loss and Waste Research
      • Market Systems Strengthening
      • Global Food Security, Agriculture, and Nutrition
      • Climate-Smart Agriculture
      • Agricultural Innovation
    • Innovation Ecosystems
      • Innovation Advising
      • Innovation for Economic Growth
      • Innovation for Emerging and Developing Economies
      • Innovation for Organizations
      • Research, Technology, and Innovation Policy
      • Technology Acceleration
    • Military Support
      • Military Behavioral Health
      • Military Health and Human Performance
      • Military Sexual Assault, Harassment, and Domestic Violence Prevention
      • Wearable Sensor Technologies
      • Military Health System Transformation
      • North Carolina Center for Optimizing Military Performance

    Practice Areas

  • Services + Capabilities
    • Surveys and Data Collection
      • Survey Design
      • Instrument Development
      • Survey Methodologies
      • Data Collection
      • Establishment Surveys
      • Health Registries
      • Data Analysis and Reporting
      • Research Operations Center
    • Statistics and Data Science
      • Survey Statistics
      • Environmental Statistics
      • Coordinating Centers for Multisite Studies
      • Analysis and Design of Complex Data
      • Biostatistics
      • RTI Center for Data Science
    • Evaluation, Assessment and Analysis
      • Evaluation Design and Execution
      • Advanced Qualitative, Quantitative, and Mixed Methods
      • Evaluation, Monitoring, and Assessment
      • Economic Analysis
      • Evaluating Communication Interventions and Campaigns
      • Evidence Synthesis for Policy and Practice
      • Risk Assessment and Prediction
    • Program Design and Implementation
      • Systems Strengthening and Scaling
      • Capacity Assessment and Building
      • Policy Reform Support
      • Curriculum and Teacher Professional Development
      • Interventions and Prevention Programs
      • Implementation Science
    • Digital Solutions for Social Impact
      • Human-Centered Design of Digital Solutions
      • Digital Product Development
      • Digital Communication Campaigns
      • Digital Data Analytics
    • Research Technologies
      • Survey Technologies
      • Data Management and Decision Support Systems
      • Geospatial Science, Technology, and Visualization
      • ICT for Limited-Resource Settings
      • Mobile Applications
      • Web Applications
      • Bioinformatics
      • Interactive Computing
    • Drug Discovery and Development
      • Medicinal Chemistry
      • Molecular Design and Cheminformatics
      • Behavioral Pharmacology
      • Drug Metabolism and Pharmacokinetics (DMPK)
      • In Vitro Pharmacology, Bioassay Development, and High-Throughput Screening (HTS)
      • Isotope Labeling
      • Regulatory Consulting and Support for Medical Products
    • Analytical Laboratory Sciences
      • Bioanalytical and Toxicology Research
      • Forensic Sciences
      • Physicochemical Characterizations
      • Metabolomics
      • Proficiency Testing and Reference Materials
      • Microbiology
      • Analytical Chemistry and Pharmaceutics
    • Engineering & Technology R&D
      • Biomedical Technologies
      • Decarbonization Sciences
      • Environmental Exposure & Protection
      • Materials & Environment
      • Sustainable Energy Solutions

    Services + Capabilities

  • Impact
    • Newsroom
    • Insights Blog
    • Events
    • Publications
    • RTI Press
      • About the RTI Press
      • Instructions for Authors
      • RTI Press Collections
    • Projects
    • Global Reach
      • Asia
      • Eastern Europe and Central Asia
      • RTI International India
      • Africa
      • Middle East and North Africa (MENA)
      • Latin America and the Caribbean (LAC)

    Impact

  • Experts
    • Our Experts
    • In-Depth With Our Experts
    • Related News
    • Experts In the Media
    • RTI Fellow Program

    Experts

  • Emerging Issues
    • COVID-19 Research
    • Artificial Intelligence
    • Global Health Security
    • Cannabis Research
    • Opioid Research
      • Interventions for Opioid Use Disorders
      • Preventing Opioid Misuse and Overdose
      • Treating Opioid Use Disorders
    • Policing Research and Investigative Science
    • Drone Research and Application
    • E-cigarette Research
    • Zika Virus Research
    • Integrated Governance

    Emerging Issues

  • Global Reach
  • Insights Blog
  • Newsroom
  • RTI Press
  • Publications
  • Partner With Us
  • Careers
  • Facebook IconTwitter IconInstagram IconYouTube IconLinkedin Icon
Impact

Evaluating the Health Care Innovation Awards (HCIA)

  • Home
  • Impact
  • Evaluating the Health Care Innovation Awards (HCIA)

Combining meta-analysis with data visualization to identify success factors in new models for health care payment and service delivery

As part of the 2010 Affordable Care Act, Congress authorized the Center for Medicare and Medicaid Innovation to test innovative health care payment and service delivery models with the potential to lower Medicare, Medicaid, and Children’s Health Insurance Program (CHIP) expenditures while maintaining or improving the quality of beneficiaries’ care.

In July 2012, more than 100 providers, payers, local government, public-private partnerships, and multi-payer collaboratives received awards ranging from approximately $1–30 million over a three-year period to implement these innovative models. Known as the Health Care Innovation Awards, this initiative was open-ended rather than prescriptive, meaning the awardees could focus on innovations in care coordination, care management, home care, telemedicine, or any other aspect of service delivery or payment—with specific, shared goals of improving outcomes and reducing costs.

In the years since, these innovative programs have been subject to evaluation, producing vast amounts of information about what works in particular circumstances.

To move the discussion from “Does it work?” to “Would it work in my setting?”—a question that must be answered to support adoption of a successful model by other providers or agencies—requires fully characterizing the intervention, analyzing and synthesizing immense amounts of sometimes contradictory data, and understanding the methods used to produce it. 

Using Meta-analysis to Understand Results across Evaluation Studies

On behalf of CMMI our experts developed a new combination of approaches to analyze the Health Care Innovation Awards to make the lessons available more useful for policy makers and other health care stakeholders.

By looking across multiple studies and placing their results on a common scale, meta-analysis allows us to understand evaluation results in a different way. Our approach draws on additional sources of information—about the interventions, implementation, outcome measurement, and evaluation design—to understand the differences between study findings and examine relationships across studies. 

Informing Policy through Data Visualization

In addition to collecting and analyzing qualitative and quantitative data, we also developed a data dashboard to assist policy makers in understanding and using the wealth of information about HCIA interventions generated by our meta-evaluation.  The dashboard is interactive, which allows decision makers to filter by key features of interest and understand the relationship of those features to programmatic effects. Without conducting extensive analyses, it is possible to examine characteristics of potentially promising models for future testing. 

Identifying Models that Lower Health Care Costs and Improve Care

Using this approach, which relies on innovations in collecting, assembling, and displaying different sources of information, our meta-evaluation is able to identify health care payment and service delivery models that lower total costs of care while maintaining or improving the quality of beneficiaries’ care.

This offers a strategic aid to policy makers and to providers and agencies seeking to extend the benefits of successful health care innovations to reach more patients and realize the goals of health care reform.

Share

Clients

  • Center for Medicare and Medicaid Innovation

Our Experts

Anupa Bir
Anupa Bir Senior Vice President, Health Practice Area
Robert Chew Senior Research Data Scientist
Deborah Porterfield Senior research public health analyst

Practice Areas

Health Care Transformation Research, Technology, and Innovation Policy

Services

Evaluation Design and Execution Advanced Qualitative, Quantitative, and Mixed Methods

Learn More about Meta-Evaluation

Metaevaluation: An Innovative Approach to Evaluating Health Care Innovations

Learn More

Visit the Health Care Innovation Awards website

65 Years
Partner With Us
  • US Government
  • Commercial
  • Foundations & Associations
  • Multilateral Donors
  • Universities
  • Suppliers
Site
  • Privacy Policy
  • Security Policy
  • Site Map
  • Terms of Use
  • Accessibility
  • Contact Us
Contact Us
Facebook Icon Twitter Icon Instagram Icon YouTube Icon Linkedin Icon
delivering the promise of science
for global good
RTI International Logo
RTI Health Solutions RTI Innovation Advisors RTI Health Advance

© 2023 RTI International. RTI International is a trade name of Research Triangle Institute. RTI and the RTI logo are U.S. registered trademarks of Research Triangle Institute.