Skip to content
CRR logo
Submit Search
Advanced Search
Join E-mail List | Contact Us
  • Topics
  • Publications
  • Initiatives
  • Data
  • Sponsors
  • Opportunities
  • About Us
  • Search

Comparative Regression Discontinuity and Regression Discontinuity as Alternatives to Randomized Control Trials: Evidence from BOND

Share
Mobile Share Email Facebook Twitter LinkedIn

In this paper we use data from an evaluation of the Benefit Offset National Demonstration (BOND) to evaluate the efficacy of using comparative regression discontinuity (CRD) and regression discontinuity (RD) relative to a randomized controlled trial (RCT). BOND is a large demonstration intended to promote return to work among people with disabilities who receive Social Security Disability Insurance (DI). RD is known as a relatively rigorous non-experimental method but produces imprecise results that apply to small populations. CRD is a promising enhancement that addresses these issues. The CRD and RD methods are potentially attractive because they can be used in contexts where RCTs are challenging or infeasible. However, the bias of findings from CRD and RD studies is unknown in the context of DI. In this paper, we estimate CRD and RD models using simulated assignment to the BOND treatment group based on duration of DI receipt at the start of BOND. We compare the CRD and RD estimates to RCT estimates. While the findings from this paper are not intended to revise the well-established evidence evaluating BOND, they can be used to help with interpretation of results from CRD and RD studies on other income support interventions for people with disabilities and to inform future study designs.nOur paper has two key limitations. First, our RD models are far from ideal. This limits the degree to which our RD results generalize to what would be found with state-of-the art RD models. Second, our results may not generalize to other populations. Our analysis was based on BOND beneficiaries who were representative of the larger DI population at the time of BOND random assignment but may not reflect the DI population in more recent years.

Publications

Social Security sign in a garden

Comparative Regression Discontinuity as Alternative to RCT for Estimating Average Treatment Effects

Working Paper by Duncan Chaplin, Charles Tilley, Denise Hoffman, and John T. Jones

July 19, 2022
Sponsor
U.S. Social Security Administration
Fiscal Year Awarded
2020
Project Code
BC20-13
About us
Contact
Join e-mail list
Facebook Twitter LinkedIn YouTube RSS

© 2023 Trustees of Boston College, Center for Retirement Research|Terms of Use|Privacy Policy|Accessibility

This website uses cookies to improve your experience. We also use IP addresses, domain information and other access statistics to administer the site and analyze usage trends. If you prefer to opt out, you can select Update settings. Read our Privacy Policy. Accept
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT