Assessing an intervention’s effects on multiple outcomes increases the risk of false positives. Procedures that make adjustments to address this risk can reduce power, or the probability of detecting effects that do exist. MDRC’s Reflections on Methodology discusses how to estimate power when making adjustments as well as alternative definitions of power.
To improve outcomes among high-interest borrowers, policymakers need to understand what is driving usage. This second post in MDRC’s Reflections on Methodology series discusses how a data discovery process revealed clusters of borrowers who differed greatly in the kinds of loans and lenders they used and in their loan outcomes.
Machine learning algorithms, when combined with the contextual knowledge of researchers and practitioners, offer service providers nuanced estimates of risk and opportunities to refine their efforts. The first post of a new series, Reflections on Methodology, discusses how MDRC helps organizations make the most of predictive modeling tools.
Testimony Before the New York City Council Committee on Higher Education
In the City University of New York’s innovative program, CUNY’s least prepared students delay matriculation, beginning instead with noncredit, time-intensive instruction aimed at eliminating developmental needs after one semester, preparing participants for college courses, and improving academic outcomes. An independent evaluation will help determine CUNY Start’s effect on academic success.
An Empirical Assessment Based on Four Recent Evaluations
This reference report, prepared for the National Center for Education Evaluation and Regional Assistance of the Institute of Education Sciences (IES), uses data from four recent IES-funded experimental design studies that measured student achievement using both state tests and a study-administered test.
This brief summarizes results from performance-based scholarship programs in Louisiana, New Mexico, New York, and Ohio. These scholarships can move the dial on important markers of academic success for students, including credits attempted and earned and rates of full-time enrollment.
Implications for Income Support Policy
On the eve of the 15th anniversary of federal welfare reform, MDRC President Gordon Berlin describes the implications of the Great Recession and its effects on the labor market for welfare policy and other safety net programs. The speech was given at the 2011 Welfare Research and Evaluation Conference, sponsored by the U.S. Department of Health and Human Services.
This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools — which comprise three levels of clustering (students in classrooms in schools) — to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing.