About MDRC
Porter is a statistician with expertise in causal inference, experimental and quasi-experimental design, quantitative methods, and statistical computing. She is currently contributing to MDRC’s methodological work on heterogeneity of impacts in randomized controlled trials, regression discontinuity designs, testing of multiple hypotheses, and predictive modeling. Porter worked at MDRC from 2001 to 2006 and returned in 2011 after completing a PhD in biostatistics at the University of California, Berkeley. She also has an MPP from the University of Chicago.
-
MDRC Publications
November, 2017Assessing an intervention’s effects on multiple outcomes increases the risk of false positives. Procedures that make adjustments to address this risk can reduce power, or the probability of detecting effects that do exist. MDRC’s Reflections on Methodology discusses how to estimate power when making adjustments as well as alternative definitions of power.
September, 2017As organizations increase their use of sophisticated screening and risk assessments in their decision making, the results have the potential to fundamentally change practice, organizational culture, and the structure of work. Implementation researchers can inform the use of predictive analytic tools both before and after their adoption.
September, 2017Machine learning algorithms, when combined with the contextual knowledge of researchers and practitioners, offer service providers nuanced estimates of risk and opportunities to refine their efforts. The first post of a new series, Reflections on Methodology, discusses how MDRC helps organizations make the most of predictive modeling tools.
April, 2017Many low-income young people are not reaching important milestones, but the social-service organizations and schools that serve them often struggle to identify who is at more or less risk. Predictive analytics use schools’ and programs’ existing data to help them identify risk earlier and more accurately.
Results from a Partnership Between New Visions for Public Schools and MDRC
November, 2016A custom-designed intervention aimed to improve New York City high school students’ attendance by using text messaging to send parents daily absence updates and weekly attendance summaries. The rapid-turnaround randomized evaluation found that the short-term intervention did not improve attendance rates during the second semester of the 2015-2016 school year.
A Primer for Researchers Working with Education Data
November, 2016Predictive modeling estimates individuals’ probabilities of future outcomes by building and testing a model using data on similar individuals whose outcomes are already known. The method offers benefits for continuous improvement efforts and efficient allocation of resources. This paper explains MDRC’s framework for using predictive modeling in education.
A Guide for Researchers
July, 2016Conducting multiple statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) counteract this problem but can substantially change statistical power. This paper presents methods for estimating multiple definitions of power and presents empirical findings on how power is affected by the use of MTPs.
Lessons from a Simulation Study
November, 2014This paper makes valuable contributions to the literature on multiple-rating regression discontinuity designs (MRRDDs). It makes concrete recommendations for choosing among existing MRRDD estimation methods, for implementing any chosen method using local linear regression, and for providing accurate statistical inferences.
Elementary Student Achievement and the Bay Area School Reform Collaborative’s Focal Strategy
December, 2006The Bay Area School Reform Collaborative’s focal strategy, a system-wide reform that coaches district and school leaders, supports evidence-based decision-making, and promotes networking within and among schools, has no strong association with changes in elementary student achievement.
Elementary Student Achievement and the Bay Area School Reform Collaborative's Focal Strategy
February, 2006The Bay Area School Reform Collaborative’s strategy seeks to raise student achievement in six elementary school districts in the San Francisco Bay Area by coaching supervisors, principals, and teachers, instituting evidence-based decision making, and promoting sharing of experiences among schools. During the first two years of implementation, MDRC found no strong, pervasive association with student achievement.
Evidence from a Sample of Recent CET Applicants
September, 2005This working paper examines employment and earnings over a four-year period for a group of disadvantaged out-of-school youth who entered the Evaluation of the Center for Employment Training (CET) Replication Sites between 1995 and 1999. It assesses the importance of three key factors as barriers to employment: lack of a high school diploma, having children, and having an arrest record.
Final Report on the Center for Employment Training Replication Sites
September, 2005The Center for Employment Training (CET) in San Jose, California, produced large, positive employment and earnings effects for out-of-school youth in the late 1980s. However, in this replication study, even the highest-fidelity sites did not increase employment or earnings for youth over the 54-month follow-up period, despite short-term positive effects for women.
A Study of Adult Student Persistence in Library Literacy Programs
January, 2005Library-based literacy programs face serious challenges to improving adult students’ participation. This study suggests programs should be prepared to accommodate intermittent participation by adult students and to connect students to social services and other supports.
Thirty-Month Findings from the Evaluation of the Center for Employment Training Replication Sites
June, 2003Efforts to replicate the experience of the Center for Employment Training in San Jose, California — a uniquely successful program that helped at-risk youth develop skills needed to compete in today’s labor market — showed mixed results.
Responding to the Challenges of Adult Student Persistence in Library Literacy Programs
April, 2003Based on a study of nine adult literacy programs in public libraries, this report examines student characteristics, participation patterns, and new strategies to raise student persistence.
-
Other Publications
-
Projects
A research-practice partnership between MDRC and New Visions for Public Schools (a nonprofit organization supporting district-run high schools in New York City) operated in 2015 and 2016 to tackle challenges related to high school graduation.
Current practice for ensuring that impact evaluations in education have adequate statistical power does not take the use of multiplicity adjustments into account.
Virginia Knox, Charles Michalopoulos, Sharon Rowser, JoAnn Hsueh, Helen Lee, Desiree Principe Alderson, Dina A. R. Israel, Erika Lundquist, Kristin Porter, Electra Small, Rebecca Behrmann, Anne Warren, Samantha Xia, Kelly Saunders, Ilana Blum, Jessica Kopsic, Noemi Altman, Caroline MageAdverse birth outcomes result in significant emotional and economic costs for families and communities. One promising avenue for helping expectant women is home visiting programs, which work with parents to promote prenatal care and improve infant health.
Virginia Knox, Charles Michalopoulos, Sharon Rowser, JoAnn Hsueh, Helen Lee, Desiree Principe Alderson, Dina A. R. Israel, Erika Lundquist, Kristin Porter, Electra Small, Carolyn Hill, Rebecca Behrmann, Ximena Portilla, Anne Warren, Samantha Xia, Hiwote Getaneh, Kelly Saunders, Ilana BlumHome visiting programs operate around the country to prevent child maltreatment, improve maternal and child health outcomes, and increase school readiness.