Scaling Up First Things First

Project

Overview

Project Overview

Developed by the Institute for Research and Reform in Education (IRRE), First Things First is an ambitious comprehensive school reform model that seeks to address the impersonal nature and poor performance of many secondary schools serving disadvantaged students. Calling for changes in structure, instruction, governance, and accountability in low-performing middle and high schools, the model is grounded in substantial research on factors that contribute to high engagement and achievement among adolescents, as well as on the organizational change literature and on the practices of schools that have succeeded with students who might otherwise be at high risk of school failure. Key program elements include: the establishment of small learning communities to promote a more personalized atmosphere, a “Family Advocate System” to further the development of strong teacher-student bonds, and the introduction of professional development activities geared toward making classroom instruction more rigorous and involving.

Promising early results in Kansas City, Kansas, where First Things First was initially mounted, led the U.S. Department of Education to select the initiative for expansion and testing as one of several comprehensive school reform models participating in its Comprehensive School Reform Demonstration Program. (MDRC’s Evaluation of the Talent Development Model is also receiving support under the same Department of Education research initiative.) Specifically, MDRC’s charge is to study the implementation and effects of First Things First in 12 middle and high schools, located in four school districts that are part of this expansion effort, as well as in additional schools in Kansas City, Kansas. If the approach is effective and adaptable to these new contexts, it can serve as a model for turning around low-performing schools.

STATUS: Completed

Basics

Issue: P-12 Education

Focus Area: High School

Population: Children and Schools

Focus Population: High School Students, Students Experiencing Academic Struggles

Locations: Kansas, Mississippi, Missouri, Texas

Intervention: Comprehensive School Reform, Counseling/Advising, Curricular/Instructional Reforms

Agenda, Scope, <br> & Goals

Agenda, Scope, and Goals

Under way since 2000, the Scaling Up First Things First study addresses the following key questions:

To what extent are the program’s key features operating successfully in the expansion sites, and what factors promote or impede successful implementation?
Does the program register impacts on student attitudes and on their academic performance?
How are program implementation, student and teacher attitudes, and student performance related to each other?

STATUS: Completed

Basics

Issue: P-12 Education

Focus Area: High School

Population: Children and Schools

Focus Population: High School Students, Students Experiencing Academic Struggles

Locations: Kansas, Mississippi, Missouri, Texas

Intervention: Comprehensive School Reform, Counseling/Advising, Curricular/Instructional Reforms

Design, Sites, & <br> Data Sources

Design, Sites, and Data Sources

In Scaling Up First Things First, IRRE, the reform’s developer, provides support and technical assistance to the schools and districts into which First Things First has expanded, while MDRC acts as project manager and evaluator.

The analytic approach used for this study combines two particularly strong quasi-experimental evaluation methods: an interrupted time series analysis and a comparison schools technique. In the interrupted time series analysis, measures of student performance in schools that implemented the intervention are compared with the performance of similar students in the same schools prior to the implementation. The difference between performance levels in the two groups is referred to as a “deviation from the baseline.” A second interrupted time series analysis is conducted for a group of comparison schools in the same district that have characteristics similar to those of the intervention schools. The difference between the deviations from the baseline in the intervention schools and the deviations from the baseline in the comparison schools represents the estimated impact of the intervention.

By design, one group of expansion schools began implementing First Things First one year after the other group of schools. Thus, three years of post-implementation data are available for the earlier-starting schools and two years are available for the later-starting schools.

The expansion sites in MDRC’s study of First Things First include secondary schools in these urban, suburban, and rural school districts:

Houston Independent School District (Houston, Texas)
Riverview Gardens School District (suburban St. Louis County, Missouri)
Greenville Public Schools (Greenville, Mississippi)
Shaw Public Schools (Shaw, Mississippi)

Information about program implementation comes from annual surveys of teachers and students and from field interviews with district and school administrators, teachers, students, and others. Data sources for the impact study include school records on attendance, promotion, and test scores. A classroom observation study was also conducted to ascertain changes in instructional practices.

STATUS: Completed

Basics

Issue: P-12 Education

Focus Area: High School

Population: Children and Schools

Focus Population: High School Students, Students Experiencing Academic Struggles

Locations: Kansas, Mississippi, Missouri, Texas

Intervention: Comprehensive School Reform, Counseling/Advising, Curricular/Instructional Reforms

MDRC Staff

Fred Doolittle
Senior Adviser and Chair, Institutional Review Board
Doolittle joined MDRC in 1986, initially specializing in studies of employment and training programs for economically disadvantaged, out-of-school young people and adults. As MDRC expanded its work to include education, he focused on evaluations of elementary and secondary school reforms.
More »

Project Director

Publications & Resources

COMPLETE LIST OF PUBLICATIONS

Issue Focus

Sustaining Change in High School Reform

01/2007

MDRC’s research on Career Academies, First Things First, Project GRAD, and Talent Development suggests that the twin pillars of high school reform are structural changes to improve personalization and instructional improvement.

Overview »

Report

Student Context, Student Attitudes and Behavior, and Academic Achievement

An Exploratory Analysis

01/2006

Theresa M. Akey

This analysis of data collected in MDRC’s evaluation of the First Things First reform initiative confirms that high school students’ engagement in school and perceptions of their own academic competence influence their mathematics achievement. The study also suggests that perceived academic competence may be more influential than engagement in boosting achievement in both mathematics and reading.

Overview »

Full

Report

The Challenge of Scaling Up Educational Reform

Findings and Lessons from First Things First

07/2005

Janet Quint, Howard Bloom, Alison Rebeck Black, LaFleur Stephens

First Things First, a comprehensive school reform initiative, increased student achievement in Kansas City, Kansas, the first school district to adopt the reform model. It is not yet clear if First Things First is working in four other school districts in which it has been replicated.

Overview »

Full

Methodology

Conducting Classroom Observations in First Things First Schools

07/2004

Angela Estacion, Teresa McMahon, Janet Quint

Relying on 427 classroom observations conducted over a three-year period, this study traces changes in teachers’ instructional practices in the First Things First schools.

Overview »

Full

Report