Design, Sites, and Data Sources
MDRC is employing an experimental research design to determine whether PowerTeaching i3 continues to be effective as it is expanded to more schools. Approximately 50 schools recruited in two cohorts will be randomly assigned; half to receive the program, and half to a “business-as-usual” control group.
The evaluation will compare math outcomes for middle school students in both sets of schools for up to three years, using math scores from state standardized tests that are administered each spring. The impact analysis will also measure the program’s effects on student attendance and grade promotion.
Further, the evaluation will assess program fidelity and the contrast in math instruction between the program and control schools. MDRC will collect and analyze data from a variety of sources — teacher logs, principal and teacher surveys, and rating sheets completed by the coaches — to examine the implementation of PowerTeaching i3 in the treatment schools and how math instruction differs between the treatment and control schools. It will also compare the characteristics of the study schools with those of other schools participating in the i3 demonstration, providing suggestive evidence about the extent to which the evaluation’s findings can be generalized.