CPRE Four-Year Evaluation
Evaluation of Reading Recovery expansion finds strong gains in student reading achievement.
One of the largest and most rigorous evaluations ever implemented in the field of education.
The Consortium for Policy Research in Education (CPRE) at the University of Pennsylvania's Graduate School of Education has released its evaluation of one of the most ambitious and well-documented expansions of a U.S. instructional curriculum. The rigorous independent evaluation of the Investing in Innovation (i3) scale-up of Reading Recovery, a literacy intervention for struggling first graders, was a collaboration between CPRE and the Center for Research on Education and Social Policy (CRESP) at the University of Delaware.
This evaluation included a four-year, multi-site randomized control trial (RCT) involving nearly 7,000 first-grade students in more than 1,200 schools. The study, which found medium to large effects on student achievement in reading, contributes to a growing body of research on the conditions for, and impacts of, scaling up instructional programs. Reading Recovery is a short-term intervention that provides one-on-one tutoring to first-grade students who are struggling in reading. The supplementary program aims to promote literacy skills and foster the development of reading strategies by tailoring individualized lessons to each student.
As part of the scale-up, the 3,747 teachers trained in Reading Recovery with i3 grant funds provided one-to-one Reading Recovery lessons to 62,000 students and taught an additional 325,000 students in other instructional settings.
The CPRE/CRESP evaluation revealed that students who participated in Reading Recovery significantly outperformed students in the control group on measures of overall reading, reading comprehension, and decoding. These effects were similarly large for English language learners and students attending rural schools, which were the student subgroups of priority interest for the i3 scale-up grant program.
The study included an in-depth analysis of program implementation. Key findings focus on the contextual factors of the school and teachers that support the program's success and the components of instructional strength in Reading Recovery.
Impact on Student Reading Performance
- The RCT revealed medium to large impacts across all outcome measures. Effect sizes on the Iowa Test of Basic Skills (ITBS) Reading Total assessment and its Comprehension and Reading Words subscales at the end of 12 to 20 weeks of treatment ranged between 0.30 and 0.48 standard deviations.
- For the ITBS Total Reading battery, this effect size translates to a gain of +18 percentage points in the treatment group, as compared with control students.
- The growth rate observed in students who participated in Reading Recovery over approximately a five-month period was 131% of the national average rate of progress for first-grade students.
The research team and the i3 scale-up leadership at The Ohio State University will present these and other findings from the evaluation and scale-up process on April 9 at the 2016 meeting of the American Educational Research Association
The evaluation was funded by an i3 grant from the U.S. Department of Education's Office of Innovation and Improvement to The Ohio State University. The grant, which was awarded in 2010, totaled $45 million to cover the expansion of Reading Recovery around the U.S., with an additional $10.1 million raised from the private sector. Of this, $4 million was earmarked for the completion of the independent evaluation of the scale-up effort between 2011 and 2015. The report can be accessed at http://www.cpre.org/reading-recovery-evaluation-four-year-i3-scale.