Papers by Nancy Scammacca Lewis
Review of Educational Research, 2016
The history of research on interventions for struggling readers in Grades 4 through 12 dates back... more The history of research on interventions for struggling readers in Grades 4 through 12 dates back to 19th-century case studies of seemingly intelligent children who were unable to learn to read. Physicians, psychologists, educators, and others were determined to help them. In the process, they launched a century of research on a wide variety of approaches to reading intervention. As shown in this systematic narrative review, much has changed over time in the conceptualization of reading interventions and the methods used to determine their efficacy in improving outcomes for struggling readers. Building on the knowledge gathered over the past 100 years, researchers and practitioners are well-poised to continue to make progress in developing and testing reading interventions over the next 100 years.
Journal of Educational Psychology
Despite focused efforts, achievement gaps remain a problem in the America's education system,... more Despite focused efforts, achievement gaps remain a problem in the America's education system, especially those between students from higher and lower income families. Continued work on reducing these gaps benefits from an understanding of students' reading and math growth from typical school instruction and how growth differs based on initial proficiency, grade, and demographic characteristics. Data from 5,900 students in Grades 1-5 tested in math and reading at six points across two years were analyzed using cohort-sequential latent growth curve models to determine longitudinal growth patterns. Results indicated that students with low initial proficiency grew more quickly than students with higher proficiency. However, after two school years their achievement remained below average and well below that of students with higher initial proficiency. Demographic characteristics had small but significant effects on initial score and growth rates.
Review of Educational Research, 2017
The history of research on interventions for struggling readers in Grades 4 through 12 dates back... more The history of research on interventions for struggling readers in Grades 4 through 12 dates back to 19th-century case studies of seemingly intelligent children who were unable to learn to read. Physicians, psychologists, educators , and others were determined to help them. In the process, they launched a century of research on a wide variety of approaches to reading intervention. As shown in this systematic narrative review, much has changed over time in the conceptualization of reading interventions and the methods used to determine their efficacy in improving outcomes for struggling readers. Building on the knowledge gathered over the past 100 years, researchers and practitioners are well-poised to continue to make progress in developing and testing reading interventions over the next 100 years.
Review of Educational Research, 2013
Previous research has shown that treating dependent effect sizes as independent inflates the vari... more Previous research has shown that treating dependent effect sizes as independent inflates the variance of the mean effect size and introduces bias by giving studies with more effect sizes more weight in the meta-analysis. This article summarizes the different approaches to handling dependence that have been advocated by methodologists, some of which are more feasible to implement with education research studies than others. A case study using effect sizes from a recent meta-analysis of reading interventions is presented to compare the results obtained from different approaches to dealing with dependence. Overall, mean effect sizes and variance estimates were found to be similar, but estimates of indexes of heterogeneity varied. Meta-analysts are advised to explore the effect of the method of handling dependence on the heterogeneity estimates before conducting moderator analyses and to choose the approach to dependence that is best suited to their research question and their data set.
This meta-analysis synthesizes the literature on interventions for struggling readers in Grades 4... more This meta-analysis synthesizes the literature on interventions for struggling readers in Grades 4 through 12 published between 1980 and 2011. It updates Scammacca et al.'s analysis of studies published between 1980 and 2004. The combined corpus of 82 study-wise effect sizes was meta-analyzed to determine (a) the overall effectiveness of reading interventions studied over the past 30 years, (b) how the magnitude of the effect varies based on student, intervention, and research design characteristics, and (c) what differences in effectiveness exist between more recent interventions and older ones. The analysis yielded a mean effect of 0.49, considerably smaller than the 0.95 mean effect reported in 2007. The mean effect for standardized measures was 0.21, also much smaller than the 0.42 mean effect reported in 2007. The mean effects for reading comprehension measures were similarly diminished. Results indicated that the mean effects for the 1980-2004 and 2005-2011 groups of studies were different to a statistically significant degree. The decline in effect sizes over time is attributed at least in part to increased use of standardized measures, more rigorous and complex research designs, differences in participant characteristics, and improvements in the school's "business-as-usual" instruction that often serves as the comparison condition in intervention studies.
Journal of Research on Educational Effectiveness
Effect sizes are commonly reported for the results of educational interventions. However, researc... more Effect sizes are commonly reported for the results of educational interventions. However, researchers struggle with interpreting their magnitude in a way that transcends generic guidelines. Effect sizes can be interpreted in a meaningful context by benchmarking them against typical growth for students in the normative distribution. Such benchmarks are not currently available for students in the bottom quartile. This report remedies this by providing a comparative context for interventions involving these students. Annual growth effect sizes for K-12 students were computed from nationally normed assessments and a longitudinal study of students in special education. They reveal declining growth over time, especially for reading and math. These results allow researchers to better interpret the effects of their interventions and help practitioners by quantifying typical growth for struggling students. More longitudinal research is needed to show growth trajectories for students in the bottom quartile.
Review of Educational Research, 2013
ABSTRACT
Journal of Learning Disabilities, 2012
The authors report the effects of a yearlong, very small-group, intensive reading intervention fo... more The authors report the effects of a yearlong, very small-group, intensive reading intervention for eighth-grade students with serious reading difficulties who had demonstrated low response to intervention (RTI) in both Grades 6 and 7. At the beginning of Grade 6, a cohort of students identified as having reading difficulties were randomized to treatment or comparison conditions. Treatment group students received researcher-provided reading intervention in Grade 6, which continued in Grade 7 for those with low response to intervention; comparison students received no researcher-provided intervention. Participants in the Grade 8 study were members of the original treatment (N = 28) and comparison (N = 13) conditions who had failed to pass a state-mandated reading comprehension test in both Grades 6 and 7. In Grade 8, treatment group students received a 50-minute, daily, individualized, intensive reading intervention in groups of two to four students per teacher. The results showed that students in the treatment condition demonstrated significantly higher scores than comparison students on standardized measures of comprehension (effect size = 1.20) and word identification (effect size = 0.49), although most continued to lack grade-level proficiency in reading despite 3 years of intervention. Findings from this study provide a rationale for intensive intervention for middle school students with severe reading difficulties.
Previous research has shown that treating dependent effect sizes as independent inflates the vari... more Previous research has shown that treating dependent effect sizes as independent inflates the variance of the mean effect size and introduces bias by giving studies with more effect sizes more weight in the meta-analysis. This article summarizes the different approaches to handling dependence that have been advocated by methodologists, some of which are more feasible to implement with education research studies than others. A case study using effect sizes from a recent meta-analysis of reading interventions is presented to compare the results obtained from different approaches to dealing with dependence. Overall, mean effect sizes and variance estimates were found to be similar, but estimates of indexes of heterogeneity varied. Meta-analysts are advised to explore the effect of the method of handling dependence on the heterogeneity estimates before conducting moderator analyses and to choose the approach to dependence that is best suited to their research question and their data set.
Educational Psychology Review, 2015
This meta-analysis extends previous work on extensive Tier 3 type reading interventions (Wanzek a... more This meta-analysis extends previous work on extensive Tier 3 type reading interventions (Wanzek and Vaughn School Psychology Review, 36, 541-561, 2007; Wanzek et al. Review of Educational Research, 83, 163-195, 2013) to Tier 2 type interventions by examining a non-overlapping set of studies addressing the effects of less extensive reading interventions for students with or at risk for reading difficulties in Grades K-3. We examined the overall effects of these interventions on students' foundational skills, language, and comprehension as well as the intervention features that may be associated with improved outcomes. We conducted four meta-analyses on 72 studies to examine effects on (1) standardized foundational skill measures (mean ES=0.54), (2) not-standardized foundational skill measures (mean ES=0.62), (3) standardized language/comprehension measures (mean ES= 0.36), and (4) not-standardized language/comprehension measures (mean ES=1.02). There were no differences in effects related to intervention type, instructional group size, grade level, intervention implementer, or the number of intervention hours.
Promoting Acceleration of Comprehension and Content through Text (PACT) and similar team-based mo... more Promoting Acceleration of Comprehension and Content through Text (PACT) and similar team-based models directly engage and support students in learning situations that require cognitive elaboration as part of the processing of new information. Elaboration is subject to metacognitive control, as well (Karpicke, Journal of Experimental Psychology: General 138(4):469–485, 2009)—successful learners use metacognitive elaborative rehearsal to process and make sense of incoming information even in the absence of structured opportunities or instructional prompts for elaborating. Levels of processing and cognitive load theories suggest that students in PACT classrooms may outperform students in comparison classes because PACT engages and supports deep cognitive processing (via elaboration and discussion) at the time of learning, allowing participants to better conserve and more consis- tently reallocate cognitive and metacognitive resources (compared to students in the non- treated group) for encoding content. In other words, PACT may moderate the relationship of metacognitive elaborative rehearsal and content retrieval. Extant data from years 1 (n=419) and 2 (n=704) of the PACT/RFU project suggests such an effect. As hypothesized, there were no mean differences in reported metacognitive rehearsal use across the groups because metacognitive elaborative rehearsal was not taught. However, regression coefficients for content recall on metacognitive elaboration were greater in the treatment group in both samples suggesting that an instructional emphasis on deep processing leads to better content recall. The findings are discussed in the context of the Common Core State Standards and the large-scale testing programs in place currently across the USA.
Uploads
Papers by Nancy Scammacca Lewis