Nested Learning Systems
Nested Learning Systems
Nested Learning Systems
the present century that the concept of college readiness for all
has taken root as a serious education policy target.
Figure 1 provides a conceptual graph of the radically changed
education aspirations that characterize our present efforts to
teach 21st-century skills to virtually all American students
(cf. D. P. Resnick & Resnick, 1977). The very concept of schooling for all is only a few centuries old in Western countries. It is a
17th-century invention, born during the spread of Protestant
Christianity in Northern Europe and then taken up in Southern
Europe as part of the Catholic Reformation. In the 19th century,
basic schooling for all became a national aspiration in Europe and
North America, aimed at creating citizens and competent participants in national defense efforts. These initial mass schooling
efforts (the top left points in the graph) aimed to make high
proportions of the population literate but set a low criterion of
what counted as literacy.1 Catechism, in which individuals were
asked a set series of questions culled from specific religious texts
and were expected to provide standardized answers, was a basic
form of instruction. Participants were judged literate if they
could recite familiar texts and answer simple questions on which
they had been drilled.
As schooling became more widespread, the catechism form of
instruction moved into the lay classroom. The content changed
to include basic arithmetic, geography, history, and some science,
along with a broader range of texts for reading and writing. But
schoolroom discourse remained remarkably unchanged. Students
were assigned a text to read or a problem to work, and they were
then quizzed by the teachers with a set of questions that basically
checked on whether the students had done the assignment
(Mehan, 1979; Resnick, Wiliam, Apodaca, & Rangel, in press).
Across Europe and America, schooling became part of most
young peoples experience. But mass schooling did not even try
to engage most pupils in the kinds of knowledge-based reasoning
and problem solving that characterized elite schooling from
ancient times. This elite type of schooling became institutionalized in academies and technical institutions in the 19th and
20th centuries (see the bottom right point in the Figure 1 graph).
A sharp distinction in expectations for mass, or basic, education and what was taught to an elite minority still held in the
april 2010
183
educational Researcher
From the 1990s on, the public agenda of raising educational levels
for all has been promoted under the banner of the standards movement, often accompanied by the phrase All children can learn.
But neither term clarifies just what we have expected all children
to learn and thus what the standards ought to be. The evidence is
now pretty clear. We seem to have figured out how to teach the
basics to just about everyonewith special success in mathematics. But we are deeply unsuccessful in the rest of our 21st-century
agenda of moving beyond basic competencies to proficiency.
Figure 2 shows the National Assessment of Educational
Progress (NAEP) fourth-grade math scores over an 18-year
period spanning the end of the 20th and the beginning of the
21st centuries. The graph plots scores separately for Whites,
Blacks, and Hispanics. There has been a nearly continuous rise in
achievement scores over this period among all population groups.
The achievement gap has not closed, but it has shrunk somewhat.
In fact, and very much worth noting, Blacks and Hispanics were
doing as well in 2007 as Whites had been in 1990. The fourthgrade math gap would have closed completely if White students
had not continued to improve across the 18-year period! In
eighth-grade math, the pattern is similar (Figure 3), with Blacks
showing an especially steep rise, but a lower percentage of
students is meeting basic eighth-grade goals.
The story is less dramatic for reading, but there is evidence
that this achievement gap is shrinking somewhat as well. Over
the past 20 years, guided by a growing body of scientific research,
there has been substantially more teaching of the components of
basic literacy (phonemic awareness, phonics, vocabulary). And
this has shown up in higher first-grade scores on basic word
decoding skills (National Institute for Literacy, 2008). But by
fourth grade, when NAEP first measures reading, the focus is on
reading comprehensionunderstanding what you read. There,
the gains have been very small.
Overall, then, national achievement results suggest that as a
nation we are en route to eliminating basic illiteracy and innumeracy. The really troubling performances of the early 1990s, in
FIGURE 2. Disaggregated NAEP scores for 1990 through 2007, fourth-grade mathematics. Source: U.S. Department of Education,
Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), NAEP Data
Explorer, available online at http://nces.ed.gov/nationsreportcard.
FIGURE 3. Disaggregated NAEP Scores for 1990 through 2007, eighth-grade mathematics. Source: U.S. Department of Education,
Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), NAEP Data
Explorer, available online at http://nces.ed.gov/nationsreportcard.
which large numbers of our minority students, along with some
White children of poverty, seemed to be fundamentally illiterate
or innumerate, have changed. We are on the way to meeting our
basic education goalsand we have achieved this even as we
have absorbed growing numbers of students with limited English
proficiency into the nations schools. It appears that the standards
effort, including requirements for disaggregated test score reporting, is having the hoped-for equity effects. We are teaching basic
literacy and math to more and more of our elementary school
children, and fewer and fewer are being left way behind.
We are, however, very far from reaching the star. Proficiency
levels on the NAEP remain low, and there are very few students of
any subgroup reaching Advanced levels. Furthermore, it now seems
likely that the accountability regime that appears to be creating
much of the improvement in Basic skills may actually be limiting
progress toward the kinds of more challenging competencies we
seek. The effects of high-stakes, low-cognitive-demand tests on
185
educational Researcher
Other studies, in which multiple teachers are trained to teach science or math discursively, produce less dramatic differences in
scores but still show significant transfer effects on measures of general cognitive functioning across disciplines (e.g., Adey & Shayer,
2001; Mercer, Dawes, Wegerif, & Sams, 2004).
187
FIGURE 5. Feedback control system for a manufacturing process. Source: Modified from W. C. Turner, J. H. Mize, K. E. Case, & J. W.
Nazemetz. (1992). Introduction to industrial and systems engineering (3rd ed.). Upper Saddle River, NJ: Prentice Hall.
1990s there were attemptslargely encouraged and funded by
the American business communityto apply TQM to education
(e.g., a Malcolm Baldridge award for school systems was initiated). Key to the TQM management philosophy was that all
employeesfrom floor workers to CEOsbe engaged in seeking quality improvements and that processes as well as outputs be
measured and improved as necessary. It is odd that, just as we
have truly engaged the agenda of focusing on results, we seem to
have left behind the attention to organizational processes that is
a crucial aspect of quality management.
Engineering a Nested Learning System for
the Thinking Curriculum
The systems engineering concept of process control (Turner,
Mize, Case, & Nazemetz, 1992) provides a foundation for
organizational design that goes beyond just measuring outputs.
Originally introduced for manufacturing organizations, systems
engineering approaches have also been heavily applied to the service industry, including financial, medical, and educational organizations. A notable example of how process engineering has
focused on the values and needs of people is the redesign of hospital systemsincluding improved surgery room functionality,
reduction of errors in medical procedures and medicine distribution, improved diagnosis systems, improved scheduling to reduce
patient waiting times, and effective distribution of information
and resources to minimize hospital costs (Sahney, 1993).
Figure 5 provides a schematic of how a process control system
would work in a manufacturing setting. The production process
(circle in the bottom line of the figure) is where the fundamental
work on the product is done, using a variety of input resources
materials, people, and so forth (shown to the left of the production process circle). The quality of the end product and the
processes used to produce it are both continuously measured.
Results are compared to plans (diamond at far right), and a leadership and management team (central rectangle in the figure)
uses these measurement results (on outputs and processes) to
188
educational Researcher
FIGURE 6. Three-level conceptual model of K12 district system with process feedback. Source: L. B. Resnick, M. Besterfield-Sacre, M. M.
Mehalik, J. Z. Sherer, and E. R. Halverson. (2007). A framework for effective management of school system performance. In P. A. Moss (Ed.),
Evidence and decision making: The 106th yearbook of the National Society for the Study of Education (NSSE) (Part I, pp. 155185).
Malden, MA: Blackwell.
189
educational Researcher
new policy triangle (see Figure 8) that is beginning to guide policy designs for improved achievementalthough it is rare for
advocates or scholars to consider the three in combination.
Human Capital
Economists tend to be especially interested in human capital:
what people in the organization know and know how to do
(Harbison & Hanushek, 1992). Human capital is typically measured by credentials, performance observations, and individual
outputs (in education, student learning). Economists have related
Social Capital
Social capital is a term introduced by sociologists (Becker, 1964;
Coleman, 1988) referring to resources for action that inhere in
the relations or interactions among peoplethe opportunities
that some people have, and that organizations can create, for
acquiring knowledge and other resources through interactions
with others. Social capital is used to refer to social ties and trustful
191
educational Researcher
FIGURE 9. Coaching enhances key enablers and is constrained by district policies and practices.
policies, often mean that coaches are selected from the teaching
ranks by seniority or preference of principals rather than by demonstrated capacity to increase student learning. Coaches job
descriptions are often only vaguely specified. And, reporting usually to individual principals who do not have a developed understanding of what to expect from coaches, they are assigned to a
myriad of tasks (ranging from supervising testing, serving as substitute teachers, or providing personal teaching to underperforming students) and do not have the opportunity to develop a
systematic coaching relationship with teachers. Figure 9 also
illustrates how the quality of coaching in a school district is
dependent on a large set of policies and practices (those to the left
of the coaching diamond in Figure 9) that are heavily influenced
by the district central office.
In our study of CFC, we enacted a carefully focused program
of coaching in upper elementary classrooms teaching reading
comprehension (Matsumura, Sartoris, Bickel, & Garnier, 2009).
The program used to train coaches had been developed over
several years at the University of Pittsburghs Institute for
Learning (Bickel & Artz, 2001). We worked with district administrators to select demonstrably successful reading teachers to be
trained as coaches. We also worked with school principals to
develop agreements that would make it probable that coaches
assigned to their schools would be scheduled for regular meetings
with subgroups of teachers, would be allowed to make classroom
visits to individual teachers, and would not have competing work
assignments (Matsumura et al., 2009).
Twenty-nine of the lowest performing elementary schools, all
with high proportions of English language learners, were randomly assigned to either the CFC or a comparison condition.
Teachers and principals in both sets of schools responded to periodic surveys and interviews. There were systematic observations
of classroom text discussions and recording of the complexity of
the texts being used in instruction. Students reading test scores
on the state accountability tests were tracked over several years.
Teachers in the CFC intervention schools significantly
increased participation in coaching focused directly on classroom practice. The quality of the text discussions in their classrooms improved: The classes read more difficult texts, they
193
educational Researcher
Adler, P. S., & Kwon, S. (2002). Social capital: Prospects for a new concept. Academy of Management Review, 27, 1740.
Allison, G. T. (1971). Essence of decision. New York: Little, Brown.
Ball, D. L. & Lampert, M. (1998). Multiples of evidence, time, and
perspective: Revising the study of teaching and learning. In E. C.
Lagemann & L. S. Shulman (Eds.), Issues in education research:
Problems and possibilities (pp. 371398). San Francisco: Jossey Bass.
Beck, I. L., & McKeown, M. G. (2002). Questioning the author:
Making sense of social studies. Educational Leadership, 60(3), 4447.
Becker, H. (1964). Against the code of ethics. American Sociological
Review, 29, 409410.
Berliner, D. C. (2006). Educational psychology: Searching for essence
throughout a century of influence. In P. A. Alexander & P. H. Winne
(Eds.), Handbook of educational psychology (2nd ed., pp. 327).
Mahwah, NJ: Lawrence Erlbaum.
Bickel, D. D., & Artz, N. J. (2001, August). Implementing content-focused
coaching as part of a district-wide reform effort. Paper presented at the
biannual meeting of the European Association for Research on
Learning and Instruction (EARLI), Fribourg, Switzerland.
Bill, V. L., Leer, M. N., Reams, L. E., & Resnick, L. B. (1992). From
cupcakes to equations: The structure of discourse in a primary mathematics education classroom. Verbum, 15(1), 6385.
Boyd, D., Grossman, P., Lankford, H., Loeb, S., & Wyckoff, J. (2006).
How changes in entry requirements alter the teacher workforce and affect
student achievement. Education Finance and Policy, 1(2), 176216.
Boyd, D., Grossman, P., Lankford, H., Loeb, S., & Wyckoff, J. (2008,
September). Teacher preparation and student achievement (NBER
Working Paper No. W14314). Cambridge, MA: National Bureau of
Economic Research. Available at http://ssrn.com/abstract=1264576.
Brown, J. S., & Duguid, P. (2000). The social life of information.
Cambridge, MA: Harvard Business School Press.
Bryk, A. S., & Schneider, B. L. (2003). Trust in schools: A core resource for
improvement. New York: Russell Sage Foundation.
Carroll, J. B. (1963). A model of school learning. Teachers College Record,
64, 723733.
Carroll, J. B. (1989) The Carroll model: A 25-year retrospective and
prospective view. Educational Researcher, 18(1), 2631.
Center on Education Policy. (2008). Instructional time in elementary schools:
A closer look at changes for specific subjects. Washington, DC: Author.
Chi, M. T. (2000). Self-explaining expository texts: The dual processes
of generating inferences and repairing mental models. In R. Glaser
(Ed.), Advances in instructional psychology (pp. 161238). Mahwah,
NJ: Lawrence Erlbaum Associates.
Clark, R. M., Sherer, J. Z., Besterfield-Sacre, M., & Resnick, L. (2007,
April). Combining expert directed graphs of the K12 educational system.
Paper presented at the American Educational Research Association
Annual Meeting, Chicago, Illinois.
Clotfelter, C. T., Ladd, H. F., & Vigdor, J. L. (2007). How and why do
teacher credentials matter for student achievement? (NBER Working
Paper No. 12828). Cambridge, MA: National Bureau of Economic
Research.
Cohen, M. D., & Bacdayan, P. (1994). Organizational routines are
stored as procedural memory: Evidence from a laboratory study.
Organizational Science, 5, 554568.
Cohen, D. K., & Hill, H. (2000). Instructional policy and classroom
performance: The mathematics reform in California. Teachers College
Record, 102, 294343.
Coleman, J. S. (1988). Social capital in the creation of human capital.
American Journal of Sociology, 94, S95S120.
Correnti, R., & Rowan, B. (2007). Opening up the black box:
Literacy instruction in schools participating in three comprehensive school reform programs. American Educational Research
Journal, 44, 298338.
april 2010
195
Darling-Hammond, L., & Bransford, J. (Eds.). (2005). Preparing teachers for a changing world: What teachers should learn and be able to do.
San Francisco: Jossey-Bass.
David, J. L., & Greene, D. (2008). Improving mathematics instruction in
Los Angeles high schools: Follow up to the evaluation of the PRISMA Pilot
Program. Palo Alto, CA: Bay Area Research Group.
Davis, L. E. (1982). Organizational design. In G. Salvendy (Ed.),
Handbook of industrial engineering (pp. 2.1.12.1.29). New York:
John Wiley.
Dweck, C. S., & Molden, D. C. (2005). Self-theories: Their impact on
competence motivation and acquisition. In A. Elliot & C. Dweck
(Eds.) Handbook of competence and motivation (pp. 122140). New
York: Guilford.
Feldman, M. S. (2000). Organizational routines as a source of continuous change. Organization Science, 11, 611629.
Feldman, M. S., & Pentland, B. T. (2003). Reconceptualizing organizational routines as a source of flexibility and change. Administrative
Science Quarterly, 48, 94118.
Frank, K. A., Zhao, Y., & Borman, K. (2004). Social capital and the
diffusion of innovations within organizations: The case of computer
technology in schools. Sociology of Education, 77, 148171.
Gamoran, A., Anderson, C. W., Quiroz, P. A., Secada, W. G., Williams,
T., & Ashmann, S. (2003). Transforming teaching in math and science:
How schools and districts can support change. New York: Teachers
College Press.
Gersick, G. J., & Hackman, J. R. (1990). Habitual routines in taskperforming groups. Organizational Behavior and Human Decision
Process, 47, 6597.
Grossman, P., & McDonald, M. (2008). Back to the future: Directions
for research in teaching and teacher education. American Educational
Research Journal, 45, 184205.
Harbison, R., & Hanushek, E. (1992). Educational performance for the poor:
Lesson from rural northeast Brazil. Oxford, UK: Oxford University Press.
Hertzberg, H. (1988). Foundations. The 1982 Committee of Ten. Social
Education, 52(2), 4445.
Hill, H., Rowan, B., & Ball, D. (2005). Effects of teachers mathematic
knowledge for teaching on student achievement. American Educational
Research Journal, 42, 371406.
Jaeger, R. M., & Tittle, C. K. (1980). Minimum competency testing:
Motives, models, measures and consequences. Berkeley, CA: McCutchan.
Johnson, R. T., & Johnson, D. W. (1986). Action research: Cooperative
learning in the science classroom. Science and Children, 24, 3132.
Koretz, D., & Hamilton, L. (2006). Testing for accountability in K12.
In R. L. Brennan (Ed.), Educational measurement (5th ed., pp. 531
578). Westport, CT: American Council on Education/Praeger.
Lampert, M. (2001). Teaching problems and the problems of teaching.
New Haven, CT: Yale University Press.
Lampert, M., & Ball, D. (1998). Teaching, multimedia, and mathematics:
Investigations of real practice. New York: Teachers College Press.
Leana, C., & Pil, F. (2009). Applying organizational research to public
school reform: The effects of teacher human and social capital on
student performance. Academy of Management Journal.
Loeb, S., Darling-Hammond, L., & Luczak, J. (2005). How teaching
conditions predict teacher turnover in California schools. Peabody
Journal of Education, 80(3), 4470.
March, J. G. (1981). Footnotes to organizational change. Administrative
Science Quarterly, 26, 563577.
March, J. G., & Simon, H. A. (1958). Organizations. New York: John Wiley.
March, J. G., & Simon, H. A. (with H. Guetzkow). (1993). Organizations
(2nd ed.). Cambridge, MA: Blackwell.
Matsumura, L. C., Garnier, H., & Resnick, L. B. (in press). Implementing
literacy coaching: The role of school social resources. Educational
Evaluation and Policy Analysis.
196
educational Researcher
Stigler, J., & Hiebert, J. (1999). The teaching gap: Best ideas from the
worlds teachers for improving education in the classroom. New York:
Free Press.
Suchman, L. (1996). Constituting shared workspaces. In. Y. Engestrm
& D. Middleton (Eds.), Cognition and communication at work
(pp. 3560). Cambridge, UK: Cambridge University Press.
Talbert, J. E., David, J. L., with Lin, W. (2008, September). Evaluation
of the Disciplinary Literacy-Professional Learning Community (DL-PLC)
Initiative in Austin Independent School District. Final Report. Palo Alto,
CA: Center for Research on the Content of Teaching, Stanford
University.
Thorndike, E. L. (1932). Fundamentals of learning. New York: Teachers
College, Columbia University.
Turner, W. C., Mize, J. H., Case, K. E., & Nazemetz, J. W. (1992).
Introduction to industrial and systems engineering (3rd ed.). Upper
Saddle River, NJ: Prentice Hall.
Tyack, D. B. (1974). The one best system: A history of American urban
education. Cambridge, MA: Harvard University Press.
AUTHOR
april 2010
197