Social Studies Simulations - Brown
Social Studies Simulations - Brown
Social Studies Simulations - Brown
Hunter Gehlbach
Harvard University
University of Connecticut
Hunter Gehlbach
[email protected]
W: (617) 496-7318
Fax: (617) 495-9268
1
INCREASING INTEREST IN SOCIAL STUDIES
Abstract:
school social studies classrooms. Using a pre-post design, we examined 305 middle school
students (49% female) who participated in the web-based GlobalEd simulation. Unlike the
why these increases may have occurred. We found no support for the possibility that, (a)
students interest in a particular issue area or (b) their increased valuing of the subject
matter, were related to their increased interest. However, results suggested that, (c) the
challenging nature of the activity may have bolstered their interest in social studies and (d)
explores future research directions and whether implications for classroom teachers are
2
INCREASING INTEREST IN SOCIAL STUDIES
For many secondary school teachers, sparking student interest in their particular
discipline can be a Herculean challenge. The magnitude of this challenge is greater for
some teachers than for others. For social studies teachers, students often perceive their
subject matter as less interesting and important than other school subjects (Stodolsky, Salk,
& Glaessner, 1991; Wolters & Pintrich, 1998). These perceptions are likely exacerbated
by teachers attempting to cover a vast amount of content at a necessarily superficial level
(VanSledright & Limon, 2006). Specifically, when teachers try to cover so much so
quickly (perhaps because of pressure from the No Child Left Behind program and
standardized testing), very few issues come alive or seem personally relevant. Even in the
best cases, students will likely find themselves engaged in learning about others opinions
regarding history, geography, politics, and economics rather than developing their own
narratives and explanations. Thus, students may also find social studies uninteresting and
unimportant because they rarely have the opportunity to actively engage in the doing of
social science (Kobrin, Abbott, Ellinwood, & Horton, 1993).
Motivating student interest can be equally challenging for middle school teachers.
Eccles et al. (1993) describe early adolescents as being particularly at risk for decreases in
motivation as they enter and advance through the middle school or junior high grades. A
diverse body of research indicates that studies of interest parallel this larger trend. Using a
cross sectional approach with 4th 12th graders, Epstein and McPartland (1976) found that
there was a significant, negative relationship between interest and grade level. In a
longitudinal approach, focused only on junior high students, Pintrich (2000) found that
students task value for math class (operationalized by a scale consisting of interest and
utility value items) declined during eighth grade. This decline appears to occur outside the
United States as well. In a sample of Australian middle and high school students, Watt
(2004) found that students intrinsic valuing of math and English declined during middle
school as did their perceptions of the utility value of these subjects. There is also evidence
that this trend generalizes across different conceptions of interest. Using a
3
INCREASING INTEREST IN SOCIAL STUDIES
In this article, we first describe some of the past work on simulations. Then we
detail the specifics and procedures of the GlobalEd simulation. Next, we offer some
theoretical explanations as to why simulations might effectively motivate interest in social
studies for middle school students. We conclude the introductory section by presenting the
four specific hypotheses related to the second research question that we tested.
Past research on simulations
Simulations have long been perceived as activities that facilitate student learning
and motivation. However, two major questions arise for secondary school social studies
teachers thinking about implementing simulations. First, will the findings from past
simulation research will generalize across settings? Much of the research documenting the
success of simulations has come from higher education or from science classrooms.
4
INCREASING INTEREST IN SOCIAL STUDIES
Whether these findings extend to different age groups or different subject matters is
unclear. Second, will the results of smaller case studies be replicated for a larger
quantitative study? Although some evaluations of simulations have looked at student
learning in a rigorous and systematic way, most of the assessments of simulations impact
on student motivation have been anecdotal.
Lay and Smarick (2006) provide an illustrative case of a successful simulation at
the higher education level. They assessed the effectiveness of a U.S. Senate simulation as
a tool for college students learning about American politics. The goal of the simulation was
to have students experience law-making procedures so that they better understood the
process and appreciated the institutions at the core of the U.S. political system. Their
evaluation of the simulation used pre- and post-measures of knowledge and attitudes to
compare two introductory American Government classes. One class utilized traditional
teaching methods such as lectures and tests, while the other supplemented these traditional
methods with the online simulation. They found that students who participated in the
simulation gained more knowledge, became less cynical, and became more confident about
their knowledge of the legislative process as compared to their peers in the traditional
class.
In secondary school science, the River City simulation (Dede, Clarke, Ketelhut,
Nelson, & Bowman, 2005) stands out as exemplary both in its content and in the
evaluation of the simulation. River City employs a multi-user, virtual environment.
Learners actively investigate complex, real-world problems and interact with novices and
experts who are part of the environment to facilitate their problem-solving. Specifically,
students work in teams to find out why River Citys citizens are plagued by various
illnesses. Several experiments from Dede and his colleagues showed that River City
participants learn standards-based biological content and complex inquiry skills better than
students receiving other good traditional approaches. In terms of motivation, findings also
indicate that students and teachers in River City classrooms are highly engaged, student
self-efficacy increases, student attendance improves, and disruptive student behavior drops
(Dede et al., 2005).
Although these examples provide solid evidence that simulations can be effective
tools for learning and motivational outcomes, it is not clear whether these findings
5
INCREASING INTEREST IN SOCIAL STUDIES
6
INCREASING INTEREST IN SOCIAL STUDIES
7
INCREASING INTEREST IN SOCIAL STUDIES
Security Council Reform. Although the broad topical areas stay consistent from year to
year, the specific topics vary depending on current hot topics in world affairs and
feedback from the teachers about how well different issues worked in their classrooms in
previous years.
In the weeks leading up to the simulation, students research their countries and
issue area. During the simulation, they interact through synchronous live chat
conferences and through asynchronous email correspondences. Students communicate
with representatives from the other countries who are focused on the same issue area.
For example, the Chinese Human Rights group might communicate with Human Rights
groups from Brazil, England, and Kenya. Each group strives to make agreements or
treaties with other countries in the simulation. It is student engagement in this negotiation
process, rather than the creation of specific formal agreements, that is the main goal of
the simulation. These communications are moderated by a simulation controller
(SIMCON). SIMCON monitors the civility of the student interactions and ensures that
countries do not make agreements prematurely, i.e., without thinking through all of the
issues involved. In addition, SIMCON ensures that the representatives of different
countries remain true to their roles. Unbeknownst to the middle school students, the
United States is played by a research assistant working on the project, thus, all students
have to engage in taking the perspective of a foreign country.
8
INCREASING INTEREST IN SOCIAL STUDIES
For the present study, we have adopted this conception of interest with the
following caveat. According to Hidi and Renninger, situational and individual interest are
always motivating. Other motivational theories present interest as a component of
motivation but imply that interest alone will not result in motivation. For example, in
Fords (1992) theory, motivation consists of goals, emotions, and personal agency beliefs.
Interest may play a role in guiding the selection of certain goals that students might pursue
or in helping generate the emotion and energy for students to pursue such goals. However,
in Fords conception, one can be interested in a domain without setting goals to pursue that
domain. Consequently, one can be interested without being motivated. In Eccles-Parsons
et al. (1983) expectancy-value theory, motivation consists of students expectations for
success on a given task and their valuing of that task. In this approach, interest is one of
four types of task value: intrinsic/interest value, attainment value, utility value, and cost.
This approach also allows one to be interested in a domain without being motivated to
pursue goals in that domain (e.g., if one is interested but does not expect success).
Although these scholars maintain differing perspectives as to whether interest will
necessarily result in motivation, they would likely concur that increasing students interest
in subjects such as social studies is a desirable outcome. Thus, for our purposes, we
conceptualize interest similarly to Hidi and Renninger (2006) and view it as a desirable
outcome in its own right. However, we view it as a key component of student motivation
rather than as a psychological state that is necessarily motivating. This section explores
four possibilities for how simulations might impact students interest in social studies.
As indicated above, Hidi and Renningers (2006) four-phase model focuses on the
transition from interest being supported by aspects of the situation to being sustained by
the individual. As students interest in a particular content area progresses towards
individual interest, knowledge becomes increasingly important and can often perpetuate
the development of interest. For example, as students become interested in a particular
content, they may begin to ask more self-generated questions out of curiosity. Answers to
these curiosity questions help students become more knowledgeable, which in turn might
raise new curiosities. It seems plausible that the GlobalEd simulation might facilitate
students interest in social studies because students develop a particular area of expertise
through research on their issue area. For example, as students become more
9
INCREASING INTEREST IN SOCIAL STUDIES
knowledgeable about Russias role in the U.N. Security Council, they might become more
curious about how it evolved. This interplay between curiosity and knowledge may help
students interest become more internalized and may help their interest generalize to other
domains. For example, if these feelings extend from their particular research topic to
related areas it seems possible that students could become more interested in social studies.
In Eccles-Parsons et al. (1983), previously-mentioned expectancy-value theory,
students valuing of a specific task depends on their perceptions of the tasks
intrinsic/interest value, attainment value, utility value, and cost. Other scholars have
conceptualized importance as a sub-component of interest (Schiefele, 1996). Thus,
students interest in a particular subject matter and their view of its importance are
intimately related. Interest and importance are, however, conceptually distinct. Students
might view one subject as interesting but not very important (e.g., an elective class), while
another (perhaps math) might be seen as important but uninteresting. In the GlobalEd
simulation, students may find themselves reassessing the importance of social studies and
becoming more interested as a result. Although social studies has traditionally been
viewed by students as unimportant (Stodolsky et al., 1991), it seems reasonable to think
that as students apply their issue area knowledge and negotiate about current world issues,
they may come to see social studies as increasingly important and relevant to their personal
lives. As social psychologists have shown through research on the self-reference effect,
people are particularly attuned to self-relevant information (Symons & Johnson, 1997).
According to Fords (1992) theory of motivation, the principle of optimal challenge
states that, motivation is maximized under conditions of optimal challenge that is,
conditions in which standards for goal attainment are difficult given the persons current
level of expertise, but still attainable with vigorous or persistent effort (p. 211-2). This
idea follows from Whites (1959) notion that we need an optimal amount of stimulation or
an optimal level of arousal to perform well on a task (see also Csikszentmihalyi, 1991). If
we are completely confident in our ability to succeed on a task, we will normally be
unmotivated to attempt it; completing the task will merely confirm that we could succeed
on the task (which we already knew). However, for optimally challenging tasks where we
are necessarily less confident in the future outcome, we are more motivated because
succeeding (or failing) on these tasks provides us with information that helps us learn. A
10
INCREASING INTEREST IN SOCIAL STUDIES
simulation such as GlobalEd could potentially present more of an optimal challenge for
most middle school students than their usual schoolwork, which often consists of
cognitively unchallenging, uncreative tasks (Eccles et al., 1993). Thus, although students
might be less confident about their ability to succeed in the simulation activities, these
more challenging tasks might bolster their interest in their social studies class.
A final possibility emerges from a group of historians who have conducted
simulations with secondary school students. Pace et al., (1990) were attracted to the
perspective taking aspect of the role-playing required for their simulation of the Cuban
Missile Crisis. Specifically, their students had to wrestle with different perspectives in
different ways. As representatives of a nation, students came into conflict with the
ideologies of the representatives of other nations. In addition, they had to contend with the
internal politics of each of the nations involved and had to negotiate the differing points of
view of their peers. Thus, students in this simulation had to frequently engage in social
perspective taking (SPT) i.e., they had to discern the thoughts and emotions of others and
often had to assess others perceptions of the situation. The authors intuited that the need to
engage in SPT regularly for students in their simulation might be particularly motivating.
For middle school students, the opportunities to regularly engage in SPT may be
particularly valued. Students at this developmental stage have recently developed the
capacity to engage in thinking about the mental worlds of others at a sophisticated level
(Keating, 1990) and are often engaged in trying to figure out what their classmates think
about them (Eccles et al., 1993). Because GlobalEd also offers intense and protracted
perspective taking opportunities, we hypothesized that students might become similarly
interested in social studies. In other words, if SPT is particularly interesting to middle
school students, and students come to see social studies as a setting that encourages and
rewards SPT, students may become more interested in the discipline.
Hypotheses
The first research question that guides this study examines the extent to which
students interest in social studies changes over the course of this simulation. In addition,
it is sensible to investigate whether changes in interest occurred differentially for males
versus females, older versus younger students, or for students of different races. These
11
INCREASING INTEREST IN SOCIAL STUDIES
sub-group analyses might help shed light on whether the simulation is particularly
effective or ineffective for different groups of students.
The second research question asks why these changes may have occurred.
Specifically, we test four hypotheses that follow directly from the aforementioned
explanations as to how the GlobalEd simulation might impact students interest:
1) Students become more interested in the specific topic that they research during
the simulation. As students research a particular issue area in depth, they become more
knowledgeable and curious about that area, which, in turn, generalizes to more overall
interest in social studies.
2) Because of their experience in the simulation, students view social studies as
more important. Through the simulation, students see how social studies is actually
enacted in the real world, develop a new appreciation of how important it is, and
consequently, become more interested in it.
3) Through the simulation, students realize that social studies is more challenging
than they had originally thought. In contrast to a subject like mathematics, students have
not viewed social studies as a challenging discipline (Stodolsky et al., 1991). By engaging
in the challenging problem-solving activities of the simulation, students begin to perceive
social studies as an optimally challenging, and therefore more interesting, subject.
4) Students engage in SPT more frequently during the simulation. The simulation
encourages them to engage in a type of thinking that is different from their regular class,
but that they are intrinsically motivated to develop. As students begin to perceive social
studies class as a venue in which they can continue developing SPT, they become more
interested in the discipline.
Method
Participants. Students from 19 schools located throughout the United States
participated in the study. Most schools in the sample were near the national average in
their achievement level and socio-economic status. Participants (N = 305) included a
balanced proportion of males (51%) and females. White students (73%) made up the
majority of the sample; Asians (10%), African-Americans (8%), and Latinos (5%)
comprised the other major groups in this sample. Eighth graders (61%) comprised the
majority of the participants, followed by 7th graders (27%), 6th graders (9%), and 5th
12
INCREASING INTEREST IN SOCIAL STUDIES
graders (3%). In using race and grade-level as variables in our analyses, we collapsed the
former into two categories (white and non-white) and the latter into three categories
(by combining the 5th and 6th graders). These aggregations allowed for a sufficient n to
potentially detect between-group differences.
Measures. In addition to demographic variables, the measures included pre- and
post- assessments for interest in social studies, interest in issue area, importance of social
studies, self-efficacy in social studies, and SPT (see the Appendix). A multiple choice test
of content knowledge covering the social studies material that students were studying
during the simulation was also given to students prior to and after the simulation.
For our main dependent measure, we developed a measure of interest to be
congruent with Hidi and Renningers (2006) theory. Some items tapped students interest
in social studies when it was likely sparked by the classroom situation (e.g., item 4), while
others examined instances when students individual interest persisted beyond that context
(e.g., item 2). The scale also included general items such as Overall, how interesting do
you find your social studies class? Thus, students scoring highly across all six items on
the Interest in social studies scale ( = .85 for pre and .87 for post) should be more
developed in terms of their interest in social studies.
Our first independent measure, students Interest in issue area (i.e., the topic they
focused on in the simulation) assessed students relative interest in their topic by asking
them to rank order all five topics from most interesting (1) to least interesting (5).
Importance of social studies was assessed by having students rank how important they
perceived social studies to be relative to English, math, and science from most important
(1) to least important (4). Social studies self-efficacy was a 5-item rating scale ( = .79 for
pre and .82 for post) that assessed how confident students were that they could meet the
expectations of the class; for example, How confident are you that you can learn all the
material presented in this class? This measure represents an adaptation of the Midgley et
al. (2000) academic efficacy scale. SPT was a 7-item rating scale ( = .88 for pre and
post) adapted from Davis (1996) scale that asked students to assess how frequently they
tried to figure out the thoughts and feelings of others. Items included, Before criticizing
others, how often do you imagine how you would feel if you were in their place?
13
INCREASING INTEREST IN SOCIAL STUDIES
The multiple choice test had reliability estimates of = .53 for pre and .72 for post.
It included questions such as Global warming is most often blamed on: (Industrialization
byproducts, Deforestation, The burning of fossil fuels, All of the above).
Procedures. Teachers were initially recruited to participate in GlobalEd
simulations several years before this evaluation began and have continued to participate
annually on a voluntary basis. New teachers who learn about the simulation through
colleagues or the website have also joined on a voluntary basis. The curriculum that
students use to educate themselves about their country and issue area is posted online at
www.xxxxx.globaled.edu. Thus, students are all exposed to the same basic material
(though some students may pursue additional sources on their own), including an extensive
on-line research library and a simulation scenario that lays out the fundamental problems
in each issue area. The scenario deals with real-world issues and is set about six months
into the future to prevent students from playing out the newspaper. Students completed
the assessment instruments online as they began researching for the simulation and within
two weeks of the simulations conclusion. They research their topics for approximately 6-
8 weeks prior to the start of the simulation. Once the simulation begins, student groups
send messages at their convenience and/or as assigned by their teacher. Each issue group
participates in two synchronous, issue-specific conferences during the simulation. All
countries, and the issue-groups within them, take part in a debriefing conference after the
simulation is complete.
During the simulation period the email correspondences allow students to negotiate
over the issues laid out in the simulation scenario. During this process, they must work
within their issue groups to decide their countrys policy and discuss responses to
proposals from other countries. In addition, they also negotiate within their country-teams
to establish coherence across issue areas. For example, students working on Indias human
rights policy must coordinate with their classmates working on Indias environmental
policy. In this way, the students are engaged in two-level negotiations (i.e., within their
country-team and across country-teams) throughout the simulation period (see Putnam,
1988). Synchronous conferences are held to simulate face-to-face diplomatic interactions
and compress the interactions into hour-long chats facilitated by SIMCON.
14
INCREASING INTEREST IN SOCIAL STUDIES
Results
To address our first research question, we determined the nature and magnitude of
the change in interest that students experienced. On the 5-point scale mentioned above,
students interest in social studies increased significantly from pre (M = 3.34) to post (M =
3.50; t(191) = 3.82, p < .001; Cohens d = .21). This increase did not appear to be the result
of a small group of particular teachers as students in all but one classroom experienced a
gain in interest (see Figure 1). To probe this result further, three repeated measures
ANOVAs were conducted while including different factors (specifically gender, race, and
grade level) to examine whether this increase in interest occurred differentially for
different subpopulations. No evidence of gender differences (F1, 190) = 1.53, p = .22)
emerged. The change in interest was the same for students of different races and grade
levels. However, non-white students (F1, 190) = 5.46, p = .02; partial2 = .03) and students in
younger grades (F3, 186) = 10.07, p < .01; partial2 = .14) were more interested at both pre-
and post. In other words, there was a slight main effect for race and grade-level, but no
interaction effects emerged. In sum, students interest in social studies increased
significantly from pre to post; although some subgroups were more interested than others
at the outset, all subgroups became more interested by the end of the simulation.
[INSERT FIGURE 1 ABOUT HERE]
15
INCREASING INTEREST IN SOCIAL STUDIES
We posed four hypotheses as to why this change in interest might have occurred.
First, it appeared that students might become more interested in social studies because they
became particularly engaged with their issue area. The descriptive statistics in Table 1
indicate that at the time of the initial assessment, students were more interested in their
issue area than the other topics. However, by the end of the simulation, students for all
five topic areas were less interested in their topic than they had been at the start of the
simulation. In other words, while there was a significant increase in interest in social
studies overall, students were actually becoming less interested in their specific issue area.
Thus, we found no evidence to support first hypothesis. If anything, there appears to be a
trend that students become disenchanted with their own topic area.
Second, we hypothesized that students might come to view social studies as more
interesting as they realize how important the discipline is during the simulation. Students
perceptions of social studies importance relative to other subject areas increases
significantly over the course of the simulation (t(196) = 2.76, p < .01; Cohens d = .21),
although this increase still left social studies ranked as the least important subject. Because
we were only interested in students responses to social studies and because both pre- and
post distributions were approximately normal, students reported values for these items
function similarly to any rating scale (for which parametric approaches are frequently
used). However, some might argue that a nonparametric approach would be more
appropriate. Analyzing the data by comparing the pre and post distribution of responses
(using a McNemar-Bowker test of symmetry) yielded a similar significant result (2 (6, N =
197) = 14.30, p = .03). In terms of raw numbers this trend meant that over the course of the
simulation 71 students came to view social studies as more important, 92 maintained the
same opinion, and 35 viewed it as less important relative to other subjects. Thus, students
perceptions of the import of social studies changed over the course of the simulation.
In determining whether this change was related to their increase interest in social
studies, preliminary analyses showed that these measures were correlated before (r(195) = -
16
INCREASING INTEREST IN SOCIAL STUDIES
.24, p < .01) and at the end (r(195) = -.28, p < .01) of the simulation (because we are
correlating ranking and rating items, a negative r indicates a positive association between
the variables). To test whether this increase in perceived importance related to students
increased interest in social studies, we regressed students Interest in social studies (post)
on the change in importance scores while controlling for interest in social studies (pre).
Change in importance was not a significant predictor in this regression equation
(standardized = .00, t = .07, p = .95). Thus, we did not find support for the second
hypothesis.
The third hypothesis posited that, through the simulation, students would come to
view social studies as more (optimally) challenging than they had originally thought. This
appreciation of the challenges in the simulation may have sparked an increase in students
interest in the subject matter more generally. In exploring this possibility, we first
examined the extent to which students self-efficacy in social studies changed over the
course of the simulation. The data showed a decline in students self-efficacy from pre (M
= 3.73) to post (M = 3.58; t(197) = 3.32, p < .01; Cohens d = .22). Correlations indicated
that self-efficacy and interest were related before (r(191) = .47, p < .01) and at the end (r(187)
= .43, p < .01) of the simulation. To investigate whether this decline in self-efficacy
predicted their increased interest in social studies, we regressed students Interest in social
studies (post) on the change in their self-efficacy scores while controlling for interest in
social studies (pre). Change in self-efficacy was a significant predictor in the regression
(standardized = -.15, t = -2.94, p < .01). Thus, we retained the third hypothesis as
plausible.
Finally, we hypothesized that as students increasingly engaged in SPT, their
interest in social studies may increase. We found that students SPT increased slightly
over the course of the simulation (M = 3.24 pre, M = 3.32 post; t(189) = 1.75, p = .08;
Cohens d = .11) 1. SPT and interest correlated moderately before (r(193) = .37, p < .01) and
at the end (r(197) = .49, p < .01) of the simulation. To test the plausibility that the increase
in SPT might help explain the increase in interest in social studies, we regressed students
Interest in social studies (post) on their change in SPT while controlling for Interest in
1
All p-values reported are two-tailed tests. Because the simulation encourages students to engage in SPT,
the only reasonable hypothesis is that it might increase during the simulation. Thus, a one-tailed test seems
appropriate in this instance (which results in p-value of less than .05).
17
INCREASING INTEREST IN SOCIAL STUDIES
social studies (pre). Change in SPT was a significant predictor in the regression
(standardized = .25, t = 5.44, p < .01). Thus, we retained the fourth hypothesis as
plausible.
With the testing of these hypotheses completed, we conducted an additional
analysis to investigate the simultaneous relationship between those variables that appeared
to play a role in students changing levels of interest. Specifically, we conducted a path
analysis that included students race and grade-level as exogenous variables; gender was
excluded because it showed no main effects in the initial analysis. The remaining variables
included pre- and post- measures of students interest, change in self-efficacy in social
studies, and change in SPT. As Figure 2 illustrates, students increases in SPT and
decreases in self-efficacy related to their final level of interest while controlling for initial
interest. Overall the path model in Figure 2 fit the data well (2 (8) = 6.097, p = .636; CFI =
1.00; RMSEA = .00) and explains 64% of the variance in students interest in social studies
by the end of the simulation.
18
INCREASING INTEREST IN SOCIAL STUDIES
discusses these results, including what their implications for future research and for
practitioners, and describes three limitations that particularly warrant mention.
Hypothesized mechanisms. First, we revisit the explanations posited in the
introduction as to how different factors might impact student interest in social studies.
Although the first hypothesis did not receive support in this study, the idea that students
might get interested in a particular area that they studied and that interest may generalize to
the larger domain may still be viable. One possibility is that students in the GlobalEd
simulation spent so much time on their issue area, that they experienced some level of
burnout. Alternatively, as they increasingly interacted with their classmates and began to
learn more about the other topics that they were studying, they may have become more
curious about areas that they knew less about. In other words, students may not have
grown disenchanted with their particular issue area, but rather they grew more intrigued
with the other topics. Although ranking items have some advantages over the use of rating
items (Krosnick & Alwin, 1988), one drawback is that they provide relative, rather than
absolute information. On the other hand, it is possible that interests do not necessarily
transfer between broader domains and sub-domains. Just because students become
interested in a specific issue such as Brazils environmental policies, does not mean that
this interest will transfer to the larger domain of social studies. Research has shown
transfer of learning to be challenging for educators to achieve (Mayer & Wittrock, 1996)
the same may hold true for transfer of interest.
Our investigation of the second hypothesis found that while students did view
social studies as relatively more important by the end of the simulation, this increased
valuing of the discipline was not associated with the increase in interest. We find this
result puzzling. Eccles-Parsons et al. (1983) expectancy-value theory posits a close
connection between these two constructs specifically that interest is one way in which
students might value an activity. One possibility is that interest in social studies makes
students view the subject matter as more important but that the causal path does not flow in
the reverse. However, our data do not support that contention (Importance at Time 1
relates to Interest at Time 2 just as much as Interest at Time 1 relates to Importance at
19
INCREASING INTEREST IN SOCIAL STUDIES
Time 2; rs(197 & 192) = -.26 & -.27 respectively 2). Alternatively, it may be that the simulation
prompted students to view social studies as more important because they saw its utility
value in helping them develop skills such as independent research. However, the reason
they became more interested in social studies was for a completely separate reason, such as
the intrinsic enjoyment of the social process of negotiating. A final possibility is that a
methodological issue, such as the measure of change in importance being unreliable (see
the Limitations section below), accounts for the lack of relationship.
We did find support for our third hypothesis that as students found social studies to
be more challenging during the GlobalEd simulation, they found it more interesting.
Fords (1992) concept of optimal challenge offers one compelling explanation of this
result. Historically, students have perceived social studies as not just boring, but not as
challenging as other subjects such as math (Stodolsky et al., 1991). Thus, to the extent that
the simulation makes students perceive the subject area as harder than they realized and
correspondingly modify their perceptions of their social studies ability, they may become
more interested in the discipline. One potential flaw in this explanation is that there may
be problems in equating declining self-efficacy with students perceiving social studies as
more closely approximating an optimal challenge. Students self-efficacy may drop
because of changes that they attribute to themselves (e.g., their grades are dropping in all
their subjects because they no longer have enough time to study) rather than to their
environment. However, if this drop in self-efficacy is due to an internal factor, it is hard to
know why it would correlate with the rise in interest. Alternatively, some third factor
besides the simulation might cause both the drop in self-efficacy and the increase in
interest. For example, an exciting, dynamic teacher who was challenging and a hard
grader might be responsible for both results. This particular possibility seems unlikely
given that students would be habituated to their teachers by the middle of the year when
the pre- and post-assessments were taken.
The final hypothesis posits that students increased propensity to engage in SPT
might relate to their increased interest. The GlobalEd simulation encourages students to
practice this skill as they negotiate with others. SPT is important to their success and
2
Because these correlations are between rating and ranking items, a negative relationship indicates a positive
relationship.
20
INCREASING INTEREST IN SOCIAL STUDIES
21
INCREASING INTEREST IN SOCIAL STUDIES
fewer teachers will behave equivalently regardless of whether they are teaching a treatment
or control classroom. Thus, although a randomized experiment is probably the most
important future study for this line of research, it is also probably the most difficult to
execute with fidelity.
A slightly different approach would allow for valuable causal data to be collected
on findings of particular interest and might qualify as the next best option. By focusing on
the student groups as the unit of analysis, future studies might take advantage of random
assignment. In other words, within the same teachers classroom the Human Rights group
might be assigned to treatment while the Global Environment group would be assigned to
control, and so on. Interventions could be administered by the SIMCON as email
messages or through a special log-in code that would direct different groups towards
different sets of resource materials. Through these designs, we could then address
questions such as, whether different levels of difficulty in the materials affect students
self-efficacy and, by extension, impact their interest in social studies. By designing an
intervention that bolsters students propensity to engage in SPT, we could also see
whether those students become more interested in social studies. In short, a promising
future direction for these types of simulations might compare groups within the simulation
rather than trying to compare the simulation to traditional classroom instruction. This
approach would not allow educators to assess the overall efficacy of the simulation; a
matched-pairs design would be a more appropriate approach for a replication study.
However, this approach of conducting experiments within the simulation would have the
added benefit of providing data that could help improve the simulations impact on
students over time.
These possibilities for future research could result in several important findings for
educators. However, in the mean time, social studies teachers continue to conduct classes
and need to decide whether to participate in simulations such as GlobalEd based upon
correlational findings. Not only do teachers need to make decisions based on imperfect
information, but their decision-making calculus also differs from that of researchers. As
researchers, we often have the luxury of chipping away at a problem with multiple studies
until we are satisfied with the veracity of an answer. However, as teachers, we must
continually make probabilistic decisions based upon what we think will work best for our
22
INCREASING INTEREST IN SOCIAL STUDIES
students using whatever data are available. Interpreting the results of this study through a
practitioners lens leads us to frame the discussion of the results differently.
As researchers we had a theoretical interest in interest as an outcome variable. For
teachers, we think it makes more sense to view the study as having a constellation of
outcome variables. Specifically, the data show that during the simulation students: came to
view social studies as more important, decreased in their self-efficacy (in a way that may
have been beneficial), increased their propensity to engage in SPT, and became more
interested in social studies. They also became less interested in their particular issue area
relative to the other issue areas (perhaps because they spent so long on their topic). So if
teachers were to have their classes participate in a simulation like GlobalEd, they may
anticipate multiple outcomes from their participation. We do not know that the simulation
caused these outcomes. However, we can probably rule out certain competing
explanations for these outcomes. For example, it seems unlikely that these changes were
caused by teachers. Students had several months to habituate to their teachers before
beginning the simulation and the degree to which teachers sparked students interest in
social studies should be reflected in their initial interest scores. Other potential
explanations cannot be ruled out. For example, these results might be caused not by the
activity of the simulation but by the curricular materials provided by GlobalEd.
Alternatively, these results might stem from the mere act of doing something novel to
change the pace of the class at that point in the year. Although most researchers might be
disappointed in these last two explanations, they may not dissuade teachers from
participating (i.e., their classes would still reap the same benefits by participating).
Assuming these outcomes consistently co-occur with participation in a simulation such as
GlobalEd, it is important to remember that more outcomes than just student interest are
stake.
In addition to taking a more inclusive view of what the outcomes of the study
are, we encourage teachers to assess the risks that might be involved in having their classes
participate. For example, although we do not know that participating in GlobalEd will
cause students to become more interested in social studies, our data indicate that it is
highly unlikely that students will become less interested in social studies as a result of
participating in this simulation. Similarly, it seems very unlikely that students will
23
INCREASING INTEREST IN SOCIAL STUDIES
experience declines in their valuing of social studies or their propensity to engage in SPT.
Instead the risks seem to be that students might experience a drop in their social studies
self-efficacy, and that they might come to view their topic as less interesting. We have
hypothesized that the first risk might normatively be viewed as a positive i.e., the drop in
self-efficacy might represent a shift towards students perceiving an optimal level of
challenge. The second risk may be a consequence of burnout or of increased interest in
other topics. The data from the study simply do not allow us to further evaluate these
risks. In addition to evaluating these results, teachers may wish to weigh whether the
learning gains demonstrated by this sample of students seem worth whatever additional
efforts might be required by participating in the simulation. Because several of the effect
sizes are relatively small (e.g., the magnitude of the increase in interest), teachers
expectations regarding the impact of the intervention should be accordingly modest.
Furthermore, teachers volunteered their classes to participate in the simulation and thus the
types of teachers who led these classes are unlikely to represent the broader population of
middle school social studies teachers. In sum, we encourage teachers to evaluate the
results of this study through a different lens than researchers and to think through these
results with the idiosyncrasies of their particular students in mind.
Limitations. Finally, we would like to address three limitations of the study that
may be weighing on readers minds. First, as alluded to earlier, the use of change scores
can be problematic. Although some scholars recommend against the use of change scores,
under certain circumstances their use may be appropriate (Gardner & Neufeld, 1987;
Rogosa & Willett, 1983). A primary concern regards the likelihood that change scores will
be unreliable. In the case of the third and fourth hypotheses, we did compute reliabilities
for change in self-efficacy ( = .55) and SPT ( = .65). Though these are lower than
generally recommended, it seems relatively unlikely that these alpha levels are at such a
low level so as to invalidate our findings. In fact, it is more likely that the lack of
reliability in these scores has diminished the strength of their relationship with interest. In
testing the first two hypotheses, we could not assess the reliability of the change in
importance because we had no means to assess the reliability of a single ranking item.
Thus, the first two findings should be interpreted with corresponding caution.
24
INCREASING INTEREST IN SOCIAL STUDIES
A second concern for some readers may be the lack of a comparison group. The
finding that provides the foundation for the study is the increase in student interest that is
associated with participation in the GlobalEd simulation. We do not know for sure what
would have happened to an equivalent group of students who was not participating in the
simulation over that same period of time. However, given the pervasiveness and
consistency with which adolescents motivation and interest in school declines, especially
during middle school (Wigfield et al., 2006), we feel that it is very unlikely that students
interest would have increased spontaneously at that point in the year.
Finally, it is reasonable to accept as plausible that the simulation may have played a
role in causing the increase in students interest, but still have concerns regarding students
learning. In other words, educators might be excited about the prospect of a simulation
that is associated with increases in student interest but be unwilling to try it out if students
are not learning anything. The present study assessed content knowledge through a
multiple choice test and found that students improved their scores significantly on the
assessment (t(188) = 5.92, p < .01; Cohens d = .43). Although the magnitude of these
learning gains is modest, the students content knowledge clearly increased over the course
of the simulation. Unfortunately, we did not include other learning assessments that might
have been more closely aligned with the types of learning that occurred during the
simulations (e.g., procedural knowledge related to negotiation). A more comprehensive
assessment of the learning that occurs in this type of simulation (and its relation to student
interest) is an additional issue that warrants further exploration in future studies.
Conclusion. Even the most cursory attention to most news outlets will illustrate the
importance of social studies in todays world. Whether the reports focus on policymakers
debating laws, the role of different religions in national and international conflicts, or the
globalized nature of business, it is hard to argue that studying the backgrounds and cultures
of different groups of people is trivial. Despite its importance, students have tended to
view social studies as particularly uninteresting. If students continue to find this discipline
boring, they will likely pursue other disciplines that they find more rewarding as they
progress through high school and into college. This type of attrition from social sciences
could potentially leave a dearth of skilled personnel at a historical moment when
25
INCREASING INTEREST IN SOCIAL STUDIES
26
INCREASING INTEREST IN SOCIAL STUDIES
References:
Alexander, P. A., Schulze, S. K., & Kulikowich, J. M. (1994). How subject-matter
knowledge affects recall and interest. American Educational Research Journal,
31(2), 313-337.
Alleman, J., & Brophy, J. (1993). Teaching that lasts: College students' reports of learning
activities experienced in elementary school social studies. Social Science Record,
30(2), 36.
Alleman, J., & Brophy, J. (1994). Teaching that lasts: College students' reports of learning
activities experienced in elementary school social studies. Social Science Record,
31(1), 42.
Csikszentmihalyi, M. (1991). Flow: the psychology of optimal experience (1st
HarperPerennial ed.). New York: HarperPerennial.
Davis, M. H. (1996). Empathy: A social psychological approach. Boulder: Westview
Press.
Dede, C., Clarke, J., Ketelhut, D. J., Nelson, B., & Bowman, C. (2005). Fostering
motivation, learning, and transfer in multi-user virtual environments. Retrieved
January 20, 2007, from
http://muve.gse.harvard.edu/rivercityproject/documents/Dede_Games_Symposium
_AERA_2005.pdf
Eccles-Parsons, J. S., Adler, T. F., Futterman, R., Goff, S. B., Kaczala, C. M., Meece, J. L.,
et al. (1983). Expectancies, values, and academic behaviors. In J. T. Spence (Ed.),
Achievement and achievement motives: Psychological and sociological approaches
(pp. 75-146). San Francisco: W.H. Freeman.
Eccles, J. S., Midgley, C., Wigfield, A., Buchanan, C. M., Reuman, D., Flanagan, C., et al.
(1993). Development during adolescence: The impact of stage-environment fit on
young adolescents' experiences in schools and in families. Special Issue:
Adolescence. American Psychologist, 48(2), 90-101.
Epstein, J. L., & McPartland, J. M. (1976). The concept and measurement of the quality of
school life: American Educational Research Journal.
Ford, M. E. (1992). Motivating humans: Goals, emotions, and personal agency beliefs.
Newbury Park, CA: Sage Publications.
27
INCREASING INTEREST IN SOCIAL STUDIES
Gardner, R. C., & Neufeld, R. W. J. (1987). Use of the simple change score in correlational
analyses. Educational and Psychological Measurement, 47(4), 849-864.
Hidi, S., & Renninger, K. A. (2006). The four-phase model of interest development.
Educational Psychologist, 41(2), 111-127.
Hope, W. C. (1996). It's time to transform social studies teaching. Social Education, 87(4),
149 -151.
Keating, D. P. (1990). Adolescent thinking. In S. S. Feldman & G. R. Elliott (Eds.), At the
threshold: The developing adolescent. (pp. 54-89). Cambridge: Harvard University
Press.
Kobrin, D., Abbott, E., Ellinwood, J., & Horton, D. (1993). Learning history by doing
history. Educational Leadership, 50(7), 39-41.
Krosnick, J. A., & Alwin, D. F. (1988). A test of the form-resistant correlation hypothesis:
Ratings, rankings, and the measurement of values. Public Opinion Quarterly,
52(4), 526-538.
Lay, J. C., & Smarick, K. J. (2006). Simulating a senate office: The impact on student
knowledge and attitudes. Journal of Political Science Education, 2(2), 131-146.
Mayer, R. E., & Wittrock, M. C. (1996). Problem-solving transfer. In D. C. Berliner & R.
C. Calfee (Eds.), Handbook of educational psychology. (pp. 47-62). New York
London: Macmillan Library Reference Usa Prentice Hall International.
Midgley, C., Maehr, M. L., Hruda, L. Z., Anderman, E., Anderman, L., Freeman, K. E., et
al. (2000). Patterns of Adaptive Learning Study. Retrieved November 8, 2000,
from http://www.umich.edu/~pals/PALS%202000_V13Word97.pdf
Pace, D., Bishel, B., Beck, R., Holquist, P., & Makowski, G. (1990). Structure and
sponteneity: Pedagogical tensions in the construction of a simulation of the Cuban
missle crisis. The History Teacher, 24(1), 53-65.
Pintrich, P. R. (2000). Multiple goals, multiple pathways: The role of goal orientation in
learning and achievement. Journal of Educational Psychology, 92(3), 544-555.
Pintrich, P. R., & Schunk, D. H. (2002). Motivation in education: Theory, research, and
applications (2nd ed.). Upper Saddle River, NJ: Merrill Prentice Hall.
Prensky, M. (2001). Digital game-based learning.: New York: McGraw Hill.
28
INCREASING INTEREST IN SOCIAL STUDIES
Putnam, R. (1988). Diplomacy and domestic politics: The logic of two-level games.
International Organization, 42(1), 427-460.
Rogosa, D., & Willett, J. B. (1983). Demonstrating the reliability of the difference score in
the measurement of change. Journal of Educational Measurement, 20(4), 335-343.
Ronen, M., & Eliahu, M. (2000). Simulation - A bridge between theory and reality: The
case of electric circuits. Journal of Computer Assisted Learning, 16, 14-26
Schiefele, U. (1996). Topic interest, text representation, and quality of experience.
Contemporary Educational Psychology, 21(1), 3-18.
Stodolsky, S. S., Salk, S., & Glaessner, B. (1991). Student views about learning math and
social studies. American Educational Research Journal, 28(1), 89-116.
Symons, C. S., & Johnson, B. T. (1997). The self-reference effect in memory: A meta-
analysis. Psychological Bulletin, 121(3), 371-394.
Tamura, E. H. (1992). Should the minimum drinking age be changed? A simulation on the
legislative process. Social Studies., 83(5), 201.
Teague, M., & Teague, G. (1995). Planning with computers: A social studies simulation. .
Learning and Leading With Technology, 23(1), 20-22.
Tracey, T. J. G. (2002). Development of interests and competency beliefs: A 1-year
longitudinal study of fifth- to eighth-grade students using the ICA-R and structural
equation modeling. Journal of Counseling Psychology, 49(2), 148-163.
VanSledright, B., & Limon, M. (2006). Learning and teaching social studies: A review of
cognitive research in history and geography. In P. A. Alexander & P. H. Winne
(Eds.), Handbook of educational psychology (2nd ed., pp. 545-570). Mahwah, N.J.:
Lawrence Erlbaum.
Watt, H. M. G. (2004). Development of adolescents' self-perceptions, values, and task
perceptions according to gender and domain in 7th- through llth-grade Australian
students. Child Development, 75(5), 1556-1574.
White, R. W. (1959). Motivation reconsidered: The concept of competence. Psychological
Review, 66, 297-333.
Wigfield, A., Byrnes, J. P., & Eccles, J. S. (2006). Development during early and middle
adolescence. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational
psychology (2nd ed., pp. 87-113). Mahwah, NJ: Lawrence Erlbaum.
29
INCREASING INTEREST IN SOCIAL STUDIES
Wolters, C. A., & Pintrich, P. R. (1998). Contextual differences in student motivation and
self-regulated learning in mathematics, English, and social studies classrooms.
Instructional Science, 26(1-2), 27-47.
30
INCREASING INTEREST IN SOCIAL STUDIES
Appendix
Response scale:
Items:
Overall, how interesting do you find your social studies class?
When you hear about current events in the news, how interesting do you find them?
How interesting do you find learning about other countries?
How interesting are the different topics you study in this class?
How interesting are the assignments you are given for this class?
How interesting do you find learning about international conflicts?
Please rank your interest in the following topics so that 1 = the most interesting to you and
___ Immigration
___ International Economics
___ Global Environment
___ Human Rights
___ Conflict and Cooperation
3) Importance of social studies:
Please rank the following subjects where 1 = most important to 4 = least important to you.
___ English
___ Math
___ Science
___ Social Studies
31
INCREASING INTEREST IN SOCIAL STUDIES
Response Scale:
not at all slightly moderately quite extremely
confident confident confident confident confident
How confident are you that you can learn all the material presented in this class?
How confident are you that you can do the hardest work that is assigned in this class?
When complicated ideas are presented in this class, how confident are you that you can
understand them?
How confident are you that you can complete all the work that is assigned in this class?
How confident are you that you will remember what you learned in this class next year?
5) SPT-Propensity 7 items
Response Scale:
How often do you try to figure out how the people around you view different situations?
If you are having a disagreement with your friends, how often do you try to imagine how
they are feeling?
How often do you try to look at everybody's side of a disagreement before you make a
decision?
When you are upset at someone, how often do you try to put yourself in his or her shoes?
How often do you try to understand your classmates better by trying to figure out what
they are thinking?
Before criticizing others, how often do you imagine how you would feel if you were in
their place?
To understand your friends better, how often do you imagine how things look from their
perspective?
32
INCREASING INTEREST IN SOCIAL STUDIES
Table 1: Descriptive statistics for students rankings of their relative interest in topic areas
Note: Because these are ranking items, lower numbers correspond to higher rankings. A
negative difference score indicates that students became less interested in their topic
Between-group comparisons (e.g., those students in the Conflict & Cooperation issue area
vs. all other students) can be made by looking down columns. Within-group comparisons
can be made by looking across rows (e.g., those students in the Global Environment topic
33
INCREASING INTEREST IN SOCIAL STUDIES
0.40
0.33
0.30
0.30
0.24 0.25
Change in Student Interes
0.23
in Social Studies
0.20 0.18
0.17
0.15
0.10
0.06
0.03
0.00
-0.01
-0.10
Teacher
34
INCREASING INTEREST IN SOCIAL STUDIES
SPT
Grade level -.12 (Change)
-.25 .23
.71
.09 (ns) Interest (Pre) Interest (Post)
-.17 -.14
SS Efficacy
Race: (Change)
White = 1,
Non-White = 0
35