Skills For Today - Social-Responsibility
Skills For Today - Social-Responsibility
Skills For Today - Social-Responsibility
Written by
Jessica Yarbro and Matthew Ventura
CREATIVE COMMONS
Permission is granted under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license to replicate, copy,
distribute, or transmit all content freely provided that attribution is provided as illustrated in the reference below. To view a copy of this license, visit
https://creativecommons.org/licenses/by-nc-nd/3.0/ or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, United States.
Sample reference: Yarbro, J., & Ventura, M. (2019). Skills for Today: What We Know about Teaching and Assessing Social Responsibility. London: Pearson.
Copyright 2019
The contents and opinions expressed in this paper are those of the authors only
-2-
table of contents Foreword . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 04
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 05
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
-3-
Foreword
Social responsibility is broadly defined as taking responsibility a need to further support students in their development of
to behave ethically and with sensitivity toward social, cultural, these skills. Our hope with this summary is to synthesize best
civic, and environmental issues. Primary and secondary practices for teaching and assessing social responsibility.
schools have traditionally been charged with developing social
Research supports several effective strategies for enhancing
responsibility through character education. Colleges have also
social responsibility. We highlight a number of these strategies
taken up the call to help their graduates be responsible citizens,
in this paper including problem-based learning, case-based
listing associated skills as key graduate outcomes. Following
instruction, interacting with diverse groups of people, and
students’ transition to the workplace, employers will expect
providing structured opportunities to practice and engage with
them to maintain a high standard of ethical behavior, and,
real-world situations relevant to social responsibility. Reliable
in our increasingly globalized society, workers of the future
and valid assessments of social responsibility can also support
will need the skills to work effectively and respectfully with
teaching and learning. Self- and informant-report questionnaires
individuals from different cultural backgrounds. Throughout
are easily administered and interpreted. Rubrics and scenario-
my time in school I participated in everything from pen-pal
based measures are more complex but can also allow for more
campaigns to volunteering in the community, all with the
authentic assessment of social responsibility competencies.
objective of understanding and helping people and communities
different from my own. I find my workplace to be focused
This paper concludes a series of summaries around Pearson’s
on how our actions impact the environment and the lives of
Personal and Social Capabilities (PSCs), the competencies
people around the globe. We are encouraged and supported
outside of academic knowledge that contribute to student
to do big and small things including dedicated days off to help
success in school, work, and life. In collaboration with
students learn, paint a school, or financially support a cause.
P21, Pearson released four papers detailing the skills of
collaboration, critical thinking, communication, and creativity,
Through a review of several frameworks for social responsibility,
along with separate papers focusing on the skills of self-
we have identified four key dimensions of competence:
management and leadership. We at Pearson are excited to
multicultural, ethical, civic, and environmental. Competence in
provide educators, employers, and policy-makers with an
these areas will support student success and is a crucial factor
overview of the best practices for developing these key PSCs.
for developing ethical, just, and well-functioning societies.
While educational institutions and employers emphasize Leah Jewell, Managing Director, Employability Solutions and Services
-4-
Introduction
Social responsibility occurs when an individual takes in high school also had higher grades, fewer behavioral
responsibility to behave ethically and with sensitivity toward problems, and felt more confident in their ability to enact
social, cultural, civic, and environmental issues. Recent large- change in their communities (Schmidt, Shumow, & Kackar,
scale surveys demonstrate the importance employers place on 2007). Likewise, prosocial activities (including attending church
social responsibility. A survey of 400 employers conducted on and participating in volunteer or community-service activities)
behalf of the Association of American Colleges and Universities in Grade 10 were associated with better grades and less use
(AAC&U; Hart Research Associates, 2015) found agreement of drugs and alcohol two years later (Eccles & Barber, 1999).
among employers that social responsibility should be taught to Developing character strengths (including honesty, kindness,
college students, regardless of their field of study. Employers and fairness) through a school program was associated with
specifically cited the following aspects of social responsibility: increased life satisfaction and better relationships (Proctor
et al., 2011; Wagner, Gander, Proyer, & Ruch, 2019).
knowing how to solve problems with people
whose views are different than their own; Lastly, and perhaps most importantly, building a nation’s social
responsibility has the potential to create a more involved
building civic knowledge, skills, and judgment;
citizenry and more caring and just communities. For example,
gaining intercultural skills. participating in community-service projects in high school
predicted greater community and civic involvement in adulthood
Regarding hiring decisions, 81 percent of employers rated
(Beane, Turner, Jones, & Lipka, 1981). Social responsibility learned
“ethical judgment and decision-making” as very important, but
and practiced in childhood and young adulthood appears to
only 30 percent thought recent college graduates were well
encourage more active civic engagement across the life span.
prepared in this area. Likewise, 56 percent rated “the ability
Civic engagement is one precursor to building social capital
to analyze and solve problems with people from different
(Hyman, 2002), which Putnam (1995, pp. 664–665) defines
backgrounds and cultures” as very important, but only 18
as “features of social life—networks, norms, and trust—that
percent rated recent college graduates as well prepared.
enable participants to act together more effectively to pursue
Reviewing accreditation and professional competence shared objectives.” Through the mechanism of increased social
guidelines indicates the emphasis professionals in many fields capital, increasing levels of social responsibility can help drive
place on social responsibility. For example, the American stronger communities that promote improved social welfare.
Chemical Society’s (ACS) Guidelines for Chemistry Programs
in Two-Year and Community Colleges (ACS, 2015) details
the importance of ethics to the academic and professional
success of chemists. According to this framework, ethics
in chemistry relates to responsible research conduct and
awareness of the role of chemistry in contemporary societal
and global issues. Likewise, the nursing profession requires
a commitment to society, and this commitment is included in
the code of ethics that regulate nursing activities in the United
States (American Nurses Association, 2003) and globally in
the International Council of Nurses Code of Ethics for Nurses
(International Council of Nurses, 2012). More specifically,
nurses “share with society the responsibility for initiating and
supporting action to meet the health and social needs of the
public” and “advocate for equity and social justice in resource
allocation, access to health care and other social and economic
services” (International Council of Nurses, 2012, p. 2).
-5-
Definitions and Models
Social responsibility represents a complex and multifaceted competency,
with different conceptualizations and frameworks emphasizing the different
components to varying degrees. In this section, we provide an overview of
several definitions of social responsibility. We then synthesize across these
definitions to generate our own framework for social responsibility.
The AAC&U also addresses social responsibility through their Shared Futures
project. In order to effectively practice social responsibility, students need to
understand the interconnected nature of the world’s human and natural systems.
This can be accomplished through global learning, which AAC&U (n.d., p. 1) defines
as “a critical analysis of and an engagement with complex, interdependent global
systems and legacies (such as natural, physical, social, cultural, economic, and
political) and their implications for people’s lives and the earth’s sustainability.”
-6-
They understand, abide by, and participate in the development, maintenance,
and/or orderly change of community, social, and legal standards or norms.
integrity.
The ATC21S working group includes citizenship—local and global—as another skill within
the “Living in the World” category. Their conceptualization of citizenship includes:
voting in elections;
While not a part of social responsibility within the ATC21S model, these aspects
of citizenship are common to other conceptualizations of social responsibility.
-7-
“
The socially responsible person cares about
others, uses ethical standards in making
judgments, is open to the viewpoints of
others, responsive to the needs of others,
altruistic, politically conscious, informed
and involved, concerned about the welfare
of the community, and acts with integrity.
Sheldon Berman,
a teacher, superintendent,
and education researcher
-8-
Social Consciousness and Social Responsibility
Sheldon Berman, a teacher, superintendent, and education researcher, has written
extensively about social responsibility. His conceptualization of social responsibility
“focuses on the nature of a person’s relationship with others and with the larger social
and political world . . . the personal investment in the well-being of others and the
planet” (Berman, 1997, p. 12). The socially responsible person “cares about others, uses
ethical standards in making judgments, is open to the viewpoints of others, responsive
to the needs of others, altruistic, politically conscious, informed and involved, concerned
about the welfare of the community, and acts with integrity” (p. 12). According to
Berman, social responsibility is driven by a sense of connectedness, understanding
that the “individual is rooted within a larger social network, within interlocking
communities that range from the local to the global” (p. 12). From this understanding
comes a concern for others, which leads to engagement with civic structures that
can improve the well-being of one’s communities. Environmental stewardship and
sustainability is also included in Berman’s conceptualization of social responsibility.
• Votes
• Is an informed and active citizen at
• Participates in community organizations
the local, national, and global level
Civic • Attends town halls addressing local issues
• Understands and acts on issues of
local, national, and global significance • Researches and forms a reasoned
opinion about an international conflict
-9-
Dimension of Competence Definition Example Behaviors
Multicultural Competence
Be aware of and respect cultural, individual and role differences, including those
based on age, gender, gender identity, race, ethnicity, culture, national origin,
religion, sexual orientation, disability, language and socioeconomic status and
consider these factors when working with members of such groups.
Try to eliminate the effect on their work of biases based on those factors, and do not
knowingly participate in or condone activities of others based upon such prejudices.
Recognize and understand that as cultural beings they hold attitudes and beliefs that
can influence their perceptions of and interactions with others . . . As such, [they] strive
to move beyond conceptualizations rooted in categorical assumptions, biases, and/
or formulations based on limited knowledge about individuals and communities.
(APA, 2017, p. 4)
Ethical Competence
- 10 -
moral way. We define this dimension of competence as demonstrating knowledge and
awareness of ethical standards and issues and applying ethical reasoning and standards
to make decisions in ethically ambiguous situations. Also, as a note on terminology,
much research on this topic uses the terms “ethical” and “moral” interchangeably.
For the sake of consistency, we will exclusively use the term “ethical” in this paper.
Another strand of research has focused on ethical reasoning or how individuals make
and justify their decisions in ethically ambiguous situations. Kohlberg (1976; 1981) is
one of the most well-known researchers on ethical reasoning. Kohlberg would present
students with ethical dilemmas (i.e. should a man steal medicine to save his dying
wife?) then examine the justification students provided for their choice. Kohlberg
suggests that children initially provide egocentric, or self-focused, justifications. For
example, an action might be considered wrong because it would result in negative
consequences. As ethical reasoning develops, responses become increasingly complex,
referencing social rules or expectations. Kohlberg considers abstract reasoning based
on universal ethical principles to be the most advanced form of ethical reasoning.
- 11 -
These virtues are further broken down into twenty-four character strengths which
are the routes or pathways for demonstrating the virtues. For example, displaying
love (“reciprocated relationship(s) with another person,” p. 293) or kindness (“the
pervasive tendency to be nice to other people—to be compassionate and concerned
about their welfare, to do favors for them, to perform good deeds, and to take care
of them,” p. 296), indicates the presence of the virtue of Humanity. Peterson and
Seligman’s framework represents one way in which ethical competence can be defined
by practicing character strengths and virtues across a variety of life situations.
Civic Competence
Environmental Competence
Our framework primarily focuses on the knowledge and behaviors that are
indicative of social responsibility. Current conceptualizations of social responsibility
sometimes include values or dispositions as well. These can be thought of as
patterns of belief that motivate socially responsible behavior. For example, Althof
and Berkowitz’s definition of civic competence incorporates dispositions, which
they define as “values and attitudes that create an inclination toward action, in this
case, an inclination toward civic engagement, including the appreciation of diversity,
equality, social justice, and attitudes such as political opinions or feelings about
civic participation generally” (2006, p. 16). Likewise, Lickona (1989, p. 51) stated
that “good character consists of knowing the good, desiring the good, and doing
the good.” Desiring the good represents a disposition toward wanting to behave
in a good or ethical way. While these dispositions are not explicitly part of our
framework, we wish to provide a discussion, since some interventions or assessments
may target dispositions as a method for developing social responsibility.
- 12 -
“
Values and attitudes that create an
inclination toward action, in this case,
an inclination toward civic engagement,
including the appreciation of diversity,
equality, social justice, and attitudes
such as political opinions or feelings
about civic participation generally.
- 13 -
The relationships between values/dispositions and behavior is complex. There is some
evidence that values do help drive patterns of behavior. For example, adolescent
values about civic responsibility predict civic behavior in adulthood (Finlay, Wray-
Lake, Warren, & Maggs, 2015). Other research suggests that social-activism values
are precursors to charitable behaviors, and that these values are needed to maintain
charitable behaviors and civic engagement over time (Bryant, Gayles, & Davis, 2012).
However, other research has found that values are not perfect predictors of behavior
(Bardi & Schwartz, 2003). For example, valuing benevolence only explained 9 percent
of the variability in self-reported caring behavior, suggesting that other factors are
also relevant predictors of these behaviors. Bardi and Schwartz (2003) suggest that
social norms might be relevant. If there is strong social pressure to act in a caring
way, then someone may act this way without actually valuing this behavior. Overall,
while values do not completely explain social responsibility, they may represent
one important avenue through which social responsibility can be developed.
- 14 -
Teaching Social Responsibility
Development of Prerequisite Skills and Competencies
Several dimensions of social responsibility require an ability to understand the
perspectives of others. While social responsibility represents a more advanced
competency, instructors may wish to help students practice perspective-taking
and related skills in order to support future development of social responsibility
skills. Meta-analyses (statistical reviews of research) suggest that social competence
training with children aged three to fifteen has a moderately strong positive effect on
perspective-taking and a variety of other social cognitive skills (Beelmann, Pfingsten,
& Lösel, 1994). The most effective training programs focused on social problem-
solving skills or a combination of social problem-solving, behavioral strategies, and
self-control. Likewise, training also has a moderately strong positive impact on the
related concept of Theory of Mind (ToM), which “refers to knowledge and awareness
of mental states, (perceptions, emotions and thoughts) in oneself and others”
(Hofmann et al., 2016, p. 200). One effective program involved engaging students
in conversations about the mental states of characters in stories (Lecce, Bianco,
Devine, Hughes, & Banerjee, 2014). In particular, each story involved a discrepancy in
the beliefs or knowledge held by the characters, which presented problems for the
main character to solve. This program had a positive impact on ToM as measured
by students’ ability to make inferences about the mental states of characters in a
story (i.e. the Strange Stories task; Happé, 1994; White, Hill, Happé, & Frith, 2009).
Multicultural Competence
Primary and Secondary School
One method for supporting multicultural competence among primary- and secondary-
school-aged children is to reduce prejudice or other negative attitudes toward other
groups of individuals. In a meta-analysis of eighty-one research studies (published
between 1958 and 2010), Beelmann and Heinemann (2014) found a low to moderate
intervention effect. Interventions were most effective at reducing negative stereotypes
or beliefs about other groups. Most of the interventions focused on views around other
ethnicity groups while some addressed views on individuals with disabilities and the
elderly. Results indicated that interventions had a stronger impact on reducing negative
beliefs about individuals with disabilities compared to individuals of other ethnicities.
Interventions were also most effective when they incorporated direct contact between
individuals of different social groups or when they addressed empathy and perspective-
taking. While only a small subset (ten studies) included follow-up data, these results were
promising as the effect sizes tended to be similar at follow-up (average of four months).
- 15 -
Other research has examined the impact of multicultural education within primary
and secondary schools. In one meta-analysis, Okoye-Johnson (2011, p. 1256) defines
multicultural education as “programs and curricula dealing with racial and cultural
diversity” that seek to address prejudice and racism while also helping students from
diverse backgrounds experience educational equity. Multicultural education activities
include reading and discussing stories about individuals from a variety of cultural
groups as well as lectures and discussions about cultural identities and values. Okoye-
Johnson (2011) found a moderately strong effect for multicultural education on reducing
negative racial attitudes, with interventions integrated into the school curriculum being
particularly effective. Additionally, these interventions were slightly more effective for
older students (ages nine to sixteen) than for younger students (ages three to eight).
Facing History and Ourselves represents one particular curriculum for middle-school-
and high-school-aged students addressing aspects of multicultural competence. This
curriculum engages students in readings and discussions about the Holocaust, with
a particular focus on the consequences of racism, violence, and antisemitism (Strom,
Sleeper, & Johnson, 1992). Research suggests that Facing History and Ourselves results
in decreases in racist attitudes (Schultz, Barr, & Selman, 2001) along with increases in
tolerance of different political preferences and stronger awareness of the experience
of prejudice and discrimination by different cultural groups (Bouley et al., 2011).
Creativity Compass is another school-based program (designed for children aged six
to twelve years) that can support multicultural competence (Dziedziewicz, Gajda, &
Karwowski, 2014). This program helps students simultaneously develop creativity and
multicultural competence through activities where the class hypothetically travels to
different countries. Students engage in open-ended discussions about cultural themes
including history, myths and legends, and traditions while employing strategies such as
analogy, imagination, and abstraction that stimulate creative thought. One study with
Polish schoolchildren found that Creativity Compass increased cultural sensitivity and
self-awareness compared to students in a control group (Dziedziewicz et al., 2014). The
cultural sensitivity and self-awareness measure focused on national cultural identity.
Higher Education
One meta-analysis by Denson (2009) examined the impact of curricular and cocurricular
diversity activities on the racial bias of college students. These activities included
multicultural coursework, diversity workshops and trainings, and peer-led interventions.
Overall, Denson (2009) found that across the sixteen studies reviewed, diversity activities
had a moderately strong effect on reducing racial bias. Activities were most effective
when they combined enlightenment (i.e. increasing the knowledge people have of
other groups or changing people’s perspective of their relations with other groups)
with cross-racial interaction (having interactions with people of other races). Notably,
many of the studies surveyed lacked random assignment, and activities were less
effective in studies where possible confounds were controlled for, indicating that some
of the effectiveness of these interventions may be attributable to study design. Other
meta-analyses suggest that similar interventions (specifically enlightenment, contact/
interaction, and the combination of enlightenment and interaction) also have a positive
impact on attitudes, emotions, and behavioral intentions toward homosexual and
bisexual individuals (Bartoş, Berger, & Hegarty, 2014; Smith, Axelton, & Saucier, 2009).
- 16 -
learning (i.e. case studies, simulations, and exercises)
and Universities (AAC&U) began their Core create awareness of one’s culture;
Commitments initiative, a program to help colleges foster appreciation of diverse cultural backgrounds;
support student development of personal and increase competence in interacting with different cultures;
Lastly, several other engaged learning practices Perspective-taking: “Adopting the perspective in the
were identified. These practices include “talking first person of a member of a stigmatized group.”
about course content with students outside of class Contact: “Increasing exposure to out-group members.”
and communicating with professors outside of
(Devine et al., 2012, p. 1270)
class; active and collaborative learning; challenging
academic classes and high expectations; and Students were provided with examples of everyday situations
integrative learning” (O’Neill, 2012, p. 44). where the strategies could be used and were asked to generate
their own examples. Students were encouraged to practice the
strategies after the intervention session. Compared to a control
group, the intervention decreased implicit racial bias, which was
- 17 -
maintained at an eight-week follow-up. The intervention also
The report concludes by offering colleges and universities increased participants’ concern about discrimination and their
seven recommendations for campus practice: awareness of their personal biases. A similar habit-breaking
intervention increased gender-bias awareness among university
1. “Take stock of existing opportunities for science faculty and showed a trend toward increasing the hiring
students to engage in personal and social rate of new female faculty (Carnes et al., 2015; Devine et al., 2017).
responsibility-related practices”
The Workshop Activity for Gender Equity Simulation (WAGES)
2. “Determine who participates in these practices, how represents an experiential learning activity targeting sexism. In
often, and why, as well as who does not and why” this activity, two teams compete in a game to advance in one’s
academic career. One team is provided with a series of small
3. “Align existing courses, programs, and cocurricular and ostensibly harmless advantages that mimic the advantages
activities with institutional learning goals men experience in the workplace. These advantages add up by
around personal and social responsibility” the end of the game, and participants engage in a structured
discussion about the activity after the game concludes. One study
4. “Seed personal and social responsibility practices—
found that WAGES increased recognition of the harmful nature of
diversity and perspective-taking, service learning
everyday sexism and behavioral intentions to learn more about
and volunteering, and other engaged learning
gender inequality (Cundiff, Zawadzki, Danube, & Shields, 2014).
practices—where gaps currently exist”
Acceptance and Commitment Training (ACT) is another technique
5. “Integrate the different instances of these that evidence suggests can improve multicultural competence
positive practices and sequence them (Lillis & Hayes, 2007). ACT includes discussion and experiential
developmentally for students” exercises designed to help students notice prejudicial thoughts,
feelings, and reactions; to accept these as a natural result of living
6. “Assess students along the way”
in a prejudiced society; and to recognize that these thoughts
do not have to lead to negative actions. A key component of
7. “Examine the institutional structures and climate for
ACT is focusing on changing behavior to better align with one’s
educating for personal and social responsibility”
values rather than trying to change one’s thought patterns and
Ethical Competence
Primary and Secondary School
Development of ethical competence in primary and secondary school most often falls
under the purview of character education. Character education refers to the movement
- 18 -
within schools to foster “ethical, responsible, and caring young people by modeling and
teaching good character through emphasis on universal values” (Character Education
Partnership, 2010, para 1). As such, the goal of character education is to enhance
aspects of ethical competence, particularly behaving in a way that is aligned with general
ethical values such as justice, integrity, and respect. Within the United States, there is a
particularly strong national interest in character-education programs, as evidenced by
the inclusion of character education as a feature of the No Child Left Behind Act (2001).
The Child Development Project (CDP) represents a school reform model for elementary
schools designed to teach social and ethical skills and promote academic achievement
by creating caring school communities (Battistich, Watson, Solomon, Schaps, &
Solomon, 1991). In particular, the CDP emphasized three key classroom components:
The Smart Character Choices (SCC; Vance & Stockwell, 2002) program is designed to
help students manage behavior by linking behavior to individual wants and needs. The
program incorporated progression development and implementation support for faculty
and focused on an American History curriculum emphasizing positive historical role
models. Students were also taught specific classroom and schoolwide social protocols
with the goal of “assist[ing] students in developing effective character traits (e.g.,
kindness, optimism, respect, responsibility, and work ethic) that help them to interact
with others positively and meet basic needs” (Parker, Nelson, & Burns, 2010, p. 820).
Compared to students in schools assigned to a control condition, students in SCC schools
demonstrated fewer negative social behaviors (classroom disruptions and verbal and
physical aggression), as measured by an independent observer (Parker et al., 2010).
- 19 -
school students. This study utilized the Building Decisions Skills curriculum (Born
& Mirk, 1997). Students learned about ethical issues and how to apply different
decisions paradigms to ethical dilemmas. The curriculum included instruction and
practice. At the same time, students also engaged in community service. Outcomes
for students in this group were compared to two other preexisting groups: students
participating in community service without explicit instruction and a control group.
Students in both community-service groups reported a stronger sense of social
responsibility within their school than students in the control groups. Students in
the community service with integrated ethical decision-making instruction group
generally outperformed students in the other two groups on measures of ethical
competence, including sensitivity to ethical issues and willingness to accept ethical
responsibility (as measured by examining ethical dilemmas). Results suggest that while
community-service participation can support some aspects of social responsibility,
explicit instruction in ethical decision-making is needed to drive strong gains in ethical
competence. It should be noted that because the groups were based on existing classes
and not random assignment, it is unclear whether the groups could be considered
equivalent, although researchers attempted to control for potential group differences.
Storytelling curricula represent another avenue for teaching younger children about
character and ethics. Leming (2000) evaluated the Heartwood Institute’s (1992) “An Ethics
Curriculum for Children,” an approach to teaching children in Grades 1–6 ethical values
and character attributes utilizing a read-aloud literature program. While the program
improved students’ ethical understanding (i.e. their knowledge about the six ethical
values), the program’s impact on ethical decision-making and behavior was inconsistent.
LifeStories for Kids represents another program that utilizes storytelling techniques
to help elementary-school-aged students understand character choices in complex
social situations (Brightwood & DeRosier, 2007). Students listen to stories that highlight
several character traits including integrity, kindness, fairness, and acceptance. After
students listen to the stories, teachers can pick from a variety of follow-up activities
that build on the stories’ lessons. These activities include role-plays, art activities,
creative storytelling, and writing activities linking the story to students’ lives. A study by
DeRosier and Mercer (2007) examined the impact of a semester-long implementation
of this program for students in Grades K–2 and 3–5. For students in Grades K–2, the
program resulted in decreased aggressive behavior and increased prosocial behavior
(i.e. demonstrating empathy and caring for others). Among students in Grades 3–5, the
program resulted in decreased aggressive behavior and immature or impulsive behavior.
Higher Education
ethical knowledge;
perceptions of self;
ethical decision-making;
metacognitive strategies.
Ethical reasoning was a common outcome in these studies, most often measured
using the Moral Judgment Test or the Defining Issues Test, which are general measures
of ethical reasoning. Effectiveness for these outcomes were generally weaker, while
- 20 -
- 21 -
Image by Christof Van Der Walt
interventions were strongly effective when the Defining Issues Test was adapted to a
particular field. Shorter programs (less than eight hours) tended to be more effective,
and format (i.e. integrated vs. stand-alone) did not strongly influence effectiveness.
Programs targeting the following content areas demonstrated the largest effects:
sexual harassment, the Nuremberg code, personal integrity, financial compliance,
group biases, data integrity, and field differences. In contrast, the weakest effects were
observed for the following topics: appropriate statistical analysis, power differentials,
diversity, organizational values, peer review, and lab safety. Purely group- or team-
based approaches tended to generate smaller effect sizes. The largest effect sizes
were observed for courses including humor, note-taking, workbooks, debates, and
current events, while games, mentoring, and service learning were associated with
smaller effect sizes. Active participation, case-based instruction, and opportunities
for practice were other features of more effective programs. Notably, participants
in these studies included undergraduate students, graduate/medical students, and
professionals/residents. Generally the effectiveness of ethics-training problems was
similar across groups, with the strongest effects for mixed groups of participants.
Civic Competence
Primary and Secondary School
The Student Voices program is a high-school civics curriculum that teaches students
about political systems by exploring problems in the students’ communities and
making connections between these problems and decisions made in state and local
government (Feldman, Pasek, Romer, & Jamieson, 2007). The program also encourages
active classroom discussions about political and social issues along with engagement
with media coverage of politics. One study found that program participation was
associated with short-term gains in political interest, efficacy for political engagement,
and knowledge of state and local government (Feldman et al., 2007). A follow-up
study conducted over a year after students finished the program (during which time
a presidential election occurred) showed that students retained gains in efficacy for
political engagement, political attentiveness, and knowledge regarding presidential
candidates (Pasek, Feldman, Romer, & Jamieson, 2008). It should be noted that class
assignment in these studies was determined by self- or administrator selection, so we
cannot be certain that the two groups being compared were equivalent. Another study
that incorporated random assignment, and that included 1,670 high-school students,
found that Student Voices had a positive impact on “students’ self-reported ability to
cast an informed vote, knowledge of the voter registration process, belief that their vote
matters, communication with others about politics, sense of civic obligation, and media
use and analysis” compared to a standard civic curriculum (Syvertsen et al., 2009, p. 33).
- 22 -
The Madison County Youth in Public Service program integrated small-group
community engagement into high-school government courses (Westheimer &
Kahne, 2004). Students, in small groups, partnered with government agencies
on community-based projects, such as developing a plan for curbside recycling.
Compared to a group of control students, participating in the program resulted
in significant growth in personal responsibility to help others, confidence
that they could make a positive change in their communities, and intention to
read the news (Kahne & Westheimer, 2006; Westheimer & Kahne, 2004). It is
important to note that the groups were based on existing class structure, not
random assignment, so we cannot be certain that the groups are equivalent.
Kids Voting USA is a civics curriculum implemented during election years that supports
civic engagement (Battistoni et al., 2003). In addition to classroom lectures, students gain
hands-on experience with the electoral process through activities like participating in Get
Out the Vote efforts and analyzing political advertisements. The program encourages
peer-collaboration activities for students and parental participation. One study found
that participating in Kids Voting USA was associated with increased media use, political
knowledge, and civic and political discussions with parents and friends (McDevitt &
Kiousis, 2006), effects which were retained at a one-year follow-up. Participating in
Kids Voting USA was also related to increased volunteering and campus activism one
and two years following the program. Assignment to condition in this study was based
on whether a school was participating in Kids Voting USA, and analyses suggested that
the two groups were similar on relevant demographic and background variables.
Higher Education
College appears to play an important role in developing civic competence among young
people. Increased education predicts political engagement, such as voting (Marcelo,
2007), as well as more general community engagement, such as active participation
in community groups or organizations (Huang, van den Brink, & Groot, 2009). Service
- 23 -
Image by Christof Van Der Walt
- 24 -
learning is often proposed as one of the college experiences that supports civic
competence. Research supports this supposition. One meta-analysis of twenty-eight
studies found that participation in service learning predicted civic engagement, which
included outcomes that impacted the community such as altruism, civic responsibility,
and current and future voting behaviors (Celio, Durlak, & Dymnicki, 2011). Another meta-
analysis found that participation in community service was associated with increases
in active involvement in community improvement as well as justice-oriented citizenship
(i.e. addressing societal structures and injustice; Conway, Amel, & Gerwien, 2009).
Other theorists suggest that diversity experiences can drive civic engagement by making
students more aware of issues of difference and inequality. This awareness prompts
civic action as a strategy for addressing injustice. One meta-analysis found that diversity
experiences in college were related to increased civic outcomes (attitudes or skills,
behaviors, or behavioral intentions), with a small- to medium-sized effect (Bowman,
2011). Diversity experiences could include interpersonal interactions with diverse
peers, diversity coursework, or diversity experiences outside of the classroom. Of these
experiences, interpersonal interactions had the strongest impact on civic outcomes. Gains
reported in the studies in this meta-analysis could be based on self-report or differences
in scores between assessments made at different times (longitudinal design), with the
latter reflecting a more rigorous design. While diversity experiences still had a significant
effect in longitudinal studies, the effects were significantly stronger when based on
self-reported gains, suggesting that the overall effect size may be an overestimation.
Krings and colleagues (Krings, Austic, Gutiérrez, & Dirksen 2015) examined the
impact of different social justice education courses. Of the courses compared, one
included a two-hour per week service learning internship, one focused on intergroup
dialogue, and one addressed social justice topics using a lecture style. These courses
were compared to a control, Introduction to Psychology course. Compared to the
control condition, students in the social justice courses demonstrated greater
gains in self-reported political participation, civic engagement, and multicultural
activism. When examining the three social justice courses independently, students
in the intergroup dialogue course demonstrated gains in all three outcomes, and
students in the lecture-based course demonstrated gains in political participation
and multicultural activism. Somewhat surprisingly, students in the service
learning course did not experience gains in any of the outcomes, but this group
had the highest levels of outcomes prior to beginning the course, which may have
contributed to these findings. Notably, participation in these courses was based on
self-selection, not random assignment, which may have impacted the results.
- 25 -
Environmental Competence
Primary and Secondary School
2. A series of three field trips to natural sites for students in Grades 3–6 that focused
on the topics of watershed, food webs, native plants, geology, and wildlife.
Higher Education
- 26 -
when they could participate in the focal activity. Another study examined the impact of
mental contrasting plus implementation intentions on decreasing meat consumption
(Loy, Wieber, Gollwitzer, & Oettingen, 2016). The mental contrasting component of the
intervention involved setting a goal around meat consumption, imagining completing
the goal and associated positive outcomes, then contrasting that image with current
obstacles that might prevent goal achievement. This intervention helped students
convert the intention to reduce meat consumption into behavioral change.
- 27 -
Image by Christof Van Der Walt
- 28 -
Assessing Social Responsibility
To support the development of social responsibility, it is also important to have
reliable and valid measures of these skills. Accurate assessment helps to document
whether social responsibility interventions have a meaningful impact and can
also serve as a tool when teaching social responsibility. Instructors can use social
responsibility assessments to identify where students are in their development
of this skill, which can inform the type and level of intervention that is needed.
Assessments also support students’ self-reflection by providing them with feedback
regarding their practice of social responsibility. Table 2 presents several measures
relevant to social responsibility, along with their alignment to our specific dimensions
of competence. We review many of these measures in more detail in later sections.
We will first provide an overview of evidence-centered design (ECD), which is the
framework we use for our discussion about assessing social responsibility.
• Multicultural Personality Questionnaire (van der Zee & van Oudenhoven, 2000)
• Defining Issues Test (DIT-2; Rest, Narvaez, Thoma, & Bebeau, 1999)
• Engineering and Science Issues Test (ESIT; Borenstein, Drake, Kirkman, & Swann, 2010)
Ethical
• Ethical Reasoning VALUE rubric (AAC&U, 2009b)
• Civic Competence Composite Indicator 2 (CCCI-2; Hoskins, Villalba, & Saisana, 2012)
- 29 -
Dimension of Competence Representative Measures
• New Ecological Paradigm Scale for Children (Manoli, Johnson, & Dunlap, 2007)
Evidence-Centered Design
ECD provides a systematic framework for developing assessment tasks to
elicit targeted skills (Mislevy, Steinberg, & Almond, 2003). ECD is particularly
useful when applied to complex skills like social responsibility because
it supports the development of more authentic activity types.
1. The Student Model defines the claims to be made about learners’ competencies.
2. The Evidence Model establishes what constitutes valid evidence of the claim.
Within the ECD framework, the targeted competencies and skills are defined within
the Student Model. Our framework of social responsibility competences represents
the Student Model. Next, the assessment designer identifies what evidence, typically
some sort of student behavior, would be a valid indicator of a given competency.
This set of evidence represents the Evidence Model. Lastly, specific activities (the
Task Model) are identified or designed that will elicit components of the Evidence
Model. Crucial to the ECD framework is a thread linking activity features, evidence
elicited from these activities, and claims made about student competencies.
- 30 -
2011; Spencer, 1938). Many aspects of social responsibility (i.e. behaving ethically) are
clearly socially favorable, so the individual taking a self-report assessment may offer
inaccurate responses to appear a good person. In later sections, we will discuss more
authentic assessment tasks that can help address concerns around social desirability.
Another common task model used in the assessment of social responsibility involves
presenting individuals with a hypothetical scenario followed by questions about possible
responses to that scenario. Individuals may be asked to indicate the best response, to
evaluate the response of an actor in the scenario, or to explain their reasoning behind their
selection of a response. While not completely authentic, these types of tasks mimic real-life
situations and provide evidence about how students would behave if placed in that situation.
The Defining Issues Test (DIT-2; Rest, Narvaez, Thoma, & Bebeau, 1999) represents
a dilemma-based assessment of ethical competence, particularly the aspect of
ethical reasoning. Students read several ethical dilemmas, each of which presents
a difficult choice for the main actor within the dilemma (i.e. “A father contemplates
stealing food for his starving family from the warehouse of a rich man hoarding food”
(Rest et al., 1999, p. 649)). Then students read through several issues which could
be considered when deciding the best course of action (twelve per dilemma) and
rank the importance of each issue in making their decision. The issues are aligned
to different aspects of moral reasoning and include questions like how other people
might respond to the behavior or whether the behavior would break any laws. Students
are also asked to rank the four most important issues for making a decision.
Borenstein, Drake, Kirkman, & Swann (2010) adapted the DIT-2 to include dilemmas
and issues specific to the fields of engineering and science (the Engineering
and Science Issues Test; ESIT). The ESIT followed the same format of the DIT-2,
including the presentation of a dilemma and ranking of issues relevant to making
a decision. One dilemma focuses on an engineer who must select a vendor to
stop working with, and she owns stock in the company of one of the potential
vendors. Example issues include, “Will [the engineer’s] decision potentially cause
harm to the public?” (Borenstein et al., 2010, p. 392). The ratings and rankings were
combined into indices analogous to the P-Score and N2 Score of the DIT-2.
- 31 -
“
An employer you work for has identified
new sustainability measures to reduce
environmental and social impacts as a result
of the business’ practice. These changes
require you to develop new knowledge and
make small changes to your work procedures.
How are you most likely to respond?
- 32 -
Mumford and colleagues (2006) applied scenario-based tasks to measure ethical
decision-making. Scenarios were written that reflected the day-to-day work of
researchers and incorporated both ethical and technical issues. After reading the
scenario, students were asked to assume the role of the primary actor in the scenario
and to choose which of two response options would best resolve the situation. Response
options were actions that could be taken in the scenario. Each response option had been
labeled by the assessment developers as either highly ethical, moderately ethical, or
unethical, based on ethical principles outlined in professional codes of conduct. Scoring
occurred by assigning a points weight to each of the two response options selected for
each scenario (3 = highly ethical, 2 = moderately ethical, and 1 = unethical). The scenarios
fell in separate domains (data management, study conduct, professional practices, and
business practices), and students were assigned an ethical decision-making score for
each domain. One example scenario involved a situation where one researcher in a
lab (Reynolds) uses a modified version of another researcher’s (Moss’s) ideas in a grant
proposal. The scenario asked the student to assume the role of the lab director and
choose the best action to take from options like: “Apologize to Moss and indicate that
the proposal must go out as is to meet the deadline” and “Acknowledge Moss in the
grant proposal because the ideas were hers originally” (Mumford et al., 2006, p. 344).
Students were given several response options and asked to select which one they
would be most likely to choose. Each response was associated with a different
level of attainment of the “environmentally aware and responsible” attribute,
which ranged from lacking the attribute, to awareness, then responsibility, with
leadership being the highest level. Table 3 depicts the alignment between the
response options, levels of attainment, and descriptors of each level. Students
were assigned a level of attribute attainment based on their response selection.
Level of Attribute
Response Option Attainment Level of Attribute Attainment Descriptor
Do not consider your workplace to Does not recognize social and environmental
Attribute lacking
negatively impact the environment impacts of practice or human activity
Be aware of the impacts and Recognizes social and environmental impacts of practice or
let others take responsibility Awareness 2 human activity and sees that some level of change may be
for reducing impacts necessary; however, leaves it to others to take responsibility
- 33 -
Level of Attribute
Response Option Attainment Level of Attribute Attainment Descriptor
Table 3 Alignment between vignettes’ response options and level of attribute attainment (adapted from Holdsworth, Thomas, & Sandri, 2018, p. 127 and p. 130).
“A group of students from another country is going to visit your university, and each
student will be placed with a local family during the stay. Select the options for the blanks
that, taken together, would produce the best direction for encouraging a positive cultural
exchange. The university should take care to [Blank1] in order to make sure that [Blank2].”
Blank 1 options:
- 34 -
Blank 2 options:
the family does not have to adjust their lifestyle in any way.
Performance-Based Tasks
The AAC&U has published several VALUE rubrics that align to each of our social
responsibility dimensions of competence (Rhodes, 2010; AAC&U, 2009a, 2009b, 2009c,
2014). For example, the “Civic Engagement, Local and Global” rubric can be used to
assess the degree to which a student “is working to make a difference in the civic life
of our communities [and] promoting the quality of life in a community, through both
political and non-political processes” (AAC&U, 2009a). The rubric is meant to be applied
to a student work sample, or a collection of work samples. An example of relevant work
for the Civic Engagement rubric includes “creat[ing] and manag[ing] a service program
that engages others (such as youth or members of a neighborhood) in learning about
and taking action on an issue they care about” (AAC&U, 2009a). There are several
dimensions within the Civic Engagement rubric, each of which can be rated on a scale
of 1 to 4, ranging from Benchmark to Capstone. Table 4 depicts the four descriptors
that align to each level within the dimension of “Civic Actions and Reflections.”
- 35 -
Level of Performance Descriptor
Has experimented with some civic activities but shows little internalized
Benchmark 1
understanding of their aims or effects and little commitment to future action
Table 4 AAC&U VALUE rubric descriptions for Civic Actions and Reflections (AAC&U, 2009a).
The AAC&U has also developed VALUE rubrics for the skills of “Intercultural
Knowledge and Competence” (AAC&U, 2009c), “Ethical Reasoning” (AAC&U,
2009b), and “Global Learning” (AAC&U, 2014), each of which have elements that
align to our multicultural, ethical, and environmental dimensions respectively.
- 36 -
- 37 -
Conclusions and Recommendations
The research reviewed here reveals a number of important conclusions regarding
teaching and assessing social responsibility, which are summarized in Table 5. The
recommendations also included in Table 5 provide a general set of best practices that, if
enacted, can help enable effective instruction and assessment for social responsibility.
Conclusion Recommendation
Social responsibility includes several key dimensions of Educators should address each of these specific
competence: multicultural, ethical, civic, and environmental. dimensions of competence in their instruction.
For college students, ethical competence training appears College instructors should focus on teaching students about how
most effective for supporting field-specific ethical behavior and to behave ethically in particular contexts relevant to their future
decision-making as opposed to more general ethical reasoning. careers as well as ethical decision-making. Instructional strategies
In particular, active participation, case-based instruction, and that particularly support ethical competence include active
opportunities for practice support effective ethical training. participation, case-based instruction, and opportunities for practice.
For college students, service learning, diversity College instructors can encourage students to participate
experiences, and social-justice coursework were in service learning, diversity experiences, and social justice
all associated with civics competence. coursework as ways to develop civic competence.
- 38 -
Conclusion Recommendation
There are many self-report and informant-report Educators may consider self-report and informant-
questionnaires that assess social responsibility, report questionnaires to measure social responsibility,
particularly relevant attitudes and values. particularly relevant attitudes and values.
Scenario- or dilemma-based measures, performance- Educators may consider scenario- or dilemma-based measures,
based assessments, and the application of rubrics performance-based assessments, and the application of rubrics
to student behavior or work products offer other to student behavior or work products to assess knowledge
avenues for more authentic assessment. and behaviors associated with social responsibility.
- 39 -
American Chemical Society. (2015). Guidelines for Bamberg, S. (2002). Effects of implementation intentions
chemistry programs and two-year and community on the actual performance of new environmentally
colleges. Retrieved from https://www.acs.org/content/ friendly behaviours: Results of two field experiments.
dam/acsorg/education/policies/twoyearcollege/2015_ Journal of Environmental Psychology, 22(4), 399–411.
guidelines_for_two_year_college_prorgrams.pdf
Bardi, A., & Schwartz, S. H. (2003). Values and behavior:
American Nurses Association. (2003). Code of ethics. Strength and structure of relations. Personality and
Retrieved from https://www.nursingworld.org/practice-policy/ Social Psychology Bulletin, 29(10), 1207–1220.
nursing-excellence/ethics/code-of-ethics-for-nurses/
Bartoş, S. E., Berger, I., & Hegarty, P. (2014). Interventions to
American Psychological Association. (2003). Ethical reduce sexual prejudice: A study-space analysis and meta-
principles of psychologists and code of conduct. analytic review. The Journal of Sex Research, 51(4), 363–382.
Retrieved from https://www.apa.org/ethics/code/
Battistich, V., Watson, M., Solomon, D., Schaps, E., &
American Psychological Association. (2017). Multicultural Solomon, J. (1991). The child development project: A
guidelines: An ecological approach to context, identity, comprehensive program for the development of prosocial
and intersectionality. Retrieved from http://www.apa. character. In W. M. Kurtines & J. L. Gewirtz (Eds.), Handbook
org/about/policy/multicultural-guidelines.pdf of moral behavior and development (3 vols., vol. III, pp.
1–34). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay,
C., & Chandrasekar, N. A. (2007). Cultural intelligence: Battistoni, R., Berman, S. H., Billig, S. H., Both, D., Fickling
Its measurement and effects on cultural judgment and Brainard, A., Brown, N. . . . Levine, P. (2003). The civic mission
decision making, cultural adaptation and task performance. of schools: A report from Carnegie Corporation of New
Management and Organization Review, 3(3), 335–371. York and CIRCLE: The Center for Information and Research
on Civic Learning and Engagement. Retrieved from https://
Association of American Colleges and Universities. (2009a). civicyouth.org/PopUps/CivicMissionofSchools.pdf
Civic engagement VALUE rubric. Retrieved from https://
www.aacu.org/civic-engagement-value-rubric Beane, J., Turner, J., Jones, D., & Lipka, R. (1981). Long-term effects of
community service programs. Curriculum Inquiry, 11(2), 143–155.
Association of American Colleges and Universities. (2009b).
Ethical reasoning VALUE rubric. Retrieved from https:// Beelmann, A., & Heinemann, K. S. (2014). Preventing
www.aacu.org/ethical-reasoning-value-rubric prejudice and improving intergroup attitudes: A meta-
analysis of child and adolescent training programs. Journal
Association of American Colleges and Universities. (2009c). of Applied Developmental Psychology, 35(1), 10–24.
Intercultural knowledge and competence VALUE rubric. Retrieved
from https://www.aacu.org/value/rubrics/intercultural-knowledge Beelmann, A., Pfingsten, U., & Lösel, F. (1994). Effects of training
social competence in children: A meta-analysis of recent evaluation
Association of American Colleges and Universities. studies. Journal of Clinical Child Psychology, 23(3), 260–271.
(2014). Global learning VALUE rubric. Retrieved from
https://www.aacu.org/value/rubrics/global Beets, M. W., Flay, B. R., Vuchinich, S., Snyder, F. J., Acock, A.,
Li, K.-K., . . . Durlak, J. (2009). Use of a social and character
Association of American Colleges and Universities. (n.d.). development program to prevent substance use, violent behaviors,
Character traits associated with the five dimensions of personal
and sexual activity among elementary-school students in
and social responsibility. Retrieved from https://www.aacu. Hawaii. American Journal of Public Health, 99(8), 1438–1445.
org/sites/default/files/CharacterTraitsofthe5Dimensions.pdf
Berman, S. (1997). Children’s social consciousness and the
development of social responsibility. Albany, NY: SUNY Press.
- 40 -
Bers, M. U., & Chau, C. (2006). Fostering civic engagement the gender bias habit for faculty at one institution: A clustered
by building a virtual city. Journal of Computer- randomized, controlled trial. Academic Medicine, 90(2), 221–230.
Mediated Communication, 11(3), 748–770.
Celio, C. I., Durlak, J., & Dymnicki, A. (2011). A meta-
Bers, M. U., & Chau, C. (2010). The virtual campus of the future: analysis of the impact of service-learning on students.
Stimulating and simulating civic actions in a virtual world. Journal of Experiential Education, 34(2), 164–181.
Journal of Computing in Higher Education, 22(1), 1–23.
Character Education Partnership. (2010). Character Education
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller- Partnership. Retrieved from http://www.character.org/site/
Ricci, M., & Rumble, M. (2012). Defining twenty-first century
Clarkeburn, H. (2002). A test for ethical sensitivity in
skills. In P. Griffin, B. McGraw, & E. Care (Eds.), Assessment and
science. Journal of Moral Education, 31(4), 439–453.
teaching of 21st century skills (pp. 17–66). Dordrecht: Springer.
Devine, P. G., Forscher, P. S., Cox, W. T. L., Kaatz, A., Sheridan, J.,
Bryant, A. N., Gayles, J. G., & Davis, H. A. (2012). The relationship
& Carnes, M. (2017). A gender bias habit-breaking intervention
between civic behavior and civic values: A conceptual
led to increased hiring of female faculty in STEMM departments.
model. Research in Higher Education, 53(1), 76–93.
Journal of Experimental Social Psychology, 73, 211–215.
Cameron, L., Rutland, A., Brown, R., & Douch, R. (2006). Changing
DiCerbo, K. E. (2014). Game-based assessment of persistence.
children’s intergroup attitudes toward refugees: Testing different
Journal of Educational Technology & Society, 17(1), 17–28.
models of extended contact. Child Development, 77(5), 1208–1219.
REFERENCES
- 41 -
Dziedziewicz, D., Gajda, A., & Karwowski, M. (2014). Happé, F. G. E. (1994). An advanced test of theory of mind:
Developing children’s intercultural competence and Understanding of story characters’ thoughts and feelings by able
creativity. Thinking Skills and Creativity, 13, 32–42. autistic, mentally handicapped, and normal children and adults.
Journal of Autism and Developmental Disorders, 24(2), 129–154.
Eccles, J. S., & Barber, B. L. (1999). Student council,
volunteering, basketball, or marching band. Journal Hart Research Associates. (2015). Falling short?
of Adolescent Research, 14(1), 10–43. College learning and career success. Washington, DC:
Association of American Colleges and Universities.
Educational Testing Service. (2017). HEIghten® intercultural
competency and diversity assessment sample questions. Hayes, S. C., Bissett, R., Roget, N., Padilla, M., Kohlenberg, B.
Retrieved from https://www.ets.org/s/heighten/pdf/ S., Fisher, G., . . . Niccolls, R. (2004). The impact of acceptance
intercultural-competency-diversity-sample-questions.pdf and commitment training and multicultural training on the
stigmatizing attitudes and professional burnout of substance
Eisenberg, J., Lee, H. J., Brück, F., Brenner, B., Claes, M. T., abuse counselors. Behavior Therapy, 35(4), 821–835.
Mironski, J., & Bell, R. (2013). Can business schools make
students culturally competent? Effects of cross-cultural Heartwood Institute. (1992). An ethics curriculum for
management courses on cultural intelligence. Academy of children. Pittsburgh, PA: The Heartwood Institute.
Management Learning and Education, 12(4), 603–621.
Hofmann, S. G., Doan, S. N., Sprung, M., Wilson, A.,
Ernst, J., & Theimer, S. (2011). Evaluating the effects of Ebesutani, C., Andrews, L. A., . . . Harris, P. L. (2016).
environmental education programming on connectedness to Training children’s theory-of-mind: A meta-analysis
nature. Environmental Education Research, 17(5), 577–598. of controlled studies. Cognition, 150, 200–212.
Feldman, L., Pasek, J., Romer, D., & Jamieson, K. H. Holdsworth, S., Thomas, I., & Sandri, O. (2018). Assessing graduate
(2007). Identifying best practices in civic education: sustainability attributes using a vignette/scenario approach.
Lessons from the Student Voices program. American Journal of Education for Sustainable Development, 12(2), 120–139.
Journal of Education, 114(1), 75–100.
Hoskins, B., Villalba, C., & Saisana, M. (2012). The 2011
Finlay, A. K., Wray-Lake, L., Warren, M., & Maggs, J. civic competence composite indicator (CCCI-2): Measuring
(2015). Anticipating their future. International Journal young people’s civic competence across Europe based
of Behavioral Development, 39(4), 359–367. on the IEA international citizenship and civic education
study. Retrieved from http://publications.jrc.ec.europa.
Flanagan, C. A., Syvertsen, A. K., & Stout, M. D. (2007). eu/repository/bitstream/JRC68398/lbna25182enn.pdf
Civic measurement models: Tapping adolescents’
civic engagement. College Park, MD: CIRCLE. Huang, J., van den Brink, H. M., & Groot, W. (2009). A
meta-analysis of the effect of education on social capital.
Gollwitzer, P. M., & Sheeran, P. (2006). Implementation intentions Economics of Education Review, 28(4), 454–464.
and goal achievement: A meta-analysis of effects and processes.
Advances in Experimental Social Psychology, 38, 69–119. Hyman, J. B. (2002). Exploring social capital and civic
engagement to create a framework for community building.
Gonyea, R. M. (2005). Self-reported data in institutional Applied Developmental Science, 6(4), 196–202.
research: Review and recommendations. In P. D.
Umbach (Ed.), Survey research: Emerging issues International Council of Nurses (2012). The ICN code
(pp. 73–89). San Francisco, CA: Jossey-Bass. of ethics for nurses. Retrieved from http://www.old.
icn.ch/who-we-are/code-of-ethics-for-nurses/
Goodman, M. S., Dias, J. J., & Stafford, J. D. (2010).
Increasing research literacy in minority communities: Kahne, J., Chi, B., & Middaugh, E. (2006). Building social
CARES Fellows training program. Journal of Empirical capital for civic and political engagement: The potential of
Research on Human Research Ethics, 5(4), 33–41. high-school civics courses. Canadian Journal of Education/
Revue Canadienne de l’éducation, 29(2), 387–409.
Griffith, R. L., Wolfeld, L., Armon, B. K., Rios, J., & Liu,
O. L. (2016). Assessing intercultural competence Kahne, J., & Sporte, S. (2008). Developing citizens: The impact of
in higher education: Existing research and future civic learning opportunities on students’ commitment to civic
directions. ETS Research Report Series, 2, 1–44. participation. American Educational Research Journal, 45(3),
REFERENCES
- 42 -
738–766. Retrieved from https://consortium.uchicago.edu/sites/ Loy, L. S., Wieber, F., Gollwitzer, P. M., & Oettingen, G.
default/files/2019-02/6621developing_citizens_aerj_final.pdf (2016). Supporting sustainable food consumption: Mental
Contrasting with Implementation Intentions (MCII) aligns
Kahne, J., & Westheimer, J. (2006). The limits of political intentions and behavior. Frontiers in Psychology, 7, 607.
efficacy: Educating citizens for a democratic society.
PS: Political Science & Politics, 39(2), 289–296. Manoli, C. C., Johnson, B., & Dunlap, R. E. (2007). Assessing
children’s environmental worldviews: Modifying and validating
Kohlberg, L. (1976). Moral stages and moralization: The the new ecological paradigm scale for use with children.
cognitive-developmental approach. In T. Lickona (Ed.), The Journal of Environmental Education, 38(4), 3–13.
Moral development and behavior: Theory, research and
social issues (pp. 31–53). Holt, NY: Rinehart & Winston. Mansilla, B. M., & Jackson, A. (2011). Educating for
global competence: Redefining learning for an
Kohlberg, L. (1981). Essays on moral development, interconnected world. In H. H. Jacobs (Ed.), Mastering
vol. I: The philosophy of moral development. global literacy: Contemporary perspectives on literacy
San Francisco, CA: Harper & Row. (pp. 5–27). Bloomington, IN: Solution Tree Press.
Krings, A., Austic, E. A., Gutiérrez, L. M., & Dirksen, K. E. (2015). Marcelo, K. B. (2007). Young urban voters in the midterm
The comparative impacts of social justice educational methods election year of 2006 [CIRCLE fact sheet]. Retrieved
on political participation, civic engagement, and multicultural from https://civicyouth.org/featured-young-urban-
activism. Equity & Excellence in Education, 48(3), 403–417. voters-in-the-midterm-election-year-2006/
Lecce, S., Bianco, F., Devine, R. T., Hughes, C., & Banerjee, R. (2014). Masuda, A., Hayes, S. C., Fletcher, L. B., Seignourel, P. J.,
Promoting theory of mind during middle childhood: A training Bunting, K., Herbst, S. A., . . . Lillis, J. (2007). Impact of
program. Journal of Experimental Child Psychology, 126, 52–67. acceptance and commitment therapy versus education
on stigma toward people with psychological disorders.
Leeming, F. C., Dwyer, W. O., & Bracken, B. A. (1995). Children’s
Behaviour Research and Therapy, 45(11), 2764–2772.
environmental attitude and knowledge scale: Construction and
validation. The Journal of Environmental Education, 26(3), 22–31. Mayer, F. S., & Frantz, C. M. (2004). The connectedness to nature
scale: A measure of individuals’ feelings in community with
Leming, J. S. (2000). Tell me a story: An evaluation of
nature. Journal of Environmental Psychology, 24(4), 503–515.
a literature-based character education programme.
Journal of Moral Education, 29(4), 413–427. McDevitt, M., & Kiousis, S. (2006). Experiments in
political socialization: Kids voting USA as a model for
Leming, J. S. (2001). Integrating a structured ethical
civic education reform. Retrieved from http://civicyouth.
reflection curriculum into high school community
org/PopUps/WorkingPapers/WP49McDevitt.pdf
service experiences: Impact on students’ sociomoral
development. Adolescence, 36(141), 33–45. Medeiros, K. E., Watts, L. L., Mulhearn, T. J., Steele, L. M., Mumford,
M. D., & Connelly, S. (2017). What is working, what is not, and
Lickona, T. (1989). Educating for character: How our schools
what we need to know: A meta-analytic review of business
can teach respect and responsibility. New York, NY: Bantam.
ethics instruction. Journal of Academic Ethics, 15(3), 245–275.
Lillis, J., & Hayes, S. C. (2007). Applying acceptance,
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). Focus article:
mindfulness, and values to the reduction of prejudice: A
On the structure of educational assessments. Measurement:
pilot study. Behavior Modification, 31(4), 389–411.
Interdisciplinary Research and Perspectives, 1(1), 3–62.
Liu, O. L., Roohr, K. C., & Rios, J. A. (2018). Assessing civic
Mumford, M. D., Devenport, L. D., Brown, R. P., Connelly,
and intercultural competency in higher education: The ETS
S., Murphy, S. T., Hill, J. H., & Antes, A. L. (2006). Validation
HEIghten® approach. ETS Research Report Series, 1, 1–18.
of ethical decision making measures: Evidence for a new
Lott, J. L., & Eagan, M. K. (2011). Assessing the set of measures. Ethics & Behavior, 16(4), 319–345.
psychometric properties of civic values. Journal of Student
Muñoz, M. A., & Vanderhaar, J. E. (2006). Literacy-embedded
Affairs Research and Practice, 48(3), 333–347.
character education in a large urban district: Effects of the
Lowman, R. L. (2013). Internationalizing multiculturalism: Child Development Project on elementary school students
Expanding professional competencies in a globalized world. and teachers. Journal of Character Education, 4(1&2), 47–64.
Washington, DC: American Psychological Association.
REFERENCES
- 43 -
National Assessment Governing Board. (2014). Civics framework for Rhodes, T. (2010). Assessing outcomes and improving
the 2014 National Assessment of Educational Progress. Retrieved achievement: Tips and tools for using rubrics. Washington,
from https://www.nagb.gov/content/nagb/assets/documents/ DC: Association of American Colleges and Universities.
publications/frameworks/civics/2014-civics-framework.pdf
Schmidt, J. A., Shumow, L., & Kackar, H. (2007).
Okoye-Johnson, O. (2011). Does multicultural education Adolescents’ participation in service activities and its
improve students’ racial attitudes? Implications for closing the impact on academic, behavioral, and civic outcomes.
achievement gap. Journal of Black Studies, 42(8), 1252–1274. Journal of Youth and Adolescence, 36(2), 127–140.
O’Neill, N. (2012). Promising practices for personal and social Schultz, L. H., Barr, D. J., & Selman, R. L. (2001). The value of a
responsibility: Findings from a national research collaborative. developmental approach to evaluating character development
Washington, DC: Association of American Colleges and Universities. programmes: An outcome study of Facing History and
Ourselves. Journal of Moral Education, 30(1), 3–27.
Osbaldiston, R., & Schott, J. P. (2012). Environmental sustainability
and behavioral science. Environment and Behavior, 44(2), 257–299. Shami, N. S., Box, N., Fort, T., & Gordon, M. (2004). Designing a
globalization simulation to teach corporate social responsibility.
Parker, D. C., Nelson, J. S., & Burns, M. K. (2010). Comparison Developments in Business Simulation and Experiential Learning:
of correlates of classroom behavior problems in schools Proceedings of the Annual ABSEL Conference. Retrieved from
with and without a school-wide character education https://absel-ojs-ttu.tdl.org/absel/index.php/absel/article/view/634
program. Psychology in the Schools, 47(8), 817–827.
Smith, S. J., Axelton, A. M., & Saucier, D. A. (2009).
Pasek, J., Feldman, L., Romer, D., & Jamieson, K. H. (2008). The effects of contact on sexual prejudice: A meta-
Schools as incubators of democratic participation: analysis. Sex Roles, 61(3–4), 178–191.
Building long-term political efficacy with civic education.
Applied Developmental Science, 12(1), 26–37. Smith, T. B., Constantine, M. G., Dunn, T. W., Dinehart,
J. M., & Montoya, J. A. (2006). Multicultural education in
Peterson, C., & Park, N. (2009). Classifying and measuring the mental health professions: A meta-analytic review.
strengths of character. In S. J. Lopez & C. R. Snyder Journal of Counseling Psychology, 53(1), 132–145.
(Eds.), Oxford handbook of positive psychology (2nd
ed., pp. 25–33). Oxford: Oxford University Press. Spencer, D. (1938). The frankness of subjects on personality
measures. Journal of Educational Psychology, 29(1), 26–35.
Peterson, C., & Seligman, M. E. (2004). Character
strengths and virtues: A handbook and classification Stayhorn, T. L., Creamer, D. G., Miller, T. K., & Arminio,
(vol. I). Oxford: Oxford University Press. J. (2006). Frameworks for assessing learning and
development outcomes. Cabot, AR: Council for the
Proctor, C., Tsukayama, E., Wood, A. M., Maltby, J., Eades, J. F., Advancement of Standards in Higher Education.
& Linley, P. A. (2011). Strengths gym: The impact of a character
strengths-based intervention on the life satisfaction and well-being Stokamer, S. T. (2011). Pedagogical catalysts of civic
of adolescents. The Journal of Positive Psychology, 6(5), 377–388. competence: The development of a critical epistemological
model for community-based learning. Unpublished doctoral
Project Learning Tree. (1998). Exploring environmental issues: dissertation. Portland State University, Portland.
Focus on risk. Washington, DC: American Forest Foundation.
Strom, M. S., Sleeper, M., & Johnson, M. (1992). Facing
Putnam, R. D. (1995). Tuning in, tuning out: The history and ourselves: A synthesis of history and
strange disappearance of social capital in America. ethics in effective history education. In A. Garrod (Ed.),
PS: Political Science and Politics, 28(4), 664–683. Learning for life: Moral education theory and practice
(pp. 131–153). Westport, CT: Praeger Publishers.
Rest, J. R., & Narvaez, D. (1998). Guide for DIT2.
Minneapolis, MN: Center for the Study of Ethical Syvertsen, A. K., Stout, M. D., Flanagan, C. A., Mitra, D. L., Oliver, M.
Development, University of Minnesota. B., & Sundar, S. S. (2009). Using elections as teachable moments:
A randomized evaluation of the Student Voices civic education
Rest, J. R., Narvaez, D., Thoma, S. J., & Bebeau, M. J. (1999).
program. American Journal of Education, 116(1), 33–67.
DIT2: Devising and testing a revised instrument of moral
judgment. Journal of Educational Psychology, 91(4), 644–659. Torney-Purta, J., Cabrera, J. C., Roohr, K. C., Liu, O. L., & Rios, J. A.
(2015). Assessing civic competency and engagement in higher
REFERENCES
- 44 -
education: Research background, frameworks, and directions for Watts, L. L., Medeiros, K. E., Mulhearn, T. J., Steele, L. M., Connelly,
next-generation assessment. ETS Research Report Series, 2, 1–48. S., & Mumford, M. D. (2017). Are ethics training programs
improving? A meta-analytic review of past and present ethics
van Berkhout, T. E., & Malouff, J. M. (2016). The efficacy of instruction in the sciences. Ethics & Behavior, 27(5), 351–384.
empathy training: A meta-analysis of randomized controlled
trials. Journal of Counseling Psychology, 63(1), 32–41. Westheimer, J., & Kahne, J. (2004). What kind of citizen?
The politics of educating for democracy. American
van der Zee, K. I., & van Oudenhoven, J. P. (2000). Educational Research Journal, 41(2), 237–269.
The multicultural personality questionnaire: A
multidimensional instrument of multicultural effectiveness. White, S., Hill, E., Happé, F., & Frith, U. (2009). Revisiting
European Journal of Personality, 14(4), 291–309. the strange stories: Revealing mentalizing impairments
in autism. Child Development, 80(4), 1097–1117.
Vance, D., & Stockwell, C. (2002). Smart character
choices: Character education curriculum and Williams, J. E., Best, D. L., Boswell, D. A., Mattson, L. A., &
program. Howell, MI: Smart Character Choices. Graves, D. J. (1975). Preschool racial attitude measure II.
Educational and Psychological Measurement, 35(1), 3–18.
Ventura, M., & Shute, V. (2013). The validity of a
game-based assessment of persistence. Computers Youniss, J., Bales, S., Christmas-Best, V., Diversi, M., McLaughlin,
in Human Behavior, 29(6), 2568–2572. M., & Silbereisen, R. (2002). Youth civic engagement in the twenty-
first century. Journal of Research on Adolescence, 12(1), 121–148.
Wagner, L., Gander, F., Proyer, R. T., & Ruch, W. (2019). Character
strengths and PERMA: Investigating the relationships of
character strengths with a multidimensional framework
of well-being. Applied Research in Quality of Life, 1–22.
REFERENCES
- 45 -
- 46 -