Improving Mental Health Literacy: A Review of The Literature

Download as pdf or txt
Download as pdf or txt
You are on page 1of 116

Improving Mental Health Literacy: A

Review of the Literature



June 2002



Catherine Francis, Jane Pirkis, David Dunt
Centre for Health Program Evaluation, The University of
Melbourne

R. Warwick Blood
School of Professional Communication, The University of
Canberra

Cathy Davis
School of Social Work, Australian Catholic University
Signadou Campus, Canberra


2
Table of Contents
EXECUTIVE SUMMARY 4
INTRODUCTION 4
PURPOSE OF THE REVIEW 4
RESEARCH QUESTION 4
METHOD 4
REVIEW OF INDIVIDUAL STUDIES 5
HEALTH COMMUNICATION CAMPAIGNS 6
CONCLUSIONS 7
1. INTRODUCTION 8
MENTAL HEALTH LITERACY 8
PURPOSE OF THE REVIEW 9
RESEARCH QUESTION 9
METHOD 10
2. REVIEW OF INDIVIDUAL STUDIES - WHOLE OF COMMUNITY
PROGRAMS 13
MASS MEDIA CAMPAIGNS 13
OTHER MODES OF DELIVERY 20
METHODOLOGICAL ISSUES 23
SUMMARY 25
3. REVIEW OF INDIVIDUAL STUDIES - PROGRAMS TARGETED TO
SPECIFIC POPULATIONS 34
CARERS AND FAMILIES OF PEOPLE WITH MENTAL ILLNESS 34
SCHOOL-BASED PROGRAMS FOR ADOLESCENTS 41
PEOPLE FROM NON-ENGLISH SPEAKING BACKGROUNDS 46
METHODOLOGICAL ISSUES 48
SUMMARY 50
4. HEALTH COMMUNICATION CAMPAIGNS 64
OVERVIEW OF THE COMMUNICATION CAMPAIGN LITERATURE 64
ADVERTISING AND COMMUNICATION CAMPAIGNS 69
ANALYSIS OF THE COMMUNICATION CAMPAIGN LITERATURE 72
SUMMARY 79
5. CONCLUSIONS 81
3
RESEARCH QUESTION 81
METHODOLOGICAL ISSUES 88
APPENDIX 1 PREVIOUS REVIEWS OF THE LITERATURE 93
REVIEWS OF MENTAL HEALTH LITERACY PROGRAMS 93
REVIEWS OF COMMUNICATION CAMPAIGNS 96
REFERENCES 110
4
Executive Summary
Introduction
The National Mental Health Strategy has a strong emphasis on mental health
promotion and mental illness prevention. The Second National Mental Health Plan
aims to build on the work of the first five years of the Strategy by focusing on the
mental health literacy of key groups in key settings (Australian Health Ministers
1998; 1999).

The term mental health literacy was coined by J orm et al (1997) as an extension of
the concept of health literacy. It may be defined as knowledge and beliefs about
mental disorders which aid their recognition, management or prevention. It includes:
the ability to recognise specific disorders; knowing how to seek mental health
information; knowledge of risk factors and causes, of self-treatments and of
professional help available; and attitudes that promote recognition and appropriate
help-seeking.

Activities designed to improve mental health literacy are a significant component of
mental health promotion. Strategies for improving mental health literacy generally
comprise education and communication approaches. These activities may be
classified in a number of different ways, and can be considered in terms of scope,
mode of delivery, scale, and setting.

Recent studies of mental health literacy in Australia have shown that the public are
not very well informed about mental illness. It is important that the level of mental
health literacy in the population be improved in order for individuals to recognise
mental illness and manage their own mental health more effectively. Improving
overall mental health literacy is also important in terms of overcoming stigma
associated with mental illness.
Purpose of the review
The aim of this literature review is to evaluate and interpret current research relating
to improving mental health literacy, in order to identify the most effective
communication strategies and tools to improve mental health literacy among target
audiences in the Australian population. The review involves a systematic examination
of the available research. In addition, this report provides an overview of the literature
relating to public health information campaigns.
Research question
What are the most effective communication strategies and tools to improve mental
health literacy among target audiences in the Australian population?
Method
Literature relating to mental health literacy programs was identified through a number
of database searches using relevant search terms. Appropriate databases were
searched for English language articles dated from 1980 to May 2002. The databases
searched included: Medline, PsychINFO, Current Contents, Communication
Abstracts, Cochrane Database of Systematic Reviews, EMB Reviews, York Database
5
of Abstracts of Reviews of Effectiveness, and ProQuest. In addition to database
searches, efforts were made to uncover unpublished work of relevance to the literature
review.

The relevant literature involving programs to improve mental health literacy was
identified and classified according to the following general categories:

Whole of community programs
Programs targeted to specific populations

Information relevant to the effectiveness of individual programs was extracted from
each of the studies. The methodological issues and limitations of each study were also
examined, in order to determine the validity and importance of any findings. The data
extracted from the studies were drawn together in order to provide a descriptive
review of the effectiveness of different programs to improve mental health literacy.
Review of individual studies
A range of programs identified for inclusion in this review addressed the issue of
improving mental health literacy at a whole of community level. Most of these
programs involved mass media campaigns, however a small number of studies used
other modes of delivery, such as education courses. In addition to whole of
community programs, a number of studies were identified which provided evaluations
of programs directed towards specific subgroups of the population.
Whole of community programs
Previous reviews of mental health literacy campaigns in the mass media have
indicated that there is potential for such programs to have an impact on community
attitudes, knowledge and behavioural intentions. Despite important methodological
limitations, the literature included in this review also indicates that mass media
campaigns can have a positive impact on levels of mental health literacy in the
population. Evaluations of programs conducted at national and statewide levels
generally indicated that attitudes and knowledge improved; however the extent of
changes was acknowledged to be limited. While it may be concluded that mass media
campaigns are a potentially effective approach to improving mental health literacy, it
should be acknowledged that such strategies are generally expensive, and none of the
studies adequately addressed the issue of cost-effectiveness.

Studies of modes of delivery other than mass media were not common, and were less
conclusive about changes in knowledge, attitudes and behaviour. There were,
however, indications that social contact with people experiencing mental illness may
be associated with improved community attitudes.

A number of recommendations may be made about the content and mode of delivery
of campaigns targeted to the whole of the community. Importantly, evaluations of
other health communication campaigns conducted in Australia and overseas have
found that messages are particularly well received when the positive outcomes of
attitudes or behaviours are communicated. With respect to mode of delivery, the
literature indicates that mass media campaigns may be most effective when
complemented by other more direct approaches, such as the dissemination of printed
materials or community activities.
6
Programs targeted to specific populations
The literature suggests that programs targeted to specific groups within the population
can improve levels of mental health literacy. It is important to note, however, that
there were significant methodological limitations associated with many of the studies
reviewed in this section, and the generalisability of the findings is limited. The
strongest evidence relates to the impact of educational interventions for families of
people with schizophrenia, and the literature indicates that programs targeted to carers
and families of people with mental illness may also result in improved outcomes for
mental health consumers. Evaluations of school-based programs targeted to
adolescents also indicated positive effects in terms of awareness and attitudes relating
to mental health issues.

Given the nature of the literature, it is clear that there is a need for further evaluations
of programs targeted to subgroups of the population, particularly in the Australian
context. It is recognised that there are various groups within the community who may
benefit from targeted mental health literacy programs, however there is little literature
addressing the issue of effectiveness of such programs at present.
Health communication campaigns
In contrast to the relatively limited amount of literature addressing mental health
literacy programs, there is a vast literature relating to public health information
campaigns. There is evidence that communication campaigns can be effective under
certain conditions for particular audiences, although evaluations of previous
communication campaigns suggest many failures and unrealistic expectations about
possible outcomes. The role of mass media campaigns in particular is likely to be in
creating awareness and knowledge of a campaign message rather than achieving
behavioural changes. It is acknowledged that mass media messages alone usually
achieve little, and therefore other supportive interventions are necessary.

In order for a communication campaign to be successful, a number of components are
considered essential. Message development is an integral component of the campaign,
and there should be widespread exposure to campaign messages. Campaign appeals
that are socially distant from audiences are generally ineffective, and messages
promoting prevention are less likely to be successful than those with immediate
positive consequences. Research should focus not only on summative evaluation,
which measures campaign outcomes, but also formative evaluation, which focuses on
campaign planning, and process evaluation, to monitor campaign implementation.

Contemporary communication campaigns are likely to recognise the capacity of
audiences to make meaning out of campaign messages, to misinterpret messages, or
even to resist messages. This model moves away from reliance on the knowledge
attitudebehaviour paradigm that underpins most of the earlier communication
campaigns and the traditional media effects theory. The newer approach to
communication campaigns acknowledges the importance of investigating the factors
that various audiences bring to their understanding and reception of communication
campaign messages.
7
Conclusions
There is evidence that mass media campaigns designed to reach the general public can
achieve positive outcomes in terms of mental health literacy. Research also indicates
that campaigns are particularly effective when they involve more than one form of
media, and include community-based components and/or direct interventions. It is,
however, important to note that the impact of such campaigns is limited. Mental
health literacy programs that target the general public but do not involve mass media
approaches appear to be less common, but show some evidence of effectiveness in
terms of attitude change. Importantly, studies of such programs have found that direct
contact with individuals with mental illness is associated with the development of
more positive attitudes.

With respect to programs targeting specific audiences, there is evidence that school-
based programs can improve mental health literacy among adolescents. It should be
noted that important methodological issues emerged in a number of studies focusing
on school-based mental health literacy programs, particularly those conducted in
Australia, which prevent firm conclusions being drawn. Some of the strongest
evidence of effectiveness of mental health literacy programs comes from studies of
educational interventions for carers and family members of people with mental
illness. In particular, programs for family members of individuals with schizophrenia
have been evaluated in a number of studies and found positive results in terms of
improvements in knowledge and attitudes.

When considering the evidence of effectiveness of health communication programs, it
is clearly important to bear in mind the theoretical basis for communication strategies.
It is apparent from the literature, however, that the majority of studies of mental
health literacy programs do not adequately address theoretical issues. Research into
mental health literacy campaigns should take into account how various audiences
acquire health knowledge and what factors motivate audiences to attend to public
health messages.

Most of the programs studied were conducted in countries other than Australia. It is
therefore difficult to determine to what extent successful programs may achieve the
same effects in the Australian context. In addition, significant methodological issues
emerged in a number of these studies, particularly those investigating school-based
programs, and the strongest evidence tends to come from evaluations of overseas
studies. There is a clear need for evaluation of mental health literacy programs in
Australia, both in terms of campaigns targeted to the general population, and those
aimed at particular sub-groups.

The issue of cost-effectiveness has not been addressed adequately in previous studies
of mental health literacy campaigns. This is clearly a key area for further research,
particularly as many programs tend to involve high cost strategies such as mass media
campaigns. In addition, much of the previous research has focused only on evaluation
of outcomes, and has tended to neglect evaluation of the development and
implementation phases of communication and information programs. It is important
that future research involves appropriate resources and methods to achieve useful
evaluation of strategies to improve mental health literacy.
8
1. Introduction

The National Mental Health Strategy has a strong emphasis on mental health
promotion and mental illness prevention. During the first five years of the Strategy,
promotion and prevention efforts focused on raising community awareness of the
prevalence of mental illness (Australian Health Ministers 1992a; 1992b). The Second
National Mental Health Plan aims to build on this work by focusing on the mental
health literacy of key groups in key settings (Australian Health Ministers 1998; 1999).

Mental health literacy
The term mental health literacy originated as an extension of the concept of health
literacy (J orm et al 1997). Nutbeam (2000) notes that health literacy has been
referred to in the health literature for at least 30 years. Health literacy is recognised as
an important aspect of health promotion, and may be defined as the personal,
cognitive and social skills which determine the ability of individuals to gain access to,
understand, and use information to promote and maintain good health (Nutbeam,
2000).

In contrast, a focus on mental health literacy has been neglected. The term mental
health literacy was coined by J orm et al (1997), who used it to describe knowledge
and beliefs about mental disorders, which aid their recognition, management or
prevention. It includes:
the ability to recognise specific disorders;
knowing how to seek mental health information;
knowledge of risk factors and causes, of self-treatments and of professional
help available; and
attitudes that promote recognition and appropriate help seeking.

Activities designed to improve mental health literacy are a significant component of
mental health promotion. Strategies for improving mental health literacy generally
comprise education and communication approaches. These activities may be
classified in a number of different ways, and can be considered in terms of:
scope universal preventive measures (i.e. targeting the whole population or
population groups), or selective preventive measures (i.e. aimed at particular
subgroups of the population);
mode of delivery e.g. mass media, brochures, oral presentations by experts
and/or community leaders etc., and whether these modes are used in isolation
or in combination;
scale small (e.g. local) or large (e.g. national); and
setting e.g. whole communities, hospitals, schools etc.

Recent studies of mental health literacy in Australia have shown that the public are
not very well informed about mental illness. A survey conducted in 2001 showed that
90% of respondents believed mental health was a significant issue in Australia, but
overall did not have a clear understanding of mental illness (Wirthlin Worldwide
Australasia Pty Ltd, 2001). In an earlier study, J orm et al (1997) found that members
of the public tended to view pharmacological treatments for depression and
9
schizophrenia as harmful, and to have a relatively negative view of mental health
specialists compared with other health professionals. J orm et al stated that the level of
mental health literacy in the population should be improved in order for individuals to
recognise mental illness and manage their own mental health more effectively.

Improving mental health literacy in the general population is also important in terms
of overcoming stigma associated with mental illness. Stigma can lead to prejudice,
discrimination and negative outcomes for people with mental illness (Corrigan and
Penn 1999; Commonwealth Department of Health and Aged Care, 2000b). In a
review of the literature on the stigma of mental illness, Hayward and Bright (1997)
defined stigma as the negative effects of a label placed on any group . . . in this case,
those who have been diagnosed as mentally ill. Corrigan and Penn (1999) stated
that the impact of stigma on a persons life might be as harmful as the effects of the
mental illness.

The attitudes of the public towards mental health issues are recognised as an
important factor in the perpetuation of the stigma experienced by people with mental
illness (Commonwealth Department of Health and Aged Care, 2000a; Kommana et al,
1997). Research has indicated that those with a better understanding of mental illness
are less likely to hold stigmatising attitudes (Link and Cullen 1986; Brockington et al
1993; Wolff et al 1996; 1996b; Corrigan and Penn 1999). Kommana et al (1997)
discussed the role of social psychology theory and attitude change in overcoming
stigma, stating that changing public attitudes was a crucial step in eliminating stigma.
They argued that stereotypes and misconceptions can be dispelled by promoting direct
contact between the general public and people with mental illnesses, however, they
also stated that overcoming stigma may be achieved more efficiently by disseminating
realistic information through public education campaigns.
Purpose of the review
The aim of this literature review is to evaluate and interpret current research relating
to improving mental health literacy, in order to identify the most effective
communication strategies and tools to improve mental health literacy among target
audiences in the Australian population. The literature review involves a systematic
examination of the available research. It is systematic in that it: a) makes a concerted
effort to identify all relevant research; b) makes judgements about the overall quality
of the literature; c) systematically draws together the findings of the studies that are
judged to be of acceptable quality for inclusion in the review; and d) makes
judgements about the efficacy of particular interventions.

In addition, this report considers research relating to public health communication
strategies, in order to provide an overview of effective health communication
approaches that may be applicable to programs designed to improve mental health
literacy. While an in-depth review of all the literature in this area is beyond the scope
of the current review, an analysis of health communication strategies is outlined in
Section 4 of this report, and a summary of key systematic reviews of health
communication campaigns is provided in Appendix 1.
Research question
What are the most effective communication strategies and tools to improve mental
health literacy among target audiences in the Australian population?
10
Supplementary questions:
a) To what extent have such strategies improved levels of knowledge and awareness,
achieved attitudinal change and/or behavioural change and/or achieved positive
changes to broader community attitudes which may have had a flow-on effect to
mental health consumers?
b) What are the determinants of successful public health information strategies, for
example, strategy development, selling the message, communication tools (eg
print, radio, television and/or film), post-strategy follow-up and cost
effectiveness?
c) Which determinants of successful strategies and campaigns apply to all
populations and which to particular target audiences?
d) Which successful public health information strategy models are transferable in
terms of content and/or process across topic areas and/or demographic groups in
Australia?
e) In which areas may further research be commissioned on public health
information approaches to mental health literacy?
Method
Literature retrieval
Relevant literature relating to mental health literacy programs was identified through
a number of database searches. The literature review aimed to identify recent
research; therefore appropriate databases were searched for English language articles
dated from 1980 to May 2002. The databases searched included: Medline,
PsychINFO, Current Contents, Communication Abstracts, Cochrane Database of
Systematic Reviews, EMB Reviews, York Database of Abstracts of Reviews of
Effectiveness, and ProQuest. The following truncated search terms were employed:

mental*, psychiatr*

health, illness*, disorder*, wellbeing

promot*, prevent*, literacy, educat*, communication campaign, information

The reference lists of relevant articles retrieved through database searches were also
scanned in order to identify other important studies for inclusion in the literature
review.

In addition to database searches, efforts were made to uncover unpublished work of
relevance to the literature review. In particular, contact was made with a number of
researchers in the field both in Australia and overseas. This contact resulted in the
inclusion of several unpublished studies in the literature review.
Inclusion criteria
Studies included in the literature review were those which evaluated programs
designed to improve general mental health literacy in the population. A large number
of studies were identified through the literature retrieval process described above,
however not all studies were of relevance to the literature review. Many studies were
excluded from the review as they did not focus on mental health literacy programs,
11
and the content was therefore not applicable. It should be noted, however, that the
term mental health literacy is not widely used in the literature. Programs designed to
improve mental health literacy are more commonly described as mental health
education or information programs.

The more general terms mental health promotion and mental illness prevention may
also refer to programs that are designed specifically to improve mental health literacy.
However, not all mental health promotion and prevention programs fall into this
category. For example, a number of mental health promotion programs focus on skills
development or early intervention methods, which are outside the scope of this
review. Only those programs that addressed the issue of mental health literacy were
selected for inclusion.

It should be noted that previous literature reviews have considered the issue of mental
health literacy in the context of the broader concepts of mental health promotion and
mental illness prevention. An overview of this literature is given in Appendix 1 of this
report. In addition, key systematic reviews of other forms of health communication
campaigns are outlined in Appendix 1.
Exclusion criteria
Sections of the literature that did not specifically involve an evaluation of a program
to improve mental health literacy were excluded from the review. Programs that were
specifically designed to provide training for mental health professionals were also
excluded, as these programs were not targeted to the general Australian population. A
number of studies were identified which described the development of particular
programs, but did not include an evaluation, and these studies were also excluded
from the review. In addition, certain studies that provided an evaluation were not of
sufficient strength or methodological rigour to include in the review.
Classification of literature
The relevant literature involving programs to improve mental health literacy was
identified and classified according to the following general categories:

Whole of community programs
Programs targeted to specific populations

Within these categories, studies differed in their mode of delivery, scale and setting.
All studies involved an evaluation of an intervention, however there was variability in
terms of their study design. Only two of the studies identified for inclusion in the
review used an experimental, randomised controlled trial design. A large proportion
of the studies were quasi-experimental in design, that is, they used intervention and
control groups but did not use randomisation of participants. Most studies also
involved a pre-test/post-test design, with surveys of study participants prior to and
following the program. (See Section 5 for discussion of methodological issues)
Data extraction
Information relevant to the effectiveness of individual programs was extracted from
each of the studies. This included the author and year of the study, the mode of
delivery, setting and content of the program, the study design, the overall method, the
key findings, and conclusions of the study. The methodological issues and limitations
12
of each study were also examined, in order to determine the validity and importance
of any findings. A detailed review of each of the studies is provided in Sections 2 and
3 of this report, along with tables of key findings.
Data synthesis
The data extracted from the studies were drawn together in order to provide a
descriptive review of the effectiveness of different programs to improve mental health
literacy. The data did not lend itself to a formal meta-analysis, as the studies included
in the review were conducted in different settings and used a variety of research
designs. In addition, the quality of studies varied widely, and therefore the findings of
better quality studies were separated from those of poorer quality evaluations. As a
result, the synthesis of data involved identification of trends in order to determine
which interventions were most effective in achieving positive outcomes.

13
2. Review of individual studies - Whole of
community programs

A variety of programs have addressed the issue of improving mental health literacy at
a whole of community level. A total of eight programs were identified which had
been formally evaluated and fulfilled the inclusion criteria for the review. Most of
these programs involved mass media campaigns, however a small number of studies
used other modes of delivery, such as education courses. Only one of the studies was
conducted in Australia, with the remaining studies conducted in the United Kingdom,
the United States, Canada and Norway. While there was a large variability in the
types of interventions studied, the overall findings were that positive changes in levels
of mental health literacy and awareness were obtained. The key findings from each of
the studies are presented in Table 1.
Mass media campaigns
A number of studies have looked at the impact of mass media programs to improve
mental health literacy. Mass media programs are a common method of conveying
health information to the general public, as it is perceived that a wide audience may
be reached. Such approaches may, for example, involve campaigns in broadcast and
print media, or may provide health information through entertainment or news
programs on broadcast media. Studies of mental health literacy campaigns in the mass
media indicate that there is potential for such programs to have an impact on
community attitudes, knowledge and behavioural intentions.

A series of studies from the UK investigated the impact of a five-year campaign
designed to raise awareness of mental illness (Priest et al 1996; Paykel et al. 1997;
1998). The studies looked at the Defeat Depression campaign, organised by the Royal
College of Psychiatrists and the Royal College of General Practitioners. The aim of
the campaign was to reduce the stigma associated with depression, educate the
community about the condition, and encourage early help-seeking behaviour. The
campaign was run between 1991 and 1996 and involved wide-ranging media
activities, including newspaper and magazine articles, and radio and television
programs.

Media activities for the campaign began with a press conference in 1992, which
resulted in widespread newspaper, radio and television reports about depression.
Other media events included reports of personal experience of depression by several
high profile individuals. Publications including leaflets and books were produced and
disseminated widely. Audiocassettes and videotapes promoting coping techniques for
people with depression were also produced. A special Defeat Depression Action
Week was held in 1994, involving media briefings and community activities, and
further Action Days were held in 1995 and 1996. In addition, a number of fact sheets
were prepared in different languages to reach people from non-English speaking
backgrounds (see Section 3 for a review of this aspect of the campaign).

In order to measure the impact of the campaign, the study involved three surveys
conducted in 1991, 1995 and 1997. The samples were selected using a quota sampling
method, which involved the selection of weighted samples on the basis of their known

14
representation in the population. This resulted in sample sizes of around 2000 in each
of the survey years. The surveys involved face-to-face interviews, with the same 25
questions asked in each of the three surveys. The questions related to the respondents
perceptions of depression, opinions about the treatment of depression, and views
about general practitioners.

The survey results showed that the attitudes of respondents to depression were very
positive on all three occasions, with little variation over time. Throughout the study,
approximately 10% of participants agreed with the negative statement that depressed
people are often mad or unstable, while around 97% felt that anybody can suffer
from depression. There was a slight increase in the proportion of respondents who
reported experiencing depression themselves in 1997 (25%) compared with the first
survey in 1991 (22%). Respondents tended to view the causes of depression as largely
psychosocial rather than physical, with almost all causes of depression endorsed more
strongly in the later survey years when compared with the first survey. In terms of
treatment, counselling was much more frequently endorsed than antidepressant
medication, however the proportion of respondents agreeing that antidepressants were
effective increased from 46% in 1991 to 60% in 1997. When asked about general
practitioners, the majority of respondents agreed that they would approach their GP or
other health professional if they suffered from depression. The proportion of
respondents who stated they would seek help from their GP rose from 60% in 1991 to
68% in 1997.

The authors concluded that there were significant positive changes in attitudes over
the course of the campaign. General attitudes to depression were very positive from
the beginning of the campaign, and did not alter significantly. Although
antidepressants were not viewed as positively as counselling in terms of treatment
options, attitudes to antidepressant medication improved during the campaign. It is
important to note that the authors acknowledged that they could not be certain that the
campaign had caused the attitudinal changes described in the study. While they stated
that there was a significant increase in media coverage of mental health issues during
the campaign, it was noted that very few of the respondents reported that they had
heard directly of the campaign (5% in 1995 and 2% in 1997).

A comparable campaign undertaken recently in Australia as part of the Community
Awareness Program (CAP) was reviewed in 1999 (Evans Research 1999). The
program aimed to increase awareness of mental health issues and reduce stigma and
discrimination associated with mental illness. The program was launched in 1995 and,
along with a number of media activities including television commercials, involved
the production and dissemination of mental health information brochures. The series
of brochures covered the following topics: mental illness, stigma, the National Mental
Health Strategy, depression, anxiety, eating disorders, schizophrenia, and bipolar
disorder. The review undertaken in 1999 looked specifically at the mental health
information brochures, and aimed to make recommendations regarding the further
development of campaign materials.

The review involved consultation with key stakeholders and experts to evaluate the
effectiveness of the mental health information brochures. This consultation comprised
written evaluation questionnaires, written and telephone surveys, and meetings with
stakeholder groups. The questionnaires were given to 660 general practitioners in

15
metropolitan Melbourne, as well as 960 medical practitioners and psychologists
nationwide, and representatives of mental health organisations. Telephone interviews
were conducted with representatives from mental health organisations, consumer
groups, and other key stakeholders.

A total of 163 general practitioners completed the questionnaires, to give a response
rate of 25%. Approximately half of the respondents (52%) reported seeing each of the
brochures. For those who reported having seen the material, all brochures were rated
as highly useful on a 10-point utility scale. In addition, the brochure providing
information about schizophrenia was selected by the greatest proportion of
respondents as the most useful. The best features of the brochures were found to be
their readability and educational role, and the most commonly suggested
improvements were increased availability and provision of service availability on the
brochures. Amongst medical practitioners and psychologists, a response rate of 26%
to the questionnaire was obtained. A slightly greater proportion (57%) of respondents
reported familiarity with the brochures, compared with the sample of general
practitioners. All brochures were rated as highly useful, although the utility scores
were lower overall than those reported by the general practitioner group. Once again,
the brochure on schizophrenia was most commonly cited as the most useful, and the
best features of the brochures overall were their educational role and readability.

A total of 18 representatives from mental health organisation responded to the survey,
however the response rate was not provided. All reported seeing the information
brochures, and, as with the other two sample groups, all brochures were rated highly
on the utility scale. Again the most useful brochure was that providing information
about schizophrenia. The best features of the brochures were reported to be the
readability and presentation, and suggested improvements were expanded availability,
inclusion of service availability, and production of brochures in other languages.
Participants from stakeholder groups who were contacted by telephone indicated a
high level of familiarity with the brochures, with 76% reporting that they had seen the
brochures. Respondents once again reported that readability was the best feature of
the brochures. In addition, around 40% of respondents endorsed the role of the CAP
information brochures, and 27% felt there was a need to improve distribution.

Following consultation with key stakeholder groups, a number of recommendations
were made about changes to the titles of various brochures, as well as content
revisions, design improvements, and the production of a main brochure in a range of
different languages. It was felt to be important to include contact details for relevant
mental health services, and to outline re-ordering information. Recommendations for
new materials included an expanded set of titles, and the use of an integrated
brochure, CD-ROM and web site. Suggestions were also made regarding the use of
specific media for particular target groups. For example, recommended strategies for
targeting young people were: television commercials and popular television programs,
advertisements in youth magazines, information in school libraries and youth-oriented
corporate sponsorship.

The review concluded that the CAP mental health information brochures had been
well received and had provided a useful education resource. It was recommended that
the focus of the information brochures on mental health education and promotion
should remain. However, they also stated that the distribution of brochures had been

16
inadequate, as only around half of the medical practitioners and psychologists
surveyed reported seeing the brochures. Recommendations were made for improving
the distribution approach, through collaboration with State and Territory health
departments, professional associations, peak mental health organisations, hospitals
and libraries. The authors also stated that there was a need for ongoing evaluation of
the dissemination of the materials, and surveys of community knowledge and attitudes
about mental health issues in Australia. It is important to note that the evaluation of
the brochures in 1999 did not include surveys of community attitudes, or attempt to
measure the impact of the mental health information brochures on community
attitudes.

Unlike the broad-ranging media campaigns already described, an earlier study from
the UK by Barker et al (1993) investigated the impact of television series designed to
provide information about mental illness to the general public. The series, entitled You
in Mind, consisted of seven ten-minute programs presenting information about mental
health problems and providing examples of coping methods. The aim of the series
was to provide insight, problem clarification and problem solving techniques in terms
of the viewers own problems, and their perceptions of the problems of others. The
programs were designed to be positive in tone, and generally depicted ordinary people
describing methods of coping with common emotional and psychological problems.
The program titles were: The Tranquiliser Trap, Being Assertive, Overcoming
Insomnia, Overcoming Fear, Overcoming Depression, Expressing Feelings, and
Change. The series was televised in the UK on Sunday evenings from February to
April in 1987 and received an audience of approximately 13% of the adult population.
A written booklet was also available, and provided information about the topics
covered in the series, as well as details of national and local mental health services.

The aim of the study was to measure the impact of the series on community attitudes
and behaviour. Baseline data were collected from a representative national sample of
1040 adults prior to the beginning of the series. Participants were then sent a follow-
up questionnaire one year later, after the series was completed, which received a 52%
response rate. Of these, only 62 participants had viewed the series. Respondents were
asked questions about coping and help-seeking measures, as well as general responses
to the series.

The results of the study were that those who had viewed the series found that it was
useful in terms of insight, problem clarification and problem solving. However, it was
found that the series had a greater impact in the areas of awareness and clarification
than in actually finding out how to respond to problems. Over 75% of viewers felt that
the series portrayed people similar to people they knew, but half of the viewers
thought that the series was not actually relevant to their own concerns. In terms of
behaviour change, 45% of viewers stated that they had either tried or intended to try
new methods of coping with their own problems. However, the authors also noted that
the figures relating to reported behaviour change should be treated with some caution,
as a validity check on one of the measures of behaviour change had revealed a
significant amount of over-reporting.

The authors concluded that there was some evidence that the series had a positive
impact on viewers. However, it was apparent that the series had a greater impact on
viewers perceptions of other peoples problems than of their own. It was argued that

17
this was most likely because there was a higher probability of respondents knowing of
other people with a mental illness than of having a mental illness themselves, and also
that a proportion of the participants may have chosen to deny their own mental health
problems. Although the authors acknowledged a large degree of over-reporting of
behaviour change, a significant number of viewers stated that they had changed or
intended to change their behaviour as a result of the series. The authors argued that,
while any significant impacts of the series were limited to a minority of the
respondents, this proportion, when translated into the actual total national audience,
would be a large absolute number.

A mass media campaign conducted in Norway in 1992 used a slightly different
approach, and indicated particularly positive results (Fonnebo and Sogaard 1995;
Sogaard and Fonnebo 1995). The objectives of the Norwegian Mental Health
Campaign were to raise money for psychiatric research, and to educate the
community about the treatment and prevention of mental health disorders. The
campaign centred around a fund-raising television program, which was broadcast in
1992 on a nationwide television station. The six-hour television program included
information about mental health issues, as well as entertainment and fund-raising
activities. Prior to the broadcast of the program, there was extensive coverage of the
campaign through newspaper and television advertisements, and through a series of
educational television and radio programs about mental illness. In addition, a
campaign newspaper was sent to every household, and information about the
campaign was distributed to a number of organizations including community health
centres, schools, libraries and psychiatric institutions. The campaign was formally
endorsed by the government, and received support from the King and Queen of
Norway, as well as a number of church organisations. Community activities including
an essay competition and a celebrity gala event were also organised to coincide with
the campaign.

The evaluation of the program involved telephone interviews with a random sample
of the population. Prior to the campaign, 1191 individuals were interviewed regarding
knowledge of and attitudes to mental health disorders. One month after the campaign,
644 (54%) of the original participants were interviewed again. Of these, 574
respondents had heard of the campaign, which represented 94% of the follow-up
sample. Approximately two-thirds of all respondents had watched pre-campaign
television programs, and 62% indicated that they had viewed the television program
on the day of the campaign. A total of 68% of respondents had read information
connected with the campaign about mental health issues, and almost half reported
discussing the theme of the campaign with others. The follow-up survey was also
administered to a separate sample of 1177 individuals, to control for any effects of
repeated interviewing in the original sample.

The 574 respondents in the follow-up sample who reported that they had heard of the
campaign were included in the evaluation of the impact of the program in terms of
changes in knowledge and attitudes. It was found that there were significant increases
in knowledge about suicide frequency following the campaign. For example, the
proportion of male respondents who correctly indicated that suicide deaths are more
common than traffic accident deaths roles from 28% prior to the campaign to 43% at
follow-up. The corresponding proportions for female respondents rose from 21% at
baseline to 46% after the campaign. Knowledge about aspects of mental illness other

18
than suicide frequency did not change significantly following the campaign. It was
found that, throughout the campaign, there were significant increases in the
proportion of respondents who were willing to be open about family members who
were hospitalised for a psychiatric disorder, as well as improved attitudes to help-
seeking.

The authors concluded that the campaign had resulted in significant changes in
knowledge and attitudes in study participants. They stated that the campaign had
reached all but 6% of the Norwegian population over 14 years of age, which indicates
that the level of awareness of the campaign was much greater than that of other
nation-wide mass media approaches, such as the Defeat Depression campaign in the
UK, which had an awareness level of only 5% of respondents (Paykel et al. 1997;
1998). The authors stated that the success of the campaign in terms of population
penetration was due to its thorough planning, and the use of appropriate mass media
and social marketing theories. They argued that the mass media are an effective
vehicle for conveying information to the population as a whole, and that collaboration
with the national media, public figures, and the Norwegian Council of Mental Health
had enabled the campaign to attract widespread attention. Importantly, the authors
noted that long-term follow-up was important to determine whether changes had been
maintained. They stated that a follow-up survey would be conducted in 1995,
however the results of this new survey do not appear to have been published.

In contrast to the large-scale mass media campaigns already mentioned, two studies
looked at the impact of educational films on attitudes to mental illness. Medvene and
Bridge (1990) conducted a study in the US that looked at the impact of a television
documentary entitled Back Wards to Back Streets, which was designed to improve
information levels and attitudes towards community-based treatment facilities for
mental illness. The structure of the film followed a contact hypothesis approach,
which promotes the concept that direct contact and interaction between different
groups can change stereotypes and lead to more positive attitudes (Amir 1976). The
aim of the documentary was to bring the audience into contact with individuals who
had been in psychiatric hospitals, using the medium of television. The content of the
film comprised personal interviews with 14 individuals, who each described their
experiences of community-based treatment.

Participants in the evaluation consisted of selected mental health professionals,
policy-makers, and members of the public in New York and Albany. The two groups
of participants (405 in New York and 136 in Albany) were shown the documentary
and then asked to complete questionnaires about community-based treatment facilities
and their beliefs about mental illness. Half of the participants were also given the
same questionnaire prior to viewing the documentary. In addition, several discussion
groups were organised to obtain qualitative data from some of the participants who
had viewed the documentary.

Participants in the New York City group showed significantly improved information
levels and attitudes towards community-based treatment facilities after viewing the
documentary. Beliefs about mental illness and mental health care amongst members
of this group also changed, and more than 90% of this audience indicated that the film
was good and informative. The impact was found to be the same for mental health
professionals, policy-makers and public members of the audience. By comparison, the

19
Albany group did not show significant changes in information levels or attitudes after
viewing the documentary, but over 90% of the audience found the film to be good.
The authors pointed out that the Albany group were better informed about issues
related to community-treatment facilities than the New York group prior to seeing the
film, and this may explain why attitudes and information levels did not change
significantly in the Albany group. The authors concluded that television programs can
alter information levels and attitudes to mental health issues among specific groups,
and argued that the success of the documentary was a result of its personalised format,
with the vast majority of the audience members indicating that the program was both
enjoyable and informative.

A similar study by Tolomiczenko et al (2001) investigated the impact of a video film
about homelessness and mental illness, but found less encouraging results. The aim of
the study was to determine whether the video would be an effective tool for educating
the public and improving attitudes to homeless people with mental illness. The video,
entitled A Fine Line, depicted caseworkers, clients and psychiatrists involved in the
Hostel Outreach Program in Toronto, Canada. In the film, the clients spoke about the
course of their illness, and its relationship to their homelessness. The clients also
conducted interviews with caseworkers and mental health professionals, who
described the Hostel Outreach Program and its impact on homeless people with
mental illness.

The evaluation of the video was conducted as part of a regular public education
program run by the Centre for Addiction and Mental Health in Toronto. The
education program generally comprised a tour of the centre, a video, discussions with
people who have mental illness, group exercises and overviews of psychiatric
terminology. For the purposes of the study, the regular education program acted as the
control condition, and two variations of the program provided two different
interventions. The first intervention, called the video group, included the video A
Fine Line in place of the video routinely used in the program. The second
intervention, entitled the video plus discussion group, utilised the video A Fine Line
along with a follow-up discussion with one of the clients featured in the video
presentation. The authors hypothesised that the intervention video would have a
positive impact on attitudes to and understanding of homelessness, and that this effect
would be enhanced by the follow-up discussion in the video plus discussion
intervention.

Participants in the study comprised 575 high school students from 14 different schools
who attended the public education program and completed assessment questionnaires.
The questionnaires consisted of items relating to: exposure to homeless people,
emotional responsiveness and empathy, attitude to mental illness, beliefs about
dangerousness, aversion, restrictive beliefs, structural determinants of homelessness,
disability, and blame. Of the 575 participants, 214 were in the video group, 186
comprised the video plus discussion group, and the remaining 175 formed the control
group, who undertook the regular education program.

Participants completed questionnaires at post-intervention only. The results indicated
that certain factors were significantly associated with more positive attitudes to
homelessness and mental illness. Females had more positive attitudes than males, and
those who had greater level of prior exposure to homeless people also showed more

20
positive attitudes to homelessness than those with lower exposure. With respect to the
intervention groups, it was found that the video group had more negative attitudes to
mental illness and homeless people than participants in other groups. In particular,
participants in the video group held more negative beliefs about mental illness, and
indicated stronger feelings of danger associated with homeless people. Participants
who saw the video, with or without the follow-up discussion, were also more likely to
endorse restrictions of homeless people, and to view disability as a cause of
homelessness, compared with the control group. In contrast, the video plus discussion
group showed more positive attitudes than the control group in terms of attitudes to
mental illness and beliefs about dangerousness.

The authors concluded that the hypothesis had not been supported by the results of the
study, as the findings indicated that the video had in fact resulted in more negative
attitudes to mental illness and homelessness. The positive findings were that the
combination of the video plus discussion with a homeless person resulted in some
improvement in attitudes. Other factors that were associated with positive attitudes
were being female and having higher level of previous exposure to people who are
homeless. The authors stated that direct contact with people with a mental illness was
important in reducing stigmatising attitudes. They also recommended that educational
media messages about mental illness and homelessness should be carefully targeted to
particular audiences to ensure that negative attitudes were not reinforced. A lack of
appropriate planning may explain why the study did not achieve positive attitude
changes similar to those found by Medvene and Bridge (1990).
Other modes of delivery
While a diverse range of studies has focused on mass media strategies, there has been
relatively little research investigating the impact of other approaches to mental health
education on a whole of community level. A series of studies from the U.K. by Wolff
et al (1996a; 1996b; 1996c) investigated the impact of a localised public education
campaign on community attitudes to people with mental illness. The studies involved
a survey of attitudes towards in two areas of South London (Streatham Hill and Herne
Hill) prior to the opening of supported accommodation houses for people with mental
illness. When the supported accommodation facilities began operating in 1993, an
education campaign was conducted in only one of the areas, and the attitude survey
then repeated in both areas.

The education campaign comprised three elements: a social component, including
social events and social interaction with staff; a didactic component, consisting of an
information video and written material; and a mixed component, consisting of a
formal reception and informal discussion meetings. The campaign was developed in
consultation with staff from the supported accommodation houses, and the residents
gave their consent for the campaign. The authors noted, however, that a number of
objections to the campaign were raised by the community mental health staff, who felt
that it would not be of benefit to the residents of the facility.

The surveys conducted prior to and following the education campaign involved face-
to-face interviews and included questions dealing with knowledge of mental illness
and mental health care, and attitudes to people with mental illness. In order to provide
a measure of attitudes, participants were given the Community Attitudes to the
Mentally Ill (CAMI) questionnaire. The CAMI questionnaire is a self-report

21
instrument containing 40 statements, which is designed to measure community
attitudes to people with mental illness. Respondents indicate the extent to which they
agree with each statement, from strongly agree to strongly disagree. For the purposes
of this study, participants were also given a 10-item questionnaire focusing on fear of
and behavioural intentions toward people with mental illness. During the follow-up
survey, participants were also asked about their levels of contact with staff and
patients from the supported houses.

The first survey indicated that the majority of the 215 participants held positive
attitudes to people with mental illness. Three attitudinal factors measured by the
CAMI questionnaire emerged as being of particular importance: Fear and Exclusion,
Social Control, and Goodwill. Although there were found to be no overall differences
in attitudes between the two survey areas at the beginning of the study, a significant
minority in both areas were found to hold views that were fearful and socially
controlling. The vast majority of respondents (91%) reported a desire for further
information, however the authors noted that only one-third of participants in the
experimental area actually accepted the offer of educational material during the
campaign.

Following the public education campaign, 109 of the original 215 participants were
interviewed again. The authors noted that those who had expressed more negative
attitudes in the initial interview were more likely to refuse the second interview. The
results of the second interview were that there was a small increase in knowledge in
the intervention area, which had received the educational campaign, compared with
the control area. In terms of changes in attitudes measured by the CAMI
questionnaire, it was found that there was a decrease in Fear and Exclusion in the
experimental area compared with the control area, but no change in Social Control or
Goodwill. There was also an increase in reported positive behavioural intentions in
the intervention area, with no corresponding change in the control area. Participants
from the experimental area were significantly more likely to have made contact with
staff and patients than those in the control area, and those in the experimental area
who had made contact with patients were more likely to show a decrease in Fear and
Exclusion over time.

Overall, the public education campaign was associated with an improvement in
overall attitudes and behaviour towards people with a mental illness, but had only a
modest effect on knowledge. The authors stated that higher levels of contact with
patients, rather than the education campaign per se, resulted in less fearful attitudes in
the experimental area. It was recommended that future education campaigns should be
targeted more specifically towards those with the most negative attitudes to people
with a mental illness.

The impact of another short-term education program was evaluated by Holmes et al
(1999). The aim of this particular study was to measure the effects of an educational
program on attitudes to mental illness, and to determine whether the impact of the
program was modified by pre-existing knowledge and experience. The program
involved a semester-long course about severe mental illness that was delivered to a
total of 35 adult participants who were enrolled at a community college in
metropolitan Chicago. The course, entitled Severe Mental Illness and Psychiatric
Rehabilitation, was designed to provide accurate information and dispel

22
misconceptions about schizophrenia. It covered information about the causes,
treatment and prognosis of schizophrenia, rehabilitation for people with psychiatric
disability, and a review of the evidence relating to dangerousness. In addition, two
presentations were given by a mental health consumer and a family member, with the
intention of reducing negative attitudes to mental illness through direct contact.

Participants completed the course in three groups of 10 to 14 students, and the study
was conducted over three separate semesters. A control group of 48 participants was
recruited from adult students enrolled in a general psychology course at the same
college. Participants from both the intervention and control groups completed
questionnaires prior to and following the education course. Two questionnaires were
designed specifically for the study in order to measure knowledge of mental illness
and contact with people with severe mental illness. In addition, attitudes were
measured using the Opinions about Mental Illness (OMI) questionnaire. The OMI
questionnaire comprises 70 statements about mental illness to which respondents
indicate their level agreement on a six-point scale. Three subscales measured by the
OMI questionnaire were selected for this study: authoritarianism, benevolence, and
social restrictiveness.

It was found that participants in the intervention group showed significant
improvement in knowledge about mental illness following the education course,
however no corresponding change was found in the control group. Participants in the
intervention group also showed significantly improved benevolence and social
restrictiveness attitudes on the OMI questionnaire, while control group participants
demonstrated improvement on benevolence scores only. No significant change was
found in authoritarian attitudes for either group.

When the results were analysed to determine the impact of prior knowledge and
contact with mental illness, it was found that these variables were significantly
associated with a number of changes in attitudes measured by the OMI questionnaire.
Specifically, participants with a higher level of knowledge or contact with severe
mental illness prior to the program demonstrated significantly greater improvement in
benevolence attitudes following the education program. These improvements were
greater for participants in the intervention group, compared with changes in the
control group. In contrast, prior level of contact was associated negatively with
changes in social restrictiveness score. Those who reported least contact with severe
mental illness prior to the program demonstrated greater improvements in social
restrictiveness attitudes following the education course.

The authors concluded that the education course had improved attitudes to mental
illness. In particular, it was found that benevolence and social restrictiveness attitudes
improved throughout the education program. A change in benevolence attitudes was
also found in the control group during the study, however this was smaller in
magnitude than that of the intervention group. The authors stated that pre-education
knowledge and contact with mental illness mediated the effects of the educational
program. Prior knowledge and contact were found to augment improvements in
benevolence attitudes. This supports the finding of Wolff et al (1996a; 1996b; 1996c)
that improved attitudes were associated with social contact with people with mental
illness, rather than education alone. In contrast, Holmes et al also found that prior
knowledge and contact were negatively associated with social restrictiveness scores.

23
The authors noted that they were unable to determine which particular components of
the education course were associated with attitude change, and it is not known
whether changes were maintained in the long term.
Methodological issues
A range of important methodological issues and limitations were raised in the
literature outlined above. For example, evaluations of the Defeat Depression
campaign were limited in that they did not involve the use of a concurrent control
group for comparison with the intervention group (Priest et al 1996; Paykel et al1997;
1998). The authors stated that, because the campaign was run at a national level, it
was not possible to include a control group. This was also the case with the evaluation
of the Norwegian Mental Health Campaign (Fonnebo and Sogaard 1995; Sogaard and
Fonnebo 1995). These studies both involved a pre-test/post-test design, which means
that measurements of attitudes were taken at the beginning of the study, enabling the
intervention groups to act as their own controls. It is important to note, however, that
the lack of concurrent control groups is a weakness in long-term studies. As a result of
this limitation, it is unclear whether the attitudinal changes described in each study
were in fact associated with campaign activities. In particular, Paykel et al noted that
very few of the participants in their study reported that they had actually heard of the
campaign, which may indicate that other factors were involved in the attitudinal
changes identified. In addition, many of the improvements in knowledge and attitudes
found in the studies were quite small in magnitude.

The review of the Community Awareness Program (Evans Research 1999) in
Australia differed from most other studies in this section in that it involved a post-test
only design, and as the intervention occurred at a national level the study did not
involve a control group. Tolomiczenko et al (2001) also conducted a post-test only
study, and therefore were unable to show whether attitudes had in fact changed over
the course of the interventions. While the study did involve concurrent controls, the
authors did not compare the characteristics of the different intervention and control
groups. It is therefore unclear whether the groups were similar, and whether attitudes
varied between the groups prior to the intervention. Although the program was
intended to educate the general public, the study sample was limited to high school
students, which may limit the generalisability of the findings to the general
population.

Evaluations of the Norwegian Mental Health Campaign (Fonnebo and Sogaard 1995;
Sogaard and Fonnebo 1995) involved a control group for the post-test interview only,
to control for the possible confounding factor of being interviewed prior to the
commencement of the campaign. Of the original sample in this study, only 54% were
interviewed at follow-up, which indicates a high level of attrition. The authors noted
that the characteristics of the follow-up sample were slightly different from that of the
total population, with an over-representation of women aged 25 to 39 years. It was
found, however, that there were no significant differences between the follow-up
sample and the control sample in terms of levels of awareness and interest in the
campaign, indicating that there were no serious biases in the follow-up sample to
account for the observed changes in attitudes following the campaign.

Methodological issues relating to sampling were also described by Wolff et al (1996a;
1996b; 1996c), who stated that, in their study of community attitudes, the

24
demographic characteristics of the participants in the control group were slightly
different from those in the intervention group. While there were no overall differences
in attitudes between the two groups prior to the campaign, the authors acknowledged
that the study sample was not representative of the overall population. In particular,
there was an over-representation of people from higher social class and from
particular ethnic groups. The authors stated that conclusions about the applicability of
the findings to the general population could be tentative only. It is also important to
note that, in the follow-up survey of attitudes, participants who had expressed more
negative attitudes at baseline were also more likely to refuse the second interview.
This may have resulted in a biased follow-up sample, and could account for some of
the improvement in attitudes found following the educational intervention.

Holmes et al (1999) found in their study that the demographic characteristics of
participants in the intervention group were similar to the population as a whole,
however there were differences between the intervention and control groups.
Participants were not randomly assigned to groups, and the authors acknowledged that
the differences noted may have been a confounding factor in the results of the study.
The authors stated that the general psychology course undertaken by the control group
did not specifically provide information about severe mental illness and issues of
stigma, and therefore had not been expected to result in significant changes in
attitudes. Despite this, it was found that benevolence attitudes significantly improved
in the control group, and it was argued that differences in mean age between the two
groups may have been associated with this unexpected finding.

Specific issues were raised in the study by Barker et al (1993), which investigated the
impact of the television series You in Mind. The authors acknowledged that the study
design proved to be insufficiently sensitive to measure much of the impact of interest.
Although the study used an initial sample size of 1040, there was a low response rate
for the follow-up questionnaire, with only 52% of initial participants providing
follow-up information. This was similar to the response rate obtained in the
evaluation of the Norwegian Mental Health Campaign (Fonnebo and Sogaard 1995;
Sogaard and Fonnebo 1995). In contrast to the Norwegian campaign, however, only a
small minority of respondents in the UK study had actually viewed the television
series, making it difficult to compare those who had viewed the series with the much
larger group who had not.

The study by Medvene and Bridge (1990), while showing quite positive results in one
of the study groups, also had a number of important limitations. The participants were
not randomly selected, and the majority were mental health professionals who may be
expected to be more receptive to information about mental health issues than the
general public. This is a significant factor when considering the generalisability of the
findings to the population as a whole. Similarly, the review of the Community
Awareness Program (Evans Research 1999) in Australia did not involve a random
sample of the population, as participants in the study were chosen from particular
professional and consumer groups. In addition, there was a very low response rate to
the surveys of general practitioners (25%) and other medical and mental health
professionals (26%), and it is possible that those responding to the survey were not
representative of the overall target group. As a result of the studys methodological
issues, it is difficult to draw valid conclusions about the usefulness of the information
brochures for improving community awareness. Although the study attempted to

25
quantify survey findings in terms of levels of awareness and usefulness of the
brochures, the key findings of the study were more qualitative, and related to
recommendations for improvements in distribution and content of future educational
materials.

Another important methodological issue in many of the studies was that measures
tended to rely on self-reporting, particularly those relating to aspects of behaviour
change. Paykel et al (1997; 1998) acknowledged in their study that it was not possible
to measure the validity of reported intentions to change behaviour, and this may have
caused a large degree of over-reporting. Importantly, Barker et al (1993) noted in their
study of the television series You in Mind that validity checks had indicated
considerable over-reporting in terms of behaviour change amongst study participants.
Summary
Despite important methodological limitations, the literature indicates that mass media
campaigns can have a positive impact on levels of mental health literacy in the
population. These findings are consistent with conclusions drawn from more general
communication research literature (see Section 4). Evaluations of programs conducted
at national and statewide levels generally indicated that attitudes and knowledge
improved; however the extent of changes was acknowledged to be limited. There
were some indications of positive changes in behavioural intentions and reported
behaviour, however the reliability of self-reported behaviour changes was not able to
be determined.

Mass media programs included in this review varied in terms of audience penetration.
A Norwegian program reportedly reached 94% of the population, compared with
levels of awareness of only 5% for the Defeat Depression Campaign in the UK.
Studies of modes of delivery other than mass media were not common, and were less
conclusive about changes in knowledge, attitudes and behaviour. There were,
however, indications that social contact with people experiencing mental illness may
be associated with improved community attitudes.

A number of recommendations may be made about the content and mode of delivery
of campaigns targeted to the whole of the community. Importantly, evaluations of
other health communication campaigns conducted in Australia and overseas have
found that messages are particularly well received when the positive outcomes of
attitudes or behaviours are communicated. With respect to mode of delivery, the
literature indicates that mass media campaigns may be most effective when
complemented by other more direct approaches, such as the dissemination of printed
materials or community activities. (See also Section 4)

While it may be concluded that mass media campaigns in particular are a potentially
effective approach to improving mental health literacy, it should be acknowledged
that such strategies are generally expensive, and none of the studies adequately
addressed the issue of cost-effectiveness. It is clear that further evaluation of mental
health literacy programs is required, particularly in the area of cost-effectiveness of
programs targeting the whole of community. There is often a tendency in planning
mass media campaigns to equate them with typical advertising campaigns and, as
discussed below in Section 4, this may well be an inappropriate strategy.


26
Table 1 - Whole of community programs

Investigators Audience Study Design Country Method Program Content Key Findings
Priest, Vize,
Roberts,
Roberts and
Tylee (1996)

Paykel, Tylee,
Wright, Priest,
Rix, Hart
(1997)

Paykel, Hart,
and Priest
(1998)
Whole of
community
Separate
samples pre-
test/post-test
study with no
concurrent
controls

United
Kingdom
Nationwide Defeat
Depression
campaign involving
wide range of
media conducted
1991-1996. Surveys
of 2000 participants
about public
attitudes towards
depression
conducted at
baseline (1991) and
follow-up (1995 &
1997)

Media activities included a
press conference and reports
of personal experience of
depression by several high
profile individuals.
Publications including
leaflets and books about
depression were produced
and disseminated widely.
Fact sheets were prepared in
different languages to reach
ethnic minority populations.
Audiocassettes and
videotapes promoting coping
techniques for people with
depression were produced.
Defeat Depression Action
Week was held in 1994,
involving media briefings
and community activities,
and further Action Days
were held in 1995 and 1996.

Community attitudes to
depression were positive
with little change over
the study period
Attitudes to treatment for
depression improved
over the study period
Very few participants
(5%) could recall the
campaign

27
Investigators Audience Study Design Country Method Program Content Key Findings
Barker,
Pistrang,
Shapiro,
Davies, Shaw
(1993)
Whole of
community
Pre-test/post-
test study with
non-viewers
acting as
control group
United
Kingdom
Nationwide mental
health promotion
television series
You in Mind
screened in 1987.
Surveys of 1040
participants were
conducted at
baseline and at
follow-up 12
months later.

The television series, You in
Mind, comprised seven ten-
minute programs presenting
information about mental
health problems and
providing examples of
coping methods. The
programs were positive in
tone, and depicted ordinary
people describing coping
skills for common emotional
problems. The program titles
were: The Tranquiliser Trap,
Being Assertive,
Overcoming Insomnia,
Overcoming Fear,
Overcoming Depression,
Expressing Feelings, and
Change. A booklet was
available on request, and
provided supplementary
information about mental
health topics and details of
national and local mental
health services.

The series was viewed
by 13% of population
For those who viewed
series there was some
evidence of positive
impact on attitudes
towards people with
mental illness
Around 45% of viewers
stated that they had
changed or intended to
change their behaviour
in terms of coping with
their own problems


28
Investigators Audience Study Design Country Method Program Content Key Findings
Medvene and
Bridge (1990)
Whole of
community
Pre-test/post-
test study with
no concurrent
controls
United
States
541 participants
viewed mental
health education
television
documentary in two
separate groups.
Participants
surveyed about
attitudes towards
mental illness prior
to and after viewing
program

A television documentary
was produced with the aim
of bringing the audience into
contact with individuals who
had been in psychiatric
hospitals. The content of the
film comprised personal
interviews with 14
individuals, who each
described their experiences
of community-based
treatment
Viewing intervention
program resulted in
improved attitudes
towards mental illness in
one of the study groups

29
Investigators Audience Study Design Country Method Program Content Key Findings
Evans Research
(1999)
Whole of
community
Post-test only
study with
purposive
sampling and
no concurrent
controls
Australia Nationwide
Community
Awareness
Program was
launched in 1995,
comprising mental
health information
brochures.
Evaluation of the
program in 1999
involved surveys of
health
professionals,
mental health
organizations and
consumer groups.

The evaluated component of
the campaign included a
series of mental health
information brochures
covering the topics: mental
illness, stigma, the National
Mental Health Strategy,
depression, anxiety, eating
disorders, schizophrenia, and
bipolar disorder.
More than half of the
respondents had seen the
brochures
All brochures were
considered to be highly
useful
Recommendations were
made for development of
new materials, including
an expanded set of titles,
and the use of an
integrated brochure, CD-
ROM and web site
Recommendations were
made for improving the
distribution approach,
e.g. through
collaboration with State
and Territory health
departments


30
Investigators Audience Study Design Country Method Program Content Key Findings
Fonnebo and
Sogaard (1995)

Sogaard and
Fonnebo (1995)
Whole of
community
Pre-test/post-
test study with
control group
at post-test
only
Norway Nationwide mental
health promotion
television program
broadcast in 1992.
Survey of 1191
participants was
conducted prior to
the campaign, and a
follow-up survey of
644 of the original
participants was
conducted one
month after the
broadcast.

The campaign comprised a
six-hour fund-raising
television program broadcast
nationwide. The program
included information about
mental health issues,
entertainment and fund-
raising activities. Prior to the
broadcast of the program,
newspaper and television
advertisements, and
educational television and
radio programs about mental
illness raised awareness of
the campaign. A campaign
newspaper was sent to every
household, and information
was distributed to
organizations including
community health centres,
schools, libraries and
psychiatric institutions. The
campaign was supported by
the government, the King
and Queen of Norway, and a
number of church
organisations. Community
activities were also organised
to coincide with the
campaign.

Approximately 94% of
participants were aware
of the campaign, and
62% had viewed the
television program
There were positive
changes in knowledge
and attitudes following
the campaign


31
Investigators Audience Study Design Country Method Program Content Key Findings
Tolomiczenko,
Goering and
Durbin (2001)
Whole of
Community
After only
study with
non-
randomisation
of concurrent
controls and
two
intervention
groups

Canada 575 participants
selected from high
school students
attending a brief
educational
program.
Participants were in
one of three groups:
video, video plus
discussion, and
control.
Questionnaires
were completed
following the
program to measure
attitudes to mental
illness and
homelessness.

A video about mental illness
and homelessness, entitled A
Fine Line, was produced for
the program, and depicted
caseworkers, clients and
psychiatrists involved in the
Hostel Outreach Program in
Toronto, Canada. The
evaluation of the video was
conducted as part of a
regular public education
program. For the purposes of
the study, the regular
education program acted as
the control condition. The
program was varied to
provide two different
interventions: the video
intervention included the
video A Fine Line in place of
the video routinely used in
the program, and the video
plus discussion intervention,
utilised the video A Fine
Line along with a follow-up
discussion with a homeless
person.

Viewing the video
resulted in more
negative attitudes to
mental illness and
homelessness
The combination of the
video plus discussion
with a homeless person
resulted in some
improvement in
attitudes.
Direct contact with
people with people with
a mental illness was
associated with more
positive attitudes.
Recommendation that
educational media
messages about mental
illness and homelessness
should be targeted to
particular audiences

32
Investigators Audience Study Design Country Method Program Content Key Findings
Wolff, Pathare,
Craig and Leff
(1996a)

Wolff, Pathare,
Craig and Leff
(1996b)

Wolff, Pathare,
Craig and Leff
(1996c)

Whole of
community
Pre-test/post-
test study with
non-
randomisation
of concurrent
controls
United
Kingdom
A survey of
attitudes to mental
illness was
undertaken in two
areas of South
London prior to the
opening of a
supported
accommodation
house for people
with mental illness
in 1993. An
education campaign
was conducted in
one area, and a
follow-up survey of
attitudes conducted
in both areas.

The education campaign
comprised three elements: a
didactic component,
consisting of an information
video and written material; a
social component, including
social events and social
interaction with staff; and a
mixed component, consisting
of a formal reception and
informal discussion
meetings. The campaign was
developed in consultation
with staff from the supported
accommodation houses.
Approximately one-third of
participants in the
intervention area agreed to
receive the educational
material.

There were some
improvements in
attitudes and behaviour
in the intervention area,
but only a small change
in knowledge
Social contact with
patients was associated
with less fearful attitudes
in the intervention area

33
Investigators Audience Study Design Country Method Program Content Key Findings
Holmes,
Corrigan
Williams, Canar
and Kubiak
(1999)
Whole of
community
Pre-test/post-
test study with
non-
randomisation
of concurrent
controls
United
States
Education program
about severe mental
illness was
administered to 35
adult students
enrolled at a
community college.
A second group of
48 students in a
General Psychology
course acted as a
comparison.
Participants
completed Opinions
about Mental
Illness
questionnaire prior
to and following the
education program.

The program involved a
semester-long course about
severe mental illness, which
aimed to provide accurate
information and dispel
misconceptions about
schizophrenia. The course
provided information about
rehabilitation for people with
psychiatric disability. There
was discussion of the causes,
treatment and prognosis of
schizophrenia, and a review
of the evidence relating to
dangerousness. Presentations
were given by a mental
health consumer and a family
member, with the intention
of reducing negative
attitudes to mental illness
through direct contact.

There were some
positive changes in
attitudes in the
intervention group
following the program
A greater level of prior
knowledge and contact
with people with mental
illness mediated the
effects of the program


34
3. Review of individual studies - Programs targeted
to specific populations

A number of programs designed to improve mental health literacy have been directed
towards specific subgroups of the population, rather than to the general community as
a whole. Studies focusing on targeted mental health literacy programs are included in
this section of the review. The key findings from each of the studies are outlined in
Table 2.

Mental health literacy programs may focus specifically on certain groups within the
population who have a particular need for mental health education. For example, it
has been argued that lack of mental health literacy can create difficulties for families
and caregivers, and therefore mental health education targeted to these groups may
help to improve quality of life for people with mental illness (Pickett-Schenk, Cook et
al. 2000). Seven studies included in this review evaluated mental health education
interventions targeted to caregivers, and overall found beneficial effects. While it is
recognised that mental health consumers are themselves an important target group for
similar mental health education programs, it is important to note that no formal
evaluations of such programs were identified for inclusion in this review.

Adolescents are also recognised as an important target population for mental health
literacy and awareness programs. Programs targeted to adolescents are generally
delivered through schools, often by incorporating mental health issues into the school
curriculum, and sometimes through a whole-school approach, addressing the
opportunities for promoting mental health beyond classroom mental health education.
Five programs targeted to adolescents were identified for inclusion in this review, all
of which were delivered in school-based settings.

Other groups who may not otherwise be reached by more general community
programs, such as people from non-English speaking backgrounds, have also been
identified as important target audiences for programs to improve mental health
literacy. While several projects have examined the needs of people from different
cultural backgrounds (Delgado 1980; Meiser and Gurr 1996; Chien, Kam et al. 2001),
only one evaluation of a mental health literacy program targeted to these groups was
found for inclusion in the review.
Carers and families of people with mental illness
A number of studies have focused on education programs targeted specifically to
family members of people with mental illness. Pickett-Schenk, Cook and Laris (2000)
evaluated the mental health education program, J ourney of Hope, which was
developed by the National Alliance for the Mentally Ill (NAMI) in the United States
in 1993. The program aimed to provide education and skills to family members of
people with mental illness to assists in their role as caregivers. It comprised an eight-
week education course and a long-term support group. Participants were not required
to attend both parts of the program, and thus participated according to their own
perceived needs. The education course and support groups were conducted by
volunteers, who were all relatives of people with mental illness. Course instructors

35
and support group leaders received training from the National J ourney of Hope
Institute.

The evaluation aimed to investigate the outcomes for families who had participated in
the program from 1993 to 1996. Participants were given a series of questionnaires
after their participation in the program, which were designed to assess participation
level, satisfaction with the program, and achievement of program outcomes. A total of
1,131 participants were sent questionnaires about the program, and responses were
received from 424 individuals, giving a response rate of 39%. The majority of
respondents were female (79%), and were parents of a person with a mental illness
(65%). The relatives being cared for were predominantly male (67%), and most
frequently had a diagnosis of schizophrenia (42%). It was found that the
overwhelming majority of participants who responded to the questionnaire felt the
program had resulted in improvements in their knowledge of causes and treatment of
mental illness, their knowledge of the mental health care system, and their overall
morale.

The authors examined whether particular factors were predictive of achievement of
program outcomes. It was found that participants who expressed greater satisfaction
with the education program were more likely to report improved knowledge of both
mental illness aetiology and mental health services. It was also found that those who
were caring for a relative with a diagnosis of schizophrenia reported increased
knowledge of causes and treatments of mental illness, while those whose relatives did
not have schizophrenia tended to report improved morale as a result of the program.
Overall, the authors stated that the J ourney of Hope program may assist families to
cope in their role as caregivers, and proposed that the program may be appropriate for
offering education and support in future to families of people with mental illness.

An early study by Leff et al (1982; 1985) investigated the impact of a social
intervention for families of people with schizophrenia. The aim of the project was to
determine whether a social intervention could affect the course of schizophrenia in
individuals who were also on anti-psychotic medication. The social intervention
involved a brief educational program, a support group for relatives, and family
sessions held in the home. The educational component comprised two sessions, and
provided information about the causes, symptoms, prognosis and management of
schizophrenia.

The study design involved a randomised controlled trial, with 24 participants selected
from recent admissions to three London hospitals. All participants were aged from 16
to 65 years, had been living with relatives prior to admission, spent more than 35
hours per week in direct contact with at least one relative, and lived close to the
hospital of admission. In addition, at least one member of the family had been
identified as high expressed emotion, as the authors were interested in the impact of
expressed emotion on the course of schizophrenia. All 24 participants had been
prescribed anti-psychotic medication, and families were randomly assigned to either
the intervention or control group. Characteristics of both groups were found to be
similar, with the exception that the participants in the intervention group had
experienced significantly greater duration of unemployment prior to hospital
admission.


36
The social intervention was conducted with the intervention group for nine months,
and follow-up was conducted immediately after the program, and again at two-years
post-intervention. At two-year follow-up, it was found that a total of five participants
had discontinued their medication. Three of these participants were from the control
group, and the remaining two were in the intervention group. These participants were
excluded from the evaluation of the program, as the aim of the intervention was to
examine its impact in addition to regular pharmacological treatment. For the
remaining participants, it was found that there had been a relapse rate of 78% in the
control group, and only 20% in the intervention group. Relapses were defined as
either the reappearance of symptoms of schizophrenia or the exacerbation of
previously stable symptoms. The difference in relapse rate between the two groups
was statistically significant. It was also found, however, that a number of suicide
attempts had been made by participants, and when these were included in the rate of
treatment failure, there were no significant differences between the two groups.

The authors concluded that the social intervention had resulted in improved outcomes
for participants in terms of schizophrenic relapse. They acknowledged, however, that
this was not the case when suicide was included as a measure of management failure,
along with reappearance or exacerbation of symptoms of schizophrenia. It is
important to note that the authors did not attempt to measure whether the social
intervention had any impact on the knowledge, attitudes and behaviour of families
who participated, therefore it is unclear whether the educational aspects of the
program achieved changes in mental health literacy.

This particular issue was addressed in a later study by Berkowitz et al (1984; 1990),
which aimed to measure the impact of the educational aspect of the program
described by Leff et al (1982; 1985). The later study included 33 participants from 23
different families of people with schizophrenia, and inclusion criteria for participants
were similar to those in the earlier study by Leff et al. All participants undertook the
educational program, and were then randomly allocated to either a relatives group or
to family therapy for the remainder of the study.

The educational component comprised four brief presentations given by mental health
professionals about causes, symptoms, diagnosis, treatment and course of
schizophrenia. The content of the educational program remained the same as in the
earlier study, however the information was presented in a more personal manner.
Participants received the information in their homes, and each family was given the
presentations separately. Evaluation of the educational program involved interviews
with participants, which were designed to measure changes in knowledge. Interviews
were conducted prior to the program, immediately following the education
component, and again nine months later. Of the 33 participants, 21 completed all three
interviews, and only these complete data sets were included in the analysis.

It was found that responses to several questions changed significantly over the course
of the education program. In particular, there were increases in the number of
participants who knew what was wrong with their ill relative and could name the
condition. At nine-months follow-up, significantly more participants stated that
schizophrenia could be inherited, family members attitudes to the ill relative had
improved, and there was increased optimism for the future of ill relatives. It was

37
found that there were no significant differences in knowledge between participants in
the relatives group and those in the family therapy group.

It was concluded that the changes in knowledge measured immediately following the
program could most likely be attributed to the impact of the educational component.
The authors stated that the changes identified at the nine-month follow-up might have
been influenced by the therapeutic interventions in addition to the education program.
In contrast to the previous study, the authors were able to demonstrate that the
educational component of the program had an impact on knowledge. They
acknowledged that immediate changes in knowledge were limited and were largely
related to diagnosis, however they argued that initial changes may have enabled
families to develop greater tolerance for their ill relatives and to continue improving
their knowledge.

A similar program for families of people with schizophrenia was evaluated by Smith
and Birchwood (1987). The evaluation focused on the benefits of an educational
program for relatives and mental health consumers, and measured changes in
knowledge and perceptions of schizophrenia. Participants in the study were 23
families who had a relative with schizophrenia, and who were selected using a
random sample of patients with schizophrenia from a hospital in Birmingham.
Patients who were selected for the study all had one or more major symptoms of
schizophrenia, were either living at home or in close contact with their family, and
had been prescribed neuroleptic medication. Participants from the 23 families were
randomly assigned to one of two intervention groups.

The first group was designated the group condition intervention, and received an
educational intervention consisting of four information sessions conducted by a
therapist over a four-week period. The sessions were in a seminar format, and
included oral and audiovisual presentations, as well as general question and answer
discussions. Participants also received a booklet containing information covered in
each session and a written homework exercise. The second group, referred to as the
postal condition intervention, received only the information booklet and the
corresponding homework exercise through the post each week over the four-week
period. Information given to both groups was divided into four sections, comprising:
concepts and causes of schizophrenia, symptoms of schizophrenia, treatments and
prognosis, and hospital and community resources.

Evaluation of the program involved measures of knowledge, beliefs, worry and fear,
behavioural disturbance, stress and family distress. Measurements were taken prior to
the commencement of the program, immediately following the intervention, and again
at six-months follow-up. It was found that there were no significant differences
between the two intervention groups at baseline on any of the measures, with the
exception that the participants in the postal group had a significantly higher level of
worry.

Following the program, there were significant improvements in knowledge in both
groups, which were maintained after six months. However, it was found that group
condition participants gained significantly more knowledge than postal condition
participants. Participants in the two groups indicated similar beliefs about the
treatment and course of schizophrenia throughout the study, however immediately

38
following the intervention the group condition participants indicated increased
optimism about the role of the family in treatment compared with the postal group.
This difference disappeared at six-months follow-up.

In terms of measures other than those relating to knowledge and beliefs, it was found
that levels of fear decreased for both groups following the intervention. At six-month
follow-up this change was only maintained in the postal group. Scores for levels of
stress also decreased for both groups immediately following the intervention, however
this was not maintained in either group after six-months, when it was found that
scores had returned to baseline levels. Levels of reported burden on the family did not
change immediately following the intervention, however for both groups there were
significant reductions in this measure at six-months follow-up. Scores for symptom
related behavioural disturbance in the family members with schizophrenia did not
alter in either group throughout the study.

Overall, the findings of the study indicated that the educational intervention had
resulted in significant improvements in knowledge and reductions in stress and fear
among participants. However, no association was found between levels of knowledge
attained and measures of other effects on family members. After six months, only the
changes in knowledge were maintained, and all other effects had returned to baseline
levels, with the exception that participants in the postal group maintained reductions
in levels of reported fear. The authors stated that the information presented to
participants in both groups had resulted in increased knowledge, however knowledge
acquisition was enhanced in the participants who were presented with the educational
information in group sessions. Most other effects of the intervention were common to
both groups, which indicates that the information content itself was responsible for
these changes, rather than the mode of delivery. The authors stated that the study had
shown that access to written information was an effective and less costly alternative to
group education. They acknowledged, however, that such an approach lacked
flexibility for adaptation to individual needs and did not provide opportunities for
feedback and clarification.

Solomon et al (1996) conducted a randomised controlled trial to investigate a similar
program for relatives of people with serious mental illness. Two different
psychoeducational strategies were selected for the program: group psychoeducation
and individualised consultation. The program was broader than those investigated in
previous studies in that it sought to include family members regardless of whether the
ill relative was residing with the family or was seeking treatment. The study therefore
aimed to measure the impact on family members of interventions that were
independent of the treatment or participation of ill relatives. The two interventions
compared in the study were developed by family advocates and mental health
professionals, and were administered by the Training and Education Center (TEC)
Network. Investigations in the current study involved measurement of the impact of
the interventions on participants in terms of subjective burden, grief, social support,
self-efficacy, mastery, adaptive coping, and stress.

The study was conducted in a city on the east coast of the US, and participants were
recruited through support groups, hospital social service departments, family
information programs, and media presentations. Individuals asked to participate in the
study were relatives of people who had been diagnosed with either schizophrenia or

39
major affective disorder at least six months prior to the study. Participants were
required to have major responsibility for and be in regular contact with the ill relative,
and participants and ill relatives were all at least 18 years of age. A total of 225
participants were recruited for the study and were randomly allocated to one of three
groups: 66 were assigned to individual family consultation, 67 to group family
psychoeducation, and 92 were allocated to a waiting list, which acted as the control
group.

Interventions were conducted over three months, and participants were surveyed prior
to and following the intervention period. The individual family consultation
intervention involved between six and fifteen hours of educational assistance provided
by a specialist consultant to either the whole family or one family member. Group
family psychoeducation comprised ten two-hour sessions, which were delivered to
participants in eleven separate groups, and were facilitated by trained mental health
specialists and peer consultants.

Following the intervention period, it was found that the only significant outcome
associated with the interventions was an improvement in specific self-efficacy.
Specific self-efficacy was defined as confidence in ones ability to understand a
relatives mental illness and cope with its consequences. The authors stated that this
finding was not unexpected, as the psychoeducational interventions tended to focus on
improving family members confidence in relating to their ill relatives. Further
analysis was conducted to determine whether prior experience in support groups had
an impact on outcome of the interventions in terms of specific self-efficacy. It was
found that individual consultation resulted in improved self-efficacy regardless of
prior support group attendance, while group psychoeducation was beneficial only to
those who did not have previous support group experience.

It was concluded that, while both psychoeducational interventions had demonstrated
improvements in self-efficacy among participants, individual consultation was more
useful than group psychoeducation for those who had previously attended family
support groups. The authors noted, however, that individual approaches involve
greater resources than group strategies. They therefore concluded that it might be
appropriate to adapt group psychoeducational sessions to involve components of the
individual consultation model, such as focusing on providing empathy and support to
individual group members.

In contrast to the previous studies, which examined educational programs for general
family members, Mannion, Mueser and Solomon (1994) studied the impact of a
program designed specifically for spouses of people with severe mental illness. The
program involved a group psychoeducational approach, and comprised ten two-hour
sessions conducted over consecutive weeks. As in the previous study (Solomon et al
1996), the program was administered by the Training and Education Center (TEC)
Network. The program was developed following collaboration between mental health
professionals and a number of spouses of people with mental illness who had
previously attended coping skills workshops at the TEC. Each of the ten sessions was
facilitated by a mental health professional and a trained family member, and involved
a 30-minute oral presentation followed by a 90-minute discussion of coping skills.
Participants also took part in role-play exercises, and were provided with written
material and homework tasks.

40

The aim of the evaluation was to measure whether the program improved knowledge
of mental illness and coping strategies. A questionnaire was developed for the
purposes of the study, and was administered prior to and following the program, and
at one-year follow-up. The questionnaire included items about attitudes to the ill
partner and levels of personal distress, as well as questions relating to knowledge of
mental illness and coping skills. A total of 34 participants who took part in the
program were involved in the study, however only 19 (68%) completed
questionnaires prior to and immediately following the program. Of these participants,
10 (53%) completed the one-year follow-up assessment.

The results of the questionnaire administered prior to the program indicated that high
levels of personal distress were significantly associated with negative attitudes to the
ill spouse. Following the program, it was found that there were statistically significant
improvements in participants knowledge of mental illness, coping skills, levels of
personal distress and attitudes to the ill partner. These improvements were maintained
twelve months after the program. Analysis of the results showed that reduced levels of
distress were associated with improved attitudes to the spouse. However, it was found
that changes in knowledge and coping skills were not related to improved levels of
distress or attitudes to the ill partner.

The authors concluded that the program had been effective in improving participants
knowledge and coping skills, while reducing levels of distress and negative attitudes
to the ill spouse. However, they also stated that improved knowledge and coping
skills were not directly related to observed changes in distress and attitudes. It was
hypothesised that social support attained from the intervention may have been
responsible for reduced distress and more positive attitudes. The authors argued,
however, that improving knowledge of mental illness was an important goal of spouse
educational programs, as this may lead to improved ability to monitor symptoms and
management of the illness.

A mental health education program specifically for caregivers of elderly people with a
mental illness was evaluated by Raskin et al (1998). The study involved 20 caregivers
at community residences in the United States who were providing care to a total of 63
veterans aged 55 years or older. The education program comprised two sessions
conducted over two weeks. Each session ran for two hours, and presenters included
mental health and allied health professionals. Presentations included information
about the causes, symptoms and treatment of major mental illnesses, and the provision
of support and care for the elderly residents. In addition to the presentations,
participants in the program received an information manual, providing an overview of
symptoms and treatment of mental illness, and focusing in particular on issues
relating to the elderly.

The program was evaluated using assessment instruments designed by the authors to
determine the impact of the training sessions on the elderly residents. Following the
program, participants were asked to rate the usefulness of the program, and a follow-
up survey one year later was designed to provide information about the experiences of
the residents who were looked after by the caregivers.


41
Information collected prior to the program indicated that the residents involved in the
study were generally single, white males with a mean age of 66 years. The vast
majority (82%) had a diagnosis of schizophrenia. Living conditions were rated
positively overall, and 91% of the residents had previously been hospitalised.
Following the program, the majority (70%) of caregivers who had participated in the
program indicated that they found it helpful. In particular, the information provided
about mental illness and treatments was well received by participants, and the vast
majority (88%) enjoyed the opportunity of meeting with other caregivers.

At the one-year follow-up, it was found that there was a significant decrease in the
number of hospital admissions for the 63 residents during the twelve months
following the program (26 admissions), when compared with the twelve months prior
to the program (37). The majority of hospital admissions which occurred in the year
following the program were for medical reasons (17) rather than psychiatric reasons
(9), however those admitted for psychiatric reasons generally spent more time in
hospital than those admitted for medical reasons. It was found that there were few
changes in living arrangements for the residents in the year following the program.
There was, however, some improvement in terms of the number of quality of life
activities for the residents.

The authors concluded that the education program served a useful purpose for the
caregivers who participated, and that hospital admissions for the elderly residents
decreased following the program. They also stated that the individuals with mental
illness who were involved in the study were happy with their living arrangements, and
that they were able to develop positive relationships both with caregivers and with
other residents in the home. The authors argued that these findings provided support
for the policy of placing people with chronic mental illness in community residences.
School-based programs for adolescents
Two studies conducted in Australia have considered the impact of school-based
mental health literacy programs targeted to adolescents. A recent evaluation of the
MindMatters pilot project in Australia identified a number of positive outcomes,
although the overall findings were mixed (MindMatters Evaluation Consortium 2000;
Wyn et al. 2000). The MindMatters pilot project was undertaken in 1998 and 1999 in
24 schools selected from all Australian states and territories. The aims of the project
were to improve attitudes, values and knowledge of mental health, improve life skills
capabilities among young people, improve access to mental health resources, and
promote models of excellence in mental health promotion in schools. The project
involved the development of resources for a whole-school approach to mental health
promotion, and was based on the Health Promoting Schools concept (Commonwealth
Department of Health and Family Services 1996). This approach included
incorporating mental health education into the school curriculum, as well as
addressing school policies and practices.

At the beginning of the program, teachers were provided with two days of
professional development activities, in order to introduce the concepts of Health
Promoting Schools and MindMatters. Each of the schools involved in the project then
established a core team, who were responsible for planning and implementing the
project. At the beginning of the project, schools conducted an audit of their current
mental health curriculum and activities, then utilised the MindMatters resource

42
documents to implement strategies that addressed their particular needs. Classroom
resources developed for MindMatters related to four key issues: enhancing resilience,
understanding mental illness, bullying and harassment, and loss and grief. Each
school agreed to incorporate at least one of the curriculum units into their educational
program. Schools also developed a range of activities as part of their whole-school
strategies, which included youth forums, mental health days, producing plays and
videos, and conducting staff surveys about mental health issues. Schools were also
encouraged to form partnerships with community organizations and health agencies to
enhance the whole-school approach to mental health promotion.

Following the project, an evaluation study was undertaken involving qualitative and
quantitative methods. One of the key aims of this study was to measure outcomes for
students involved in the program in terms of changes in knowledge and attitudes to
mental health, quality of school life, and coping style. Students were administered a
Knowledge and Attitude questionnaire, developed for the project. They were also
given the Quality of School Life Questionnaire, to assess changes in perceptions of
school life, and the COPE questionnaire, which is designed to measure coping styles.
Questionnaires were administered at baseline, during the project, and following the
project. It should be noted that incomplete data sets were received from six of the
schools, and a further five schools did not provide any data from the questionnaires.

It was found that, although all schools implemented at least part of the curriculum
resources, there was a lower level of commitment to introducing changes in school
ethos and developing new community partnerships. With respect to the curriculum,
the most frequently utilised resources related to Dealing with Bullying, with
eighteen schools incorporating this into the curriculum. In addition, twelve schools
used Understanding Mental Illness, ten schools used Enhancing Resilience, and
only four schools trialled the Loss and Grief curriculum.

Evaluation of student outcomes indicated that there was in fact a decrease in the
proportion of students who could define mental health in health-related terms, and a
decrease in the proportion of students who could correctly name one mental illness,
following the project. In contrast, there was a significant increase in the proportion of
students who stated that they would be willing to have someone with a mental illness
marry into their family, or to have someone with a mental illness as a teacher. There
was no change in the proportion of students who nominated school as a source of
information about mental illness throughout the project. There was found to be an
increase in the proportion of students who were willing to seek help from professional
sources, but no change was found in the proportion of students indicating that they
used a range of coping styles.

The authors concluded that they were unable to address the issue of causality in terms
of changes in students knowledge and attitudes as a result of the project. It appears,
however, that changes in knowledge, attitudes, and behavioural intentions did not
follow any particular trend. The authors argued that a number of beneficial outcomes
of the project were identified. In particular, there had been uptake of at least part of
the curriculum components in all schools, and the implementation of the program had
been supported by the participating schools. They stated that the pilot project had
been most successful in schools where there was support from the school executive

43
and the school community, and recommended that the implementation model be used
for future projects.

An earlier evaluation of school-based mental health education looked at the School
Education Program (SEP) now known as Mental Illness Education Australia
(MIE-A) - which was an initiative of the New South Wales branch of the Association
of Relatives and Friends of the Mentally Ill (ARAFMI) (Wearing and Edwards 1994).
The aim of the SEP was to educate school students nationwide about mental health
and mental illness, in order to improve understanding and reduce fear and ignorance
of mental illness among young people and their families. The program, which began
in Sydney in 1988, received funding from the Australian Youth Foundation in 1992 to
extend its activities nationwide, and had commenced in other states by 1994.

In contrast to the MindMatters program, the educational component of the SEP
involved presentations given to school students by volunteers with experience of
mental illness. Topics covered in the presentations included: definitions of mental
illness, facts and statistics, community attitudes, personal experiences of mental
illness, and a discussion of mental health resources available to students. A range of
curriculum materials were developed to promote the program and to assist the
classroom presentations. These included fact sheets, information packs for teachers, a
video, and orientation kits to help with recruitment of volunteer presenters.
Volunteers were trained in order to enhance skills in presentation techniques, as well
as knowledge of mental illness, and presenters underwent ongoing review throughout
the program. The program content and format were also revised and improved
between 1992 and 1994, in order to focus more on the concept of the relationship
between mental illness and mental health. In addition, a program for students from
Non-English Speaking Backgrounds (NESB) was developed to address the particular
needs of this audience.

The evaluation of the program aimed to assess the impact of the SEP on students.
Surveys of students were conducted at two stages during the program. The first survey
was undertaken prior to the education program, and involved 162 young people in the
Sydney area. This results of this survey indicated that the vast majority of respondents
(98%) had a medium level of general understanding of mental illness prior to the
educational program. The authors also noted that 36% of participants reported
previous contact with someone with a mental illness. A second survey was conducted
nationwide after May 1994, however only 25 further responses were obtained in
addition to the initial Sydney-based sample, and all of these were from students in
Queensland. It was found that there were improvements in awareness of mental
illness following the education program, and those with prior direct contact with
mental illness were more likely to show improved attitudes following the program
than those with no previous exposure. It is important to note, however, that measures
of statistical significance of changes in knowledge were not provided.

The authors concluded that the SEP had been effective in generating greater
awareness of mental illness among participants. They stated that the role of volunteer
presenters was an important factor in the success of the program. The authors argued
that there was a need to target the program to particular audiences, as the student
population is diverse in terms of cultural and socio-economic backgrounds. They also
stated that it was important to recognise when structuring the program that a

44
significant proportion of young people will have prior experience of or contact with
mental illness. It is worth noting that, since the evaluation was conducted in 1994, the
School Education Program (now MIE-A) has undergone considerable revision, and
evaluations of the revised program are currently in progress in a number of Australian
states and territories.

In the overseas context, a school-based program to improve understanding of mental
health issues undertaken in a rural area of Pakistan found encouraging results
(Rahman et al. 1998). The aim of the program was to improve the awareness of
school students, as well as their parents, friends and neighbours, of issues relating to
mental health and illness. Four schools were selected to participate in the study. Two
of the schools were involved in the intervention program, and the remaining two
schools acting as control groups. All four schools had similar characteristics in terms
of size and socio-economic areas, and all were government run. Participants in the
study were 100 school students (aged 12-16 years), 100 parents, 100 friends who did
not attend school, and 100 neighbours.

The educational program was facilitated in each school by a mental health team
comprising a doctor, a psychologist and a social worker. The teams first assessed each
schools educational facilities, as well as the knowledge, attitudes and behaviour of
teachers with respect to mental health issues. Teachers attended training courses about
mental health disorders, and collaborated with the mental health team in developing
the educational curriculum for the school. Educational methods devised for the
program included essay writing and poster competitions relating to mental health, and
the production of short plays. During the program, teachers gave daily lectures about
mental health issues to the students, and mental health posters were displayed in
schools. The mental health teams also made weekly visits to the schools.

The evaluation involved an assessment of attitudes to and awareness of mental health
issues before and after the school program. Participants were given a 19-item
questionnaire designed to assess knowledge and attitudes to mental health disorders.
A high score on the questionnaire indicated a high level of awareness of mental health
issues. School students were administered the questionnaire in the classroom, and
were then given three additional questionnaires in order to collect responses from a
parent, a friend who did not attend school, and a neighbour. The questionnaire was
given to all participants prior to the start of the school program, and again after
completion of the program.

Prior to the beginning of the program, levels of awareness were found to be poor
overall. Scores were particularly low for questionnaire items relating to traditional
beliefs about mental illness. For example, respondents tended to agree with statements
suggesting that people with a mental illness are dangerous, immoral and a bad omen
for the family. School students in both the control and intervention groups received
similar scores on the questionnaire conducted prior to the beginning of the program.
This was also true for parents and friends who completed the questionnaire, but the
neighbours in the control group received slightly lower scores than neighbours in the
intervention group.

All intervention groups showed improvement in scores in every item after the
program, with the most significant change occurring in the school students who took

45
part in the program. Students in the intervention group scored significantly higher on
the questionnaire at the completion of the program than students in the control group.
In addition, parents, friends and neighbours of participants in the program all scored
higher than their counterparts in the control group. Although there was some
improvement in scores in the control groups of school students and their friends, this
was a much smaller change than that of the intervention group.

The authors stated that there was a significant improvement in participants awareness
of issues relating to mental health and illness following the four-month education
program. There was also found to be a significant improvement in the awareness of
their parents, friends and neighbours, however this change was less marked than that
of the school students who participated in the program. By comparison, only a minor
change in awareness was detected in the control groups throughout the study. The
authors concluded that the school program had been successful in improving mental
health awareness of the school students and their local community, and stated that this
model may be appropriate for other communities. They acknowledged, however, that
no long-term follow-up had been attempted, and they were therefore unable to
demonstrate a sustained change in attitudes or behaviour.

Esters, Cooker and Ittenbach (1998) similarly studied the impact of a mental health
education program on the knowledge and attitudes of rural adolescents, this time in
Mississippi. The study involved 40 students from a rural high school who were placed
into either an intervention or control group. The education program was presented to
the 20 students in the intervention group over three days. The program involved the
use of an educational video targeted to adolescents. Information was also provided
about sources of help in the community, including the definitions and qualifications of
different mental health workers, and there was discussion of the stigma associated
with mental illness. The control group attended regular classes, which did not cover
topics related to mental health issues.

The study involved the measurement of knowledge and attitudes relating to mental
illness prior to the education program, and on two occasions following the program.
Participants were given the Opinions about Mental Illness Questionnaire to measure
perceptions about mental illness, and the Fischer-Turner Pro-Con Attitude Scale to
measure attitudes to seeking help for mental health issues.

The results of the study were that the knowledge and attitudes of the intervention
group improved following the education program, and these changes were statistically
significant. It was also found that the changes were maintained at the three-month
follow-up survey. By comparison, the control group did not show any significant
changes on the questionnaire scores throughout the study. The authors concluded that
the intervention had successfully altered the participants knowledge of mental illness
and attitudes to seeking help for mental health problems. They argued that such
changes in attitudes were important in encouraging appropriate help-seeking
behaviour.

Similar results were obtained by Battaglia, Coverdale and Bushong (1990) in their
study of a school program coinciding with Mental Illness Awareness Week. The aim
of the study was to measure participants attitudes to seeking help for mental health
problems, and to measure their interest in receiving information about mental health

46
issues. The program comprised mental health information sessions presented to
students at a number of public schools. Presentations were given by psychiatric
physicians, and covered topics including psychiatry, depression, suicide, and drug and
alcohol issues. Twenty physicians from the psychiatry program at the University of
Texas were selected to give the presentations, and attended training sessions in
preparation. Presenters were also provided with manuals detailing available youth
services, which were distributed to the participating schools.

Participants in the program were 1,380 students from ten different schools who
attended a 45-minute presentation and who subsequently completed questionnaires. A
further 280 students selected from the same schools who did not attend the
presentations comprised the comparison group. Of those who took part in the
program, 57% indicated that they liked the presentation very much, and 69% found
that it was helpful. Similar numbers of students in both the intervention and
comparison groups indicated that they had previously received talks about mental
health issues at school, with just over one-third indicating that they had been
presented with a talk about psychiatrists and approximately half reporting that they
had received information about depression and suicide. Attitudes to mental health
professionals were generally positive in both intervention and comparison groups,
however those in the intervention group expressed more positive attitudes than those
in the comparison group. In addition, those who had previously received information
at school about psychiatrists were more positive than those who had not.

When asked about attitudes to help-seeking, those who had previously received
information about mental health issues were more likely to report that they would
seek help for mental health problems than those who had not received such
information. Out of all participants who indicated they had previously received mental
health information at school, those in the intervention group were more likely than
those in the comparison group to report that they would seek help for mental health
problems. An additional finding was that students in higher grade levels were
significantly less likely to report that they would seek help. J ust over two thirds (68%)
of participants in the intervention group indicated that they would like to receive
further information about mental health issues, compared with 58% of the comparison
group.

The authors concluded that the school presentations had a positive impact on
participants attitudes to mental health professionals and to seeking help for mental
health problems. This is consistent with the finding of Esters, Cooker and Ittenbach
(1998) that the presentation of mental health information to school students was
associated with more positive attitudes to seeking help. However, the authors of the
current study acknowledged that they were unable to determine whether positive
attitudes were maintained in the longer term.
People from non-English speaking backgrounds
A pilot study of the impact of a mental health literacy program targeted to people
from particular non-English speaking backgrounds was conducted as part of the
Defeat Depression campaign in the UK (Bhugra, Baldwin and Desai 1997). The aims
of the study were to determine whether the provision of fact sheets could improve
knowledge about depression, and to investigate the impact of participation in a
discussion group about depression.

47

The study involved the use of educational fact sheets produced in several languages:
Hindi, Punjabi, Gujarati, Bangla and Chinese scripts. The aim of the fact sheets was to
provide information about depression to the lay public, including descriptions of
symptoms, causes and treatment of depression. Participants in the study were people
who attended a drop-in centre in an area of West London, all of whom identified
themselves as originating from the Indian subcontinent. Of the 24 individuals who
attended the centre, 22 agreed to participate in the study. The sociodemographic
characteristics of those who agreed to take part in the study were found to be similar
to those of the individuals who declined to participate.

The study involved the use of the Depression Knowledge Questionnaire, which was
adapted from a questionnaire developed for use in the Defeat Depression campaign
population surveys (Priest et al 1996). Participants were asked to complete the
questionnaire about knowledge of depression at the beginning of the study. Fact
sheets were then distributed to each participant in their preferred language, and
questionnaires were re-administered following the presentation of the educational
information. This stage of the study was then followed by a twenty-minute discussion
about depression between the researchers and the participants, and questionnaires
were then administered for a third time following the discussion group.

Of the 22 participants, 21 provided complete sets of data for the study. Only these 21
data sets were included in the analysis of results of the study. Participants ranged in
age from 30 to 71 years, and the majority (12 participants) were women. The results
of the questionnaire administered to participants at the beginning of the study were
compared with those obtained in a survey of the general population conducted for the
Defeat Depression campaign (Priest et al 1996; Paykel et al 1998). It was found that
there were some differences in responses to the questionnaire between the study group
and the general population. For example, only 52% of study participants agreed that
depression is a medical condition like any other, compared with 73% of the general
population. The authors stated that this finding was expected, as previous surveys of
people from similar cultural backgrounds to the study group had shown that they did
not tend to have a medical model and explanation for the concept of depression.

After the presentation of the educational fact sheets, it was found that there was some
improvement in knowledge of depression among study participants. An example of
this was an increase in the proportion of participants who agreed that depression was
like any other medical illness from 52% at baseline to 66% following presentation of
the fact sheets. Participants views about treatment of depression also changed during
the study. The proportion of participants who agreed that anti-depressant drugs should
be offered as treatment for depression increased from 38% at baseline to 67% after
reading the educational information. It was also found that changes in knowledge
were generally maintained or improved following the discussion group. However, it is
unclear from the analysis of the data if the observed changes were statistically
significant, particularly given the small sample size.

The authors concluded that the provision of educational fact sheets in appropriate
languages had improved knowledge of depression among individuals from non-
English speaking backgrounds. They also stated that small-group discussions could
enhance changes in knowledge. They noted, however, that the study had been unable

48
to indicate whether such changes were maintained over time. It was also concluded
that there was a need to identify appropriate concepts and explanations of depression
for different cultural groups when developing future targeted programs.
Methodological issues
Research investigating programs targeted to carers and families of people with mental
illness raised several methodological issues. In their respective studies of mental
health education programs for caregivers, Raskin et al (1998) and Pickett-Schenk,
Cook and Laris (2000) did not use a control groups for comparison with the
intervention group. In addition, participants levels of mental health literacy were not
measured prior to the program; therefore neither study was able to demonstrate that
there were changes in knowledge or attitudes over the course of the intervention.

Raskin et al (1998) stated that measuring the impact of an educational program
targeted to caregivers was an important aim of their study, however the study design
was not appropriate to determine whether the program actually resulted in
improvements in knowledge. Although the findings indicated that there were
improvements for the residents who were being looked after by the caregivers, it is
unclear whether this was a direct impact of the program, or whether other factors may
have been involved. The study by Picket-Schenk, Cook and Laris (2000) of the
J ourney of Hope program relied on self-report of changes in knowledge, therefore it is
not known whether such changes actually occurred, and whether any reported changes
were due to participation in the program. It is also important to note that the response
rate to the survey was quite low (39%), and it is possible that those who did not
respond to the survey may have expressed different opinions about whether the
program outcomes had been achieved. The authors stated that a before-and-after study
design, with pre-test and post-test measures, would be needed to determine whether
the program outcomes were achieved. Given these limitations, it is unclear to what
extent the positive results reported in either study were actually achieved among study
participants.

Solomon et al (1996) used a randomised controlled trial study design to compare the
impact of two different educational interventions. This design does not share many of
the weaknesses of other studies of similar programs. It was possible in this study to
demonstrate the positive effects of the interventions, compared with a control group
who did not receive an intervention over the study period. Leff et al (1982; 1985)
similarly conducted a randomised controlled trial, and concluded that their study had
found a positive impact on the level of relapse for participants as a result of a social
intervention. Although the intervention and control groups were not entirely similar,
the authors stated that when the sample of participants was stratified by demographic
characteristics, no significant associations were found between these characteristics
and observed outcomes. However, the authors acknowledged that they could not
determine whether the impact of the intervention was due to the components of the
intervention itself, or to the increased attention given by professional staff to families
in the intervention group, as those in the control group did not receive the same level
of contact. They acknowledged that there are difficulties in providing placebos for
social interventions, and recommended that further research was necessary to
determine the impact of the specific aspects of such interventions.


49
This limitation was overcome to some extent by Smith and Birchwood (1987), who
examined whether educational information itself had any impact for families, rather
than the increased involvement of professional staff. They compared two different
interventions, and found that both the educational information and the context of its
delivery contributed to changes in knowledge. Berkowitz et al (1984; 1990) were also
able to measure the impact of the educational component of a program. However, the
study did not involve the use of a separate control group for comparison with the
educational intervention, and the authors acknowledged that the numbers of
participants in the two social intervention groups may have been too small for
meaningful analysis of the impact of the interventions on knowledge.

This issue was also raised by Bhugra et al (1997), who acknowledged that the small
sample size included in their study was an important limitation. The study also did not
involve a control or comparison group, and it is unclear whether the participants were
a representative sample of the particular cultural groups targeted by the program. As
this was a pilot study, the conclusions provide an indication only, and given the
studys limitations any findings may not be generalisable to other populations and
settings. It is important for similar studies to be conducted on a larger scale to confirm
the findings. In particular, future studies should consider whether any observed
changes are maintained in the longer-term.

Studies investigating the impact of school-based programs for adolescents also raised
particular methodological issues. In particular, the evaluation of the MindMatters
project faced a number of significant limitations (MindMatters Evaluation
Consortium 2000). The study did not involve the use of comparison schools, and the
authors acknowledged that true baseline data from the intervention schools could not
be obtained, as many of the schools had commenced the program prior to the first
round of data collection. Several schools were unable to provide complete sets of
responses to all three questionnaires, which made comparison between overall
baseline and follow-up data difficult to achieve. In addition, each school adopted a
different approach to implementation of the program, and therefore participants at
different schools received different interventions. As a result of the methodological
limitations of the study, the authors were unable to address the issue of causality in
relation to changes in knowledge and attitudes. It is clear that further evaluation
would be required to determine the impact of the program.

Similarly, the evaluation of the School Education Program (SEP) was unable to
provide adequate information about whether the program had resulted in changes in
knowledge and attitudes (Wearing and Edwards 1994). The authors of the evaluation
acknowledged that the sample was not representative of the participants in the
program, particularly in the second phase of the evaluation, which obtained a response
rate of only 10%. They were also unable to determine whether changes in awareness
of mental illness identified in the study were statistically significant, and stated that
the surveys were insufficient to detect changes in attitudes and knowledge. As this
was one of the important aims of the evaluation, the inability of the study to measure
such changes is a significant limitation of this particular study.

Unlike the MindMatters and SEP evaluations, the study by Esters, Cooker and
Ittenbach (1998) used a concurrent control group. Although the study did not involve
randomisation of participants into treatment and control groups, it was found that the

50
baseline questionnaire scores were similar for both groups. Battaglia, Coverdale and
Bushong (1990) similarly did not use randomisation in their study, and it is also
important to note that participants attitudes were not measured at baseline. It is
therefore unclear whether both groups in this study held similar attitudes prior to the
intervention. The authors acknowledged that the less positive attitudes to psychiatrists
expressed by the comparison group may have been due to prior negative bias amongst
the students who did not attend the presentations. The groups also had different
characteristics in terms of grade levels, and the comparison group was much smaller
than the intervention group, which meant that certain sub-groups were too small for
meaningful comparison.
Summary
Overall, the literature suggests that programs targeted to specific groups within the
population can improve levels of mental health literacy. It is important to note that
there were significant methodological limitations associated with many of the studies
reviewed in this section, and the generalisability of the findings is limited. The
strongest evidence perhaps relates to the impact of educational interventions for
families of people with schizophrenia. In addition to changes in knowledge and
attitudes, the literature indicates that programs targeted to carers and families of
people with mental illness may result in improved outcomes for mental health
consumers, however it is unclear whether such effects may be maintained in the
longer term.

Evaluations of school-based programs targeted to adolescents generally found
improvements in terms of awareness and attitudes relating to mental health issues.
While these results may be considered encouraging, it should be noted that the
evaluations of both the MindMatters curriculum and the School Education Program in
Australia were unable to address adequately the issue of changes in participants
levels of mental health literacy.

The nature of the literature indicates that there is a need for further evaluations of
programs targeted to subgroups of the population, particularly in the Australian
context. It is clear that there are various groups within the community who may
benefit from targeted mental health literacy programs, however there is little literature
addressing the issue of effectiveness of such programs at present. It is particularly
important that programs currently underway or in development undergo systematic
evaluation, in order to extend the evidence base in this area.

51
Table 2 Programs targeted to particular populations

Investigators Audience Study Design Country Method Program Content Key Findings
Pickett-
Schenk, Cook
and Laris
(2000)

Carers and
families
Post-test only
study with no
concurrent
controls
United
States
Evaluation of the
J ourney of Hope
mental health
education program,
targeted to families
of people with
mental illness.
Questionnaires
given to
participants after
the program to
determine whether
program outcomes
had been achieved.
A total of 424 out
of 1,131
participants (39%)
responded to the
questionnaire.

The program comprised an
eight-week education course
and a long-term support
group, and was designed to
provide education and skills
to primary caregivers.
Participants were not
required to attend both parts
of the program. The
education course and support
groups were conducted by
volunteer family members of
people with mental illness
who received training from
the National J ourney of Hope
Institute.
The majority of
respondents reported that
the program had
improved their
knowledge and overall
morale

52
Investigators Audience Study Design Country Method Program Content Key Findings
Leff, Kuipers,
Berkowitz,
Eberlein-
Vries, and
Sturgeon, D
(1982)

Leff, Kuipers,
Berkowitz
and Sturgeon
(1985)

Carers and
families
Pre-test/post-
test study with
randomisation
of controls
(randomised
controlled
trial)
United
Kingdom
Brief educational
program and longer
term support group
provided to families
of 24 people with
schizophrenia.
Participants were
randomly assigned
to intervention and
control groups.
Measurements of
relapse rates were
taken immediately
after the
intervention and
again at two-years
follow-up.

The social intervention
involved a short-term
educational program, a
support group for relatives,
and family sessions held in
the home. The educational
component comprised two
sessions, and provided
information about the causes,
symptoms, prognosis and
management of
schizophrenia. The program
was conducted over nine
months.
Relapse rates for
symptoms of
schizophrenia were
significantly lower in the
intervention group than
in the control group

53
Investigators Audience Study Design Country Method Program Content Key Findings
Berkowitz,
Eberlein-
Freis, Kuipers
and Leff
(1984)

Berkowitz,
Shavit and
Leff (1990)
Carers and
families
Pre-test/post-
test study with
comparative
design and
randomisation
into two
intervention
groups
United
Kingdom
An educational
program was
conducted
involving 33
participants from
23 different
families of people
with schizophrenia.
Participants were
later randomly
allocated to one of
two social
intervention groups.
Interviews were
conducted prior to
and following the
education program,
and at nine-months
follow-up.

The educational component
comprised four brief
presentations given by
mental health professionals
covering causes, symptoms,
diagnosis, treatment and
course of schizophrenia. The
content of the educational
program was the same as in
an earlier study by Leff et al
(1982), however the
information was presented in
a more personal manner.
Participants received the
information in their homes,
and each family was given
the presentations separately.
After the education
program there were
significant increases in
participants knowledge
about their relatives
diagnosis of
schizophrenia.
After nine months
significantly more
participants stated that
schizophrenia could be
inherited, attitudes to the
ill relative had improved,
and there was increased
optimism for the future
of ill relatives.
There were no
significant differences in
knowledge between
participants in the two
social intervention
groups.


54
Investigators Audience Study Design Country Method Program Content Key Findings
Smith and
Birchwood
(1987)
Carers and
families
Pre-test/post-
test study with
comparative
design and
randomisation
into two
intervention
groups

United
Kingdom
Educational
intervention given
to 23 families of
people with
schizophrenia.
Participants were
randomised into
two intervention
groups. Measures
of knowledge and
other effects on the
family were taken
at baseline,
immediately post-
intervention, and at
six-months follow-
up.

Participants were randomly
assigned to one of two
intervention groups. The first
group, the group condition
intervention, received four
educational sessions over a
four-week period. Sessions
included oral and audiovisual
presentations, as well as
general question and answer
discussions. Participants also
received information
booklets and a written
homework exercise. The
second group, the postal
condition intervention,
received only the
information booklet and
homework exercise through
the post each week over the
four-week period.
Information given to both
groups comprised: concepts
and causes of schizophrenia,
symptoms of schizophrenia,
treatments and prognosis,
and hospital and community
resources.

There were significant
increases in knowledge
after the program which
were maintained at six-
months follow-up
The use of group
educational sessions
enhanced the acquisition
of knowledge among
participants
There were reductions in
levels of stress and fear
which were not
maintained after six
months

55
Investigators Audience Study Design Country Method Program Content Key Findings
Solomon,
Draine,
Mannion and
Meisel (1996)

Carers and
families
Pre-test/post-
test study with
two
intervention
groups and
randomisation
of controls
(randomised
controlled
trial)
United
States
Study of a program
comparing two
psychoeducational
strategies.
Participants were
225 relatives of
people with severe
mental illness, who
were randomly
allocated to one of
three groups:
individual family
consultation, group
family
psychoeducation, or
a waiting list
(control group).
Interventions were
conducted over
three months, and
participants were
surveyed prior to
and following the
intervention period.

The program involved two
different psychoeducational
interventions: group
psychoeducation and
individualised consultation.
Individual family
consultation involved
between six and fifteen hours
of educational assistance
provided by a specialist
consultant to either the whole
family or one family
member. Group family
psychoeducation comprised
ten two-hour sessions, which
were delivered to
participants in eleven
separate groups, and were
facilitated by trained mental
health specialists and peer
consultants.
There was a
significant
improvement in
participants levels
of self-efficacy
associated with the
two interventions.
Individual
consultation was
more useful than
group
psychoeducation for
those who had
previously attended
family support
groups.

56
Investigators Audience Study Design Country Method Program Content Key Findings
Mannion,
Mueser and
Solomon
(1994)
Carers and
families
Pre-test/post-
test study with
no concurrent
controls

United
States
A total of 34
participants took
part in a
psychoeducational
program designed
for spouses of
people with mental
illness.
Questionnaires
were administered
pre-test, post-test
and at one-year
follow-up. 19 of the
participants (68%)
completed
questionnaires prior
to and immediately
following the
program, and 10
(53%) completed
the one-year
follow-up
assessment.

A group psychoeducational
program for spouses was
developed following
collaboration between mental
health professionals and
spouses. It comprised ten
two-hour sessions conducted
over consecutive weeks. A
mental health professional
and a trained family member
facilitated each session.
Sessions involved a 30-
minute oral presentation, a
90-minute discussion of
coping skills, role-play
exercises, written material
and homework tasks.

The program was
effective in improving
participants knowledge
and coping skills, while
reducing levels of
distress and negative
attitudes to the ill
spouse.
Levels of personal
distress were
significantly associated
with attitudes to the ill
spouse.
Improved knowledge
and coping skills were
not associated with
changes in distress and
attitudes.

57
Investigators Audience Study Design Country Method Program Content Key Findings
Raskin,
Mghir, Peszke
and York
(1998)
Carers and
families
Pre-test/post-
test study with
no concurrent
controls
United
States
Education program
targeted to
caregivers of
elderly people with
mental illness
living in
community
residences.
Information about
the elderly residents
involved in the
study was collected
prior to and
following the
program.
Participants were
surveyed following
the program in
order to determine
its usefulness.

The education program
comprised two two-hour
presentations conducted over
two weeks. Presenters
included mental health and
allied health professionals.
Information was provided
about causes, symptoms and
treatment of major mental
illnesses, and the provision
of support and care for the
elderly residents. An
information manual was
provided, giving an overview
of symptoms and treatment
of mental illness, focusing on
issues relating to the elderly.
The majority participants
indicated that they found
the program helpful
There was a significant
decrease in the number
of hospital admissions
for the elderly residents
in the twelve months
following the program

58
Investigators Audience Study Design Country Method Program Content Key Findings
MindMatters
Evaluation
Consortium
(2000)

Wyn, Cahill,
Holdsworth,
Rowling and
Carson (2000)
Adolescents Pre-test/post-
test study with
no concurrent
controls
Australia Pilot mental health
promotion program
undertaken in 24
secondary schools
nationwide. Project
involved
curriculum
resources and
whole-school
approach to mental
health promotion.
Students were
given Knowledge
and Attitude
questionnaire on
three occasions
throughout the
program.

Prior to the program,
professional development
activities introduced the
concepts of Health
Promoting Schools and
MindMatters. Schools
established a core team to
plan and implement the
project. Each school
conducted an audit of current
mental health curriculum and
activities, and utilised
MindMatters resources to
develop appropriate
strategies. Each school
adopted at least one of the
curriculum units: enhancing
resilience, understanding
mental illness, bullying and
harassment, and loss and
grief. Whole-school
strategies were also
undertaken, e.g. youth
forums, and mental health
days. Schools were
encouraged to form
partnerships with community
organizations to enhance the
whole-school approach.

There was a wide uptake
of the curriculum
resources within the
schools, and less activity
in relation to other
aspects of the project
There were some
negative changes in
knowledge about mental
illness following the
program, along with
some positive changes in
social distance attitudes
and help-seeking
intentions

59
Investigators Audience Study Design Country Method Program Content Key Findings
Wearing and
Edwards
(1994)
Adolescents Pre-test/post-
test study with
no concurrent
controls

Australia The School
Education Program
was delivered to
students in Sydney,
then in other states
in Australia in
1994. A total of 162
students were
surveyed prior to
the program, and a
further 25 were
surveyed following
the program in
1994.

The educational component
was presented to school
students by volunteers with
experience of mental illness.
Topics covered in the
presentations included:
definitions of mental illness,
facts and statistics,
community attitudes,
personal experiences of
mental illness, and a
discussion of mental health
resources available to
students. Curriculum
materials were developed
and these included fact
sheets, information packs for
teachers, a video, and
orientation kits for volunteer
presenters. Presenters were
trained in order to enhance
skills in presentation
techniques, as well as
knowledge of mental illness.
The program was revised and
improved between 1992 and
1994, and a program for
students from Non-English
Speaking Backgrounds
(NESB) was developed.

There were some
improvements in
awareness of mental
illness following the
education program
Prior contact with mental
illness was associated
with improved attitudes
following the program

60
Investigators Audience Study Design Country Method Program Content Key Findings
Rahman,
Mubbashar
and Goldberg
(1998)
Adolescents Pre-test/post-
test study with
non-
randomisation
of concurrent
controls
Pakistan Mental health
education program
undertaken at two
schools in a rural
area, with two
similar schools
acting as controls.
Participants were
100 students, their
parents, friends and
neighbours, who
were given a
questionnaire prior
to and following the
program.

The educational program
was facilitated in each school
by a mental health team.
Teachers attended training
courses about mental health
disorders, and collaborated
with the mental health team
in developing the educational
program for the school.
Educational activities
included essay writing and
poster competitions and the
production of short plays.
Teachers provided daily
lectures about mental health
issues to the students. Mental
health posters were displayed
in schools. The mental health
teams made weekly visits to
the schools.

Participants who
received the education
program showed
improved awareness of
mental health issues
following the program,
and this change was
greater than that of
control participants
Parents, friends and
neighbours of
participants in the
program also showed
improved awareness of
mental health issues

61
Investigators Audience Study Design Country Method Program Content Key Findings
Esters,
Cooker and
Ittenbach
(1998)
Adolescents Pre-test/post-
test study with
non-
randomisation
of concurrent
controls
United
States
A mental health
education program
was presented to 20
students at a rural
high school. A
second group of 20
students acted as a
control. Participants
completed
questionnaires to
measure attitudes
and knowledge at
baseline,
immediately
following the
intervention, and
again after three
months.

The education program was
presented to the intervention
group over three days. The
program involved an
educational video targeted to
adolescents. Information was
also provided about sources
of help in the community,
including the definitions and
qualifications of different
mental health workers, and
there was discussion of the
stigma associated with
mental illness.
There was a significant
improvement in attitudes
and conceptions of
mental illness in the
intervention group
following the education
program, which was
maintained after three
months
The control group did
not show any significant
change in knowledge
and attitudes

62
Investigators Audience Study Design Country Method Program Content Key Findings
Battaglia,
Coverdale and
Bushong
(1990)
Adolescents Post-test only
study with
non-
randomisation
of concurrent
controls
United
States
Mental Illness
Awareness Week
presentations were
given by mental
health professionals
to 1,380 high
school students. A
comparison group
of 280 students did
not attend the
presentations.
Participants
completed
questionnaires
about attitudes
following the
presentations.

Mental health information
sessions were presented to
students at a number of
public schools to coincide
with Mental Health
Awareness Week. The 45-
minute presentations were
given by psychiatric
physicians, and covered
topics including psychiatry,
depression, suicide, and drug
and alcohol issues.
Presenters attended training
sessions in preparation.
Schools were also provided
with manuals detailing
available youth services.

Participants in the
intervention group
reported more positive
attitudes to mental health
professionals and to
help-seeking than those
in the comparison group

63
Investigators Audience Study Design Country Method Program Content Key Findings
Bhugra,
Baldwin and
Desai (1997)
Non-English
Speaking
Backgrounds
Pre-test/post-
test study with
no concurrent
controls
United
Kingdom
A pilot study was
conducted targeted
to people from non-
English speaking
backgrounds
involving
educational fact
sheets about
depression.
Participants in the
study were 22
individuals from
the Indian
subcontinent.
Participants were
surveyed about
knowledge of
depression
immediately prior
to and following
presentation of
written information
about depression,
and again
immediately
following a group
discussion.

Educational fact sheets about
depression were produced in
several different languages
as part of the Defeat
Depression campaign
conducted from 1991-1996.
Participants in this study
were presented with the fact
sheets in their preferred
languages, and a follow-up
discussion about depression
was conducted involving the
researchers and study
participants.
Participants knowledge
of depression prior to the
study differed from
those of the overall
population
There were positive
changes in knowledge of
depression immediately
following presentation of
written information.
Improvements in
knowledge were
consolidated by a group
discussion about
depression



64
4. Health communication campaigns

In contrast to the relatively limited amount of literature addressing mental health
literacy programs, there is a vast literature relating to public health information
campaigns. Much theoretical literature is devoted to the topic of effectiveness of
health communication strategies. This section summarises what has been learned from
the research literatures on communication campaigns that may inform mental health
literacy programs.

Generalisations and guidelines from the communication campaign literature are
examined. Critical comments about current communication campaign practice, and
the dominant underlying theoretical model, are then offered. Fundamental differences
between advertising and health communication campaigns are then discussed to place
the previous discussion in context and to provide advice for communication planners.
Drawing primarily on risk theory, and the environmental research literature, a
differing paradigm for conceptualising communication campaigns and risk is
discussed that could be used to complement traditional practices and evaluation
research. In many cases, it is a model that describes current practice where mass
media campaigns are combined with direct interventions at local or community levels.

An overview of selected systematic reviews of communication campaigns that may be
relevant to mental health literacy are examined in Appendix 1 of this report. While it
is beyond the scope of this review to provide an in-depth analysis of all the literature
in this area, it is desirable to provide an overview of some of the key studies and
theoretical literature relating to effective public health information approaches.
Overview of the Communication Campaign Literature
Communication campaigns involving diverse topics and target audiences have been
conducted for decades. Hyman and Sheatsleys (1947) synthesis, Some reasons why
information campaigns fail is an early landmark in the literature. It is important to
investigate how the history of campaign experience and evaluation research may
inform mental health literacy programs.

The seminal synthesis of campaign research by Rogers and Storey (1987) is a useful
departure point. (See also Pettegrew and Logan 1987). Rogers and Storey (1987) note
that there is evidence that communication campaigns can be effective under certain
conditions for specific audiences, but that years of campaign experience suggest many
failures and unrealistic expectations about possible outcomes. The review of the
literature relating to mental health literacy programs clearly demonstrates this point.

Rogers and Storey (1987) observe that in the modern communication campaign,
modest changes in audience behaviour are frequently achievable, and it is important
for the campaign planner to set modest and realistic expectations about what can be
achieved. They argue that a health promotion campaign might be considered
successful or effective if about five percent of the target (or segmented) audience does
adopt measurable changes in health behaviour over the longer-term.


65
In this context, it is important to define a communication campaign. It should be noted
that the word communication is used to highlight the fact that not all campaigns
necessarily involve mass media messages, or mass media messages in isolation, and
that communication campaigns may be small-scale in scope and audience reach.

There is often confusion between the labels campaign, communication campaign or
program, media or mass media campaign, and intervention. No particular definition
adequately covers current practice, and there are many local variations of what is
meant by these labels. Indeed, a variety of definitions exists in the literature but the
following elements of a communication campaign are essential (Rogers and Storey
1987).

Firstly, a campaign is purposive. The specific outcomes can be extremely diverse
ranging from individual level cognitive effects to societal or structural change.
1

Secondly, a communication campaign is aimed at a large audience. Rogers and Storey
(1987) note that large is used to distinguish campaigns from interpersonal
persuasive communications by one individual (or a few people) aiming to seek to
influence only a few others.

Thirdly, communication campaigns have a specified time limit. This is not to state
that all campaigns are short lived. For example, the initial Stanford Heart Disease
Prevention Program ran for three years from 1972 to 1975, however follow-up
investigations were conducted over decades (Pettegrew and Logan 1987).

The fourth point is that a communication campaign comprises a designed set of
organised activities. This is most evident in message design and distribution.
Messages are organised in terms of both form and content, and responsibility is taken
for selecting appropriate communication channels and media. As Rogers and Storey
(1987) point out, even those campaigns whose nature or goal is emancipation or
participation involve organised message production and distribution.

In summary, the term communication campaign implies that:
it is planned to generate specific outcomes;
in a relatively large number of individuals;
within a specified time period; and
uses an organised set of communication activities.

It is this latter element an organised set of communication activities that is the
focus of this section.
Rogers and Storeys Campaign Generalisations
In their extensive literature review, Rogers and Storey (1987) trace the history of
communication campaigns, and offer a set of generalisations based on campaign
research and evaluation. Many of the findings of the present literature review can be
directly related to these generalisations.

An important component of the generalisations comes from analysis of multi-faceted
cardiovascular risk reduction campaigns that have involved extensive tests of the

1
See also Bauman (2000).

66
impact of mass media messages on health behaviours. For example, four American
states, as well as Finland, Australia, Switzerland, South Africa and Germany
(Farquhar 1983) have conducted well-evaluated heart disease prevention campaigns.
The Stanford Heart Disease Prevention program is perhaps the best known. From
1972 to 1975, three communities in California participated in the campaign. Results
showed that in the media only community and the media plus intensive face-to-face
intervention community there were significant reductions in multi-faceted
cardiovascular risk factors, such as weight reduction, cessation of cigarette smoking,
and lowering of cholesterol levels and blood pressure, compared with the no
treatment community.

Stanford Universitys Five Cities Project (Farquhar, Maccoby and Solomon 1984)
built on this previous experience and used larger communities, as well as broader
target audiences. Participants in the project were monitored over eight years, with the
aim of developing an exemplar for other communities. The Minnesota Heart Health
Project (Pavlik et al 1985) showed that campaigns promoting increased physical
activity might be more salient than anti-smoking or other behaviour-cessation
campaigns (Pettegrew and Logan 1985). Pavlik et al (1985) also showed that,
sometimes, relatively inexpensive media, such as pamphlets, brochures and
specialised publications, can be very effective in increasing knowledge about heart
disease prevention.

Pettegrew and Logan (1987) conclude that, in contrast to anti-smoking and alcohol
and other drug campaigns, the cardiovascular risk reduction campaign evaluations
suggest that the mass media can be unilaterally effective in influencing awareness,
attitudes and behavioural changes.

Analyses conducted by Rice and Atkin (1989) and by Pettegrew and Logan (1987)
support the following generalisations by Rogers and Storey (1987). In a very real
sense, these generalisations should be considered as guidelines for communication
campaign planners.

1. Widespread exposure to campaign messages is a necessary ingredient in a
campaigns success.

2. The mass media can play an important role in creating awareness and
knowledge, in stimulating interpersonal communication, and in recruiting
individuals to participate in campaign activities.

3. Interpersonal communication through peer networks is very important in
leading to and maintaining behaviour change.

4. The perceived credibility of a communication source or channel enhances the
effectiveness of a communication campaign.

5. Formative evaluation is as important as summative evaluation following the
conclusion of the campaign.

Formative research involves evaluating aspects of the campaign,
especially message design and audiences understandings, in the

67
planning stages. This work can improve the effectiveness of campaigns
by producing messages that are specific to the desired behavioural
change. The development of the American educational television
series, Sesame Street, is a classic example in the research literature
(Lesser 1974).

6. Campaign appeals that are socially distant from audiences are not effective.

7. Campaigns promoting prevention are less likely to be successful than those
with immediate positive consequences.

8. Audience segmentation strategies can improve campaign effectiveness by
targeting specific messages to particular audiences.

9. Timeliness and accessibility of media and interpersonal messages can
contribute to a campaigns success.
Baumans Precepts and Principles
Similarly, Bauman (2000) offers a set of guidelines, which he characterises as
precepts and principles for campaign planners. These are focused on best practice and
grounded in both campaign experience and evaluations of mass media health
campaigns. His position provides support for Rogers and Storeys (1987) meta-
analysis of the research literature.

Firstly, Bauman distinguishes media campaigns from ad hoc health advocacy that
may involve the mass media. Media campaigns, he says, are purposive and organised
interventions. His guidelines, or precepts and principles, include the following points:

1. Message development should be an integral component of the campaign. As
Rogers and Story (1987) note, formative research is as important, if not more
important, than summative evaluations after a campaign.

2. Process monitoring (process evaluation) is essential. This involves detailed
assessment of each part of the campaigns implementation, providing essential
data on message production and dissemination, and audiences responses.

3. Development of appropriate outcomes is essential. As Bauman (2000) says:
Campaign planners should be clearly focused on the exact outcomes that are
feasible, achievable and measurable.

4. Measurement of carefully defined outcomes is essential (i.e. summative
evaluation).

5. Research designs should include adequate resources and methods to achieve
useful campaign evaluation. As the earlier literature review of mental health
literacy programs demonstrated, valid and useful evaluations are not always
conducted.

6. Bauman argues that, at a minimum, the evaluation budget (formative and
summative) should be more than 15 per cent of the total budget.

68

7. The hierarchy of effects matrix developed by McGuire (1989) is a useful
guide to planning media roles in a campaign.

Briefly, McGuire proposed that only about 50 per cent of an audience
will recall the media message, about half of those will understand the
message, half again will accept it as relevant, half again will shift
attitudes, half of those will adopt the new behaviour, half will trial it,
and half again will maintain the new behaviour. Thus, the role of the
mass media is more likely to be effective in increasing salience of a
campaign message rather than achieving behavioural changes.

As Rogers and Story (1987) note, long-term behavioural change
induced by mass media messages alone is unlikely to be successful.

8. Mass media messages in isolation usually achieve little, therefore other
supportive interventions are essential. These may involve direct, personal
interventions.

Rogers and Storey (1987) make similar observations in their review of
the research literature. Effective mass media campaigns need to be
supported by other direct interventions.
1


9. Over-time monitoring of linked or similar campaigns is important in assessing
the longer-term effectiveness of campaigns. It is important to determine
whether repeated campaigns are achieving net gains, maintaining the status
quo, having no effect, or in fact having a negative effect.

10. Clear frameworks for evaluation should be set by both state and federal
governments to remove or, at least, to reduce any day-to-day politics from
evaluation and policy-making.

11. Dissemination of campaign evaluation results is vital to enable others to learn
from previous campaign successes and failures.
Bauman also briefly discusses the use of so-called social marketing techniques where
a specific campaign attempts to apply a brand to a particular message. The QUIT,
Active Australia and Eatwell Australia campaigns are examples of this strategy.
2

Kotler and Roberto (1989) in particular are strong advocates of the social marketing
approach. It is perhaps important to discuss in a wider context the significant
differences between advertising and health communication campaigns. The following
discussion, designed to inform future mental health literacy campaigns, focuses on
planning realistic expectations rather than relying on the practices and theories about
commercial advertising.

1
A simple illustration of this approach comes from the staff-dining hall at Stanford University, home
of the Stanford Heart Disease Prevention Program, where, many years ago, the menu included data on
fat and cholesterol levels for all food items. This practice is now commonplace for food items in
supermarkets.
2
For a discussion of social marketing, see also Nutbeam and Harris 1998, and Kotler and Roberto
1989.

69
Advertising and Communication Campaigns
Elliott (1987), one of Australias leading communication practitioners, offers a
particularly informative look at the differences between advertising and
communication campaigns. His literature review and analyses of campaigns are
especially relevant because they are based largely on experience. He defines a set of
parameters for considering and planning for a campaigns realistic outcomes.

Elliotts (1987) basic premise is that the objectives and processes that are appropriate
for commercial advertising are usually inappropriate for health promotion. The paper
in effect reconsiders Rothschilds (1979) analysis. The essential differences between
advertising and health campaigns lie in the nature of the product, the processes
involved in promotion and, of course, in the nature of audiences. Elliot argues that
advertising by itself will not result in fundamental changes in behaviour. He quotes
Palyer and Leathar (1981):

Commercial products are regarded by many as trivial and superficial, not as
central and ego-involving to the individual as ill health. They are positive and
attractive and can be relatively easily obtained. By contrast, health publicity is
largely negative: it preaches the avoidance of something negative (which is
enjoyable), often involving short-term unpleasantness, for the sake of benefits
that are long-term, probabilistic and not guaranteed.

Elliott (1987) draws on previous research to demonstrate once again that advertising
does not have massive effects on potential consumers, as many might believe.
However, he notes that small changes in market share for a particular product that are
achieved as a consequence of advertising may result in greatly increased sales and
profits. In this regard, it is useful to recall Rogers and Storeys (1987) assertion that a
health promotion campaign might be considered successful if five percent of the
target audience make longterm changes in overt health behaviour

Commercial advertising techniques are but one element of a communication
campaign using mass media. The following table, comparing communication
campaigns and advertising, has been constructed from Elliotts (1987) literature
review and critical analyses.
Table 3 - Comparison of communication and advertising
campaigns

Typical Communication Campaign Typical Advertising Campaign
Persuasive focus involving response
shaping, reinforcement attitude change;
behavioural change.

Focus on feelings and perceptions toward
product. Not attitude change.

Difficult to specify individual desires and
wants.

Based on the idea of satisfying desires
and wants.
Designed to meet societal or individual
needs in face of risk.

May be designed to create desire and
need.


70
Typical Communication Campaign Typical Advertising Campaign
May not be in line with prevailing
attitudes and opinions.

Plays on prevailing attitudes and
opinions.
Usually against the tide of public opinion.

Tries to stay with the tide of public
opinion.

Not usually seen as a personal benefit as
such and may be designed to create a
social benefit.

Usually, if not exclusively, a personal
benefit.

Involves personal cost, sometimes even
discomfort.

Cost is one of choice among competing
brands.

Message is that all people should adopt or
comply.

Products/services that are not accepted
fail.

Often difficult to see short-term
outcomes.
Easy to see, and outcomes can usually be
quantified.

Reward difficult to see. Reward easy to see.

People may express support for socially
desirable behaviour but not adopt the
behaviour.


Experience is the best way to change
attitudes not mass media.


Tries to define communication objectives
as changes in individuals:
Increased salience;
Strengthening or attitude change;
More positive disposition to
behave in a desired direction;
Adoption of behaviour either in
the short or long term;
Awareness of unintended
consequences.

Market objectives often confused with
communication objectives.

Focus on behavioural outcomes with
intermediary objectives such as
reinforcing loyal buyers beliefs, creating
consumer satisfaction, maintaining brand
salience.

May be very sensitive, obtrusive, and
emotional.
May not involve great emotional or
affective attachment.

Many times involves an organisational
bias in the public service/interest.
Educational campaigns favoured even
when evidence shows previous similar
campaigns failed.

Campaigns that fail or result in loss lead
to immediate action.


71
Typical Communication Campaign Typical Advertising Campaign
Sometimes, objectives confused with
education or mere dissemination of
information.


Organisation may constrain budget,
processes and structure of the campaign.

All about excitement, sexuality, self-
indulgence, and even power.

Government equated to what ought to be
done, what should be done, etc. It is the
parental mode.

Talks to the child in us.

Information often perceived to be
unreliable because:
Most groups perceive others as the
problem or cause.
Many see themselves compliant
with the attitudes or behaviour,
when they are not
People seek justification for non-
compliance and may give
misleading information in any
evaluation.

Easy to get information about products
and services. Yet, advertising does not
work in the way that most people believe.
Advertising does not have massive
effects on people.
Some people have pre-existing beliefs or
ideas about communication. Unrealistic
expectations about what can be achieved.

Can be targeted to specific audiences or
segments and expectations adjusted.
Often difficult to identify target audience.
Audience could be everyone.
Expectations should be low.


Secondary audiences may be critical in
facilitating change.

Secondary audiences rarely critical in
mass advertising.
Usually a major objective related to a
social concern.

Usually aiming at slight modifications.
Tends to be strategy based on
modifications/change or slow down of
undesirable attitudes/behaviours.

Tends to be strategy based on start or
stop.
Slow processes involved over time. May see instant results.

Televisions commercial values may be
inappropriate to the campaigns message.

Commercial television is commercial
television advertising; the program is
designed to deliver an audience to an
advertiser.


72
Analysis of the Communication Campaign Literature
Much of the literature outlined in the previous discussion, especially by Rogers and
Storey (1987) and Pettegrew and Logan (1987), can be classified as media effects
research. This approach examines the possible effect of communication content on
audiences, or segments of audiences, in terms of changes in knowledge, attitudes or
behaviour. In the case of communication campaigns, the campaign message, which is
disseminated by various media, is typically viewed as the independent or exposure
variable. The effect is the dependent or outcome variable. Thus, researchers have
attempted to link exposure to the campaign information to changes in audience
knowledge, attitudes or behaviours.

The effects tradition has been debated in media theory
1
and is often criticised for its
positivist-like approach and lack of contextualised data (McQuail 1987). Individualist
psychological models underpin the theoretical framework (McGuire 1989). The
campaign message is the stimulus, with the receivers conceptualised as an audience
and, mostly, as a passive audience. This approach does not recognise contemporary
audience analyses or reception theory (Alasuutari 1999; McQuail 1997; Tulloch and
Lupton 1997).

Most early communication campaigns adhere to a narrow conceptualisation of the
communication process. This process may be defined as information transfer and the
mass media and interpersonal networks are seen largely as conduits. The dominant
metaphor is one of communication as the transmission of information (Penman 2000).
In many respects, the use of the term target audience implicitly supports this linear,
knowledge-to-attitude-to-behaviour effects model of communication. Messages are
designed to be shot at a target audience or, as communication scholars have
observed, notions of a bullet theory or hypodermic needle theory underpin the
effects tradition.

In Simkins and Brenners (1984) review of communication campaigns of the 1970s
and 1980s, they note an overemphasis in communication planning on social learning
theory and a preoccupation with the mass media. Most campaign evaluation research,
they note, stems from a linear model of mass communication effects. Such a model is
useful in describing the conditions with which communication-for-change programs
must contend in the planning and design stage for persuasion campaigns (Simpkins
and Brenner 1984). The model, however, does not explain why outcomes occur as a
result of the communication programs.

Atkin (1981) also argued that research into the use of mass media to improve public
knowledge about health was one-dimensional because it focused on what was the
most effective media channel radio, newspapers or television to create persuasive
communications. Few studies examined how various publics acquired health
knowledge or how they were motivated to attend to public health campaigns.

Pettegrew and Logan (1987) note that the degree to which health care values held by
health care providers, public and government coincided or conflicted was largely
ignored in the campaign research literature of the 1970s and 1980s. Graham (1981),
for example, explores the false conception about value in scientific or health

1
See, for example, Gitlin 1978.

73
knowledge. Conventional wisdom assumed that scientific knowledge was determined
within the scientific paradigm, which is free and immune from the impact of social or
cultural values. As a consequence, communication planners of that time might be
forgiven for seeing the mass media as a delivery system. The goal was to exploit
mass media campaigns to influence public education with only minimal loss of
scientific data. Or, to follow the communication as transmission metaphor, the goal
was to reduce unnecessary noise in the transmission of pure scientific and health
knowledge. The research and planning focused on the source, message, channel and
receiver, conceptualised as an engineering problem of process and feedback.
However, as Graham (1981) observed, scientific theories and health knowledge are
constantly influenced by public, social and cultural values.

From a policy perspective, the communication process continues to be approached
from what may be considered a flawed perspective. The transmission of information
metaphor is so dominant in popular thinking that it may direct government and its
agencies to invest unwisely in campaigns whose expectations are highly unrealistic.

Contemporary communication campaigns are far more likely to recognise the capacity
of audiences to make meaning out of campaign messages, to misinterpret messages,
or even to resist messages. Baumans (2000) concern with realistic expectations about
outcomes, formative evaluation, and long-term summative evaluations is an example
of this. The related issue of understanding audiences, and of segmenting audiences in
campaign planning, is also interwoven with understanding peoples grounded
knowledge and values.
Discourses
Several scholars have advocated a health communication research program grounded
in cultural theory, which could complement existing approaches (Tulloch 1992;
Tulloch and Lupton 1997). One way to advance such an approach is to focus research
attention on discourses. By extension, campaign planners might also incorporate
contemporary theoretical notions of risk.

The term discourse refers to mean a system of knowledge and practice representing
social and material phenomena that shape individuals perceptions of reality and of
the self (Tulloch and Lupton 1997). Media discourses, medical discourses, health
communication discourses and, most importantly, lay discourses about mental health,
are constantly in conflict over the production of meaning. Research into
contextualised knowledge is often lacking in evaluation studies about the complex
relationships between campaign messages and audiences understandings.

A culturalist approach offers a different way of conceptualising the communication
in communication campaigns, which moves away from reliance on the knowledge
attitudebehaviour model that underpins most effects studies and communication
campaigns of the past. To examine only the end effects of campaign messages ignores
the contest over the production of meaning, the unintended consequences of campaign
messages, subtextual discourses, and the likely unpredictable responses of various
audiences. Contemporary cultural theory acknowledges that the production and
reception of meanings are highly contextual, contingent in time and space, as well as
intertextual (Tulloch and Lupton 1997).


74
Discourse and frame analyses should explore meanings in communication campaign
messages, the mass media, and the daily lives of audiences. It is important to
investigate the factors that various audiences bring to their experience and reception
of communication campaign messages and to the mass media. Methods such as
participant observation, unobtrusive techniques, ethnography and ethnomethodology
may be appropriate for investigating the multiple meanings that audiences produce
from the campaigns and mass media about health messages as they go about their
daily lives (Tulloch and Lupton 1997).

Some elements of the research literature explore the use of mass media by health
professionals to influence audiences understandings and knowledge of health issues
(Atkin and Wallack 1990). The research focuses particularly on television
entertainment programs. Tulloch and Morans (1986) examination of the television
series A Country Practice is a useful example of this.

In the next section, the experiences drawn from risk communication campaigns are
discussed. The origins of such campaigns are primarily in environmental
communication. This discussion is especially important for campaign planners in
terms of focusing on audiences and the values they bring to any communicative
process, including a communication campaign. The model that emerges from this
research may be seen as a way of recognising changing practices in health
communication campaign planning.
The Concept of Risk
Most health communication campaigns involve risk, i.e. risks to people and societal
risks. The concept of risk has been at the focus of contemporary thinking in recent
years because of the salience and threat of environmental issues, which have received
extensive public and media attention.

Giddens (1996) observes that most traditional cultures did not have a concept of risk
and argues that it is a concept associated with modern industrialised civilisation,
embodying ideas about controlling or conquering the future.

Lupton (1999), Tulloch and Lupton (1997), and Lash, Szerszynski and Wynne (1996)
focus on risk as an individual concept. People are forced to negotiate their lives
around risks, and to rely increasingly on their own judgments about risks. Experts can
assess the likelihood and magnitude of a given risk, however the public understanding
of a given risk takes on meaning through our cultural practices. (See also Adams
1995).

One important cultural site for the production of meanings about risk is media
content, including communication campaigns. The meaning of a particular health risk
to various groups in society, for example, develops through the continuing and often
changing representations of that risk in media content, and in scientific and medical
discourses, as well as through other social and cultural practices. It is against this
background of changing technical, media and public discourses that communication
campaigns are planned.

Wynne (1996) argues that, just as expert opinion is central to ideas about risk, so too
is lay criticism and comment. He observes that, while risks may be debated within

75
scientific or public accountability discourses, they are dealt with by most people as
individuals in very specific situations, at the level of the local, the private, the
mundane, the everyday, and intimate experiences. Wynne argues that it is essential to
examine how perceptions of risks are constructed by local, or as he terms it situated,
knowledge, as well as by expert knowledge.

Tulloch and Lupton (1997) demonstrate, for example, that there are profound
differences across class, gender, race, ethnicity, age and other variables in the ways
people understand, interpret and respond to health risks. Individualism might suggest
a degree of choice in negotiating risk, but it is recognised that, within the power
structures of our society, some people have more authority over the ways risks are
identified, defined as public, and managed, than do other people.
1
Anecdotally, it has
been noted that a teenage boy will ask for the cigarette packet with the warning label
Smoking is dangerous to pregnant women because it doesnt apply to him.

This risk perspective offers invaluable insights for communication campaign planners.
This section of communication literature has one point of origin in the environmental
sciences, and is particularly important to review because of its parallels to more
general communication campaigns.
Risk Communication Campaigns
Risk communication campaigns of the 1980s offered the promise of resolving public
conflict and diminishing fear about new large-scale technologies, such as nuclear
power, as well as promoting safety campaigns concerned with science, technology
and health (Blood et al 2000; Covello et al. 1986; Rohrmann 1992). The concept of
communication being in the public interest was viewed as essential in fulfilling the
publics need for information and education, or for promoting behavioural change and
protective action, in the face of an anticipated disaster or hazard.

Brown and Campbell (1991) note that many western societies recognised the need for
public information about science and technological risks. They link heightened
interest in risk communication to the emergence of environmental impact legislation
and the requirement to inform the public.

The early risk communication campaign model involved expertsattempting to
persuade the public of the validity of their scientific and technical risk assessments of
a particular hazard. It is perhaps unsurprising that many such campaigns met with
limited success, as the reviews outlined above would predict. Rohrmann (1992)
observes that actual risk communication practices differed widely in terms of
substantive issues addressed, audiences, information, methods of communication, and
communication contexts.


1
Tulloch and Lupton (1997) cite a vivid example from their research on HIV/AIDS at the time of the
famous Grim Reaper campaign with its final message Always use condoms, always. A young pre-
teenage Aboriginal girl told them she had unprotected sex because condoms are chicken (cowardly).
The authors note that this young womans life involved daily personal risks. She was underprivileged,
involved in petty crime, was continually in and out of remand homes, stole cars, and had been chased
by the police. They conclude that using a condom might indeed seem chicken. Her group was one
among the many in contemporary society that takes pleasure in risk activities.

76
A fundamental change in campaign planning occurred in the late 1980s with the
recognition that public perceptions of various risks differed widely. This change is
viewed historically as a turning point for risk communication research (Hadden 1989;
Dake 1992). As Hadden (1989) observes, old risk communication models, such as
those involving scientific experts attempting to persuade lay people of the validity of
their risk assessments and decisions, are impeded by lay risk perceptions, by lay
peoples difficulties in understanding mathematical probabilities, and by technical and
scientific difficulty.

Leiss (1998) argues that the changed research direction is a shift in emphasis from
risk to communication in the concept of risk communication. In other words, it
involves re-framing the issue of risk communication as a problem in communication
theory and practice, rather than in the concept of risk.

Research conducted by Slovic (1987) and Fischhoff et al (1978) is illustrative of the
trend towards identifying generalisablerisk perception factors. Risks perceived as
familiar, controlled, voluntary, beneficial, and fair are more likely to be acceptable to
most people than risks perceived in opposite ways (Slovic et al 1981). For example,
the perceived health risks of chemical pollution from a local industrial factory are
different from the perceived risks from exceeding the speed limit on a country road:
the first is involuntary and unfamiliar, while the latter may be considered voluntary
and familiar.

Risk perception research adds to the body of knowledge in this area by accounting for
seemingly irrational responses by various publics to identified and potential hazards.
It should be noted that the same risk might in fact produce very different perceptions
in differing groups of people, depending upon the context in which the risk is
understood and interpreted. These varied perceptions may produce differing policy or
strategic decisions about risk management and responses by experts (Bradbury
1989). Rowan (1996) puts forward the following argument about generalised
perception factors:

[The factors] are expressions of various types of power: informational,
decisional and distributional. People who feel deprived of facts, unable to
control their own lives, and forced to bear the costs but not the benefits are
likely to be outraged by news of some new risk. To be effective risk
communication must involve power sharing. Therefore, risk communication
may not reduce conflict and smooth risk management. Empowerment can be
destabilising in the short term, but it leads to more broadly based policy
decisions, which can hold up over the long term.

As a consequence, contemporary risk communication campaigns attempt to be more
individually reflexive and, as Hadden (1989) and Fisher (1991) argue, the key to this
approach lies in establishing dialogue or conversations with the public.
1
The notion of
one-way, top-down, expert-to-public campaigns is replaced with a more interactive
process designed to empower various publics. Campaigns recognise that
understanding the complexities of health issues, including technical knowledge, are
not necessarily beyond ordinary people. They also highlight the potential importance

1
See also Leiss 1998 transmission model.

77
of the interplay between scientific forms of knowledge and those that may be
considered are more cultural. In other words, lay knowledge about health issues
cannot be ignored in communication campaigns.

Hadden (1989) notes that campaigns that emphasise dialogue among parties and
active participation in assessing and managing risk, are impeded by the lack of, or
difficulty in establishing, participatory institutions. Similarly, in a health context,
Needleman (1987) notes that the goal of empowering those at risk to make an
informed choice is laudable, however the risk communication intervention needs to be
more than merely the dissemination of information:

The intervention must, somewhere along the line, stimulate individual and/or
collective behavioural changes that reduce health risks. Otherwise, the risk
communication becomes a kind of ritualistic activity, an end in itself in which
the formal aspects of conveying risk information take precedence over their
actual health impact. [Emphasis added].

The emergence of a participatory or dialogue model, which attempts to explore the
disparity between expert information and a diverse public knowledge, has challenged
both the scientific approach to the problem of risk communication, and indeed the
later perception research.
1


Brown and Campbell (1991) have placed risk communication models within a two by
two matrix that categorises the underlying approach in terms of low and high power
devolvement, and low and high community interaction. Older models of risk
communication are low in terms of both power sharing and community interaction, in
contrast to newer dialogue models that are high in power sharing and high in
community interaction (see Table 4).


1
The need for this new approach is succinctly made in an editorial in the American J ournal of Public
Health. Marmot (1996) comments on the public response in Britain to Creutzfeldt-J akob diseased beef,
where little reliable data were available, compared with replicable studies linking moderate alcohol
consumption to breast cancer:

Alcohol and beef are consumed by approximately the same proportion of the British
population. Beef is as much part of the culture and economy as alcohol. Is it dread in the face
of an unknown and currently unknowable magnitude of risk that has led to the greater reaction
to beef? . Scientific evidence relating exposure to harm may be necessary but is far from
sufficient for actions affecting the public health.

It is not appropriate to dismiss this disjunction simply as politics. It is indeed politics, but the
lesson extends further. In the latest turn of events, and not for the first time, the public was
ahead of the politicians and distrustful of them. The real lesson is that we need a better
understanding of the management and communication of risk.

78
Table 4 - Risk Communication Conversation Models

COMMUNITY INTERACTION
Low High
Information Consultation
Leaflets Public Meetings
Displays Planning
Low
CSAs Inquiries

Canvassing Conversation
Surveys Searching
Focus groups Planning Cells
POWER
SHARING
High
Interviews

CSAs =Community or Public Service announcements, usually on television.
Table from: Brown, J . and Campbell, E. (1991).

The key message from Brown and Campbells (1991) table to communication
planners is to take full account of the day-to-day experiences, perceptions and cultural
values of various audiences in the formative stages of any campaign. Formative
research should go beyond simple quantitative measures to include more reflexive,
cultural understandings of campaign messages and audiences. Of equal importance is
the need to understand what various audiences bring to the reception process in their
use of mass media, and their use of mass media in terms of understanding health
issues.

British researcher J enny Kitzinger, who has completed many studies on health issues,
says (1994):

We are none of us self-contained, isolated, static entities; we are part of
complex and overlapping, social, familial and collegiate networks. Our
personal behaviour is not cut off from public discourses and our actions do not
happen in a cultural vacuum. We make sense of things through talking with
and observing other people, through conversations at home or at work; and we
act (or fail to act) on that knowledge in a social context. When researchers
want to explore peoples understandings, or to influence them, it makes sense
to employ methods, which actively encourage the examination of these social
processes in action.

The notion of an active dialogue model may appear idealistic or impractical, however
it should be contrasted with the failures of the dominant top-down campaign
strategies, which comprised the older risk communication approach. An active
dialogue model examining expert and lay knowledge should not be viewed as
ignoring technical health knowledge. The approach explicitly acknowledges the

79
legitimacy of all sources of knowledge central to risk dialogue, including technical
knowledge (Handmer 1995). It acknowledges the importance of investigating the
interplay between various discourses, including scientific, medical, health, media, and
lay discourses, in planning any communication campaign.
Summary
There is evidence that communication campaigns can be effective under certain
conditions for particular audiences. It should, however, be recognised that experiences
drawn from diverse communication campaigns suggest many failures and unrealistic
expectations about possible outcomes. In terms of modern communication campaigns,
fairly small changes in audience behaviour are frequently achievable, and an
important key for the campaign planner is to set modest and realistic expectations
about what can be achieved.

It should be noted that not all communication campaigns necessarily involve mass
media messages, or mass media messages in isolation, and that communication
campaigns may be small in terms of scale and audience reach. The role of mass media
campaigns in particular is more likely to be in creating awareness and knowledge of a
campaign message rather than achieving behavioural changes. Bauman (2000) argues
that mass media messages alone usually achieve little, and therefore other supportive
interventions are necessary.

In order for a communication campaign to be successful, a number of components are
considered essential. Message development is an integral component of the campaign,
and there should be widespread exposure to campaign messages. Campaign appeals
that are socially distant from audiences are generally ineffective, and messages
promoting prevention are less likely to be successful than those with immediate
positive consequences. Measurement of carefully defined outcomes is important, and
research designs should include adequate resources and methods to achieve useful
campaign evaluation. In addition, monitoring of linked or similar campaigns over
time is important in assessing the longer-term effectiveness of campaigns.
Dissemination of campaign evaluation results is particularly important to enable
others to learn from previous campaign successes and failures.

Much of the literature included in this section can be classified as media effects
research, which tends to focus on the possible effect of communication content on
audiences in terms of changes in knowledge, attitudes or behaviour. The effects
tradition has been debated in media theory, and evaluations of early communication
campaigns have been criticised for an overemphasis on social learning theory, which
stems from a linear model of mass communication effects and does not explain why
outcomes occur as a result of the communication programs. In contrast, contemporary
communication campaigns need to recognise that audiences have the ability to make
meaning out of campaign messages, and even to misinterpret resist messages.
Baumans (2000) recommendations for campaign planners place an emphasis on
determining realistic outcomes, and conducting both formative evaluation and long-
term summative evaluations.
A newer approach to communication campaigns offers a culturalist perspective.
This model moves away from reliance on the knowledgeattitudebehaviour
paradigm that underpins most of the earlier effects studies and communication

80
campaigns. It acknowledges the importance of investigating the factors that various
audiences bring to their understanding and reception of communication campaign
messages. The model that has emerged from the experience of risk communication
campaigns in particular acknowledges the importance of investigating the interplay
between various discourses, including scientific, medical, health, media, and lay
discourses, in planning any communication campaign.

81
5. Conclusions
Research question
What are the most effective communication strategies and tools to improve mental
health literacy among target audiences in the Australian population?

Two main categories of mental health literacy programs were identified in this
review: whole of community programs, and those targeting specific sub-groups within
the population. With respect to programs designed to reach the general public, there is
evidence that mass media campaigns can achieve positive outcomes in terms of
mental health literacy, particularly when combined with community activities.
Previous reviews of the literature have also found that mass media programs can alter
knowledge of and attitudes to issues of mental health and illness, however it is
recognised that the impact of media programs is limited (see Appendix 1).

It is important to note that most of the evidence of effectiveness of mass media
approaches comes from campaigns conducted overseas, with relatively few
evaluations in the Australian context. Earlier reviews of the literature have pointed out
that, where the majority of previous research has been conducted in other countries,
this may not be a sound basis from which to draw conclusions for different settings
(Tilford, Delaney et al. 1995). In view of this, recommendations should be considered
as a starting point from which to develop and modify campaigns. It is clearly
important that programs conducted in Australia be evaluated to determine the
characteristics of successful programs in the local setting.

Support for the effectiveness of mass media campaigns can be found in the general
health communication literature. Reviews of the evidence relating to communication
campaigns have concluded that widespread exposure to campaign messages is
necessary for the success of a campaign, and that the mass media in particular play a
key role in creating awareness and knowledge, in stimulating interpersonal
communication, and in encouraging individuals to participate in campaign activities.
Bauman (2000) and Rogers and Storey (1987) found that media messages alone
usually achieve little, and that other supportive direct interventions are necessary.

Research focusing on mental health literacy also indicates that campaigns are
particularly effective when they involve more than one form of media, and include
community-based components and/or direct interventions (Fonnebo and Sogaard
1995; Sogaard and Fonnebo 1995; Paykel et al. 1997; 1998). Previous reviews of the
literature in this area have similarly concluded that mass media campaigns
supplemented by smaller-scale community activities represent the most effective
approach to improving mental health literacy among the general public.

Mass media campaigns outlined in the current review differed in their ability to reach
the population. Those involving television broadcasts supplemented by other media
activities tended to have greater audience penetration. The Norwegian Mental Health
Campaign, which comprised a television program and other media and community
activities, reportedly reached 94% of the study population (Fonnebo and Sogaard
1995; Sogaard and Fonnebo 1995). In contrast, the educational television series You

82
in Mind received an audience equivalent to 13% of the adult population in the UK
(Barker et al 1993).

Although there is evidence that mass media programs can be effective in modifying
knowledge and attitudes, it is important to note that the impact of such campaigns is
limited. Much of the attitudinal change identified in studies of mass media campaigns
was relatively small in magnitude, and in the larger-scale interventions it was unclear
whether positive findings could be attributed solely to the impact of the campaign, or
whether other factors may have contributed. This aspect of mass media campaigns is
recognised in the health communication literature, particularly in the area of
behaviour change. It has been found that communications campaigns can be effective
under particular conditions for specific audiences, and that while relatively modest
changes in audience behaviour are often achievable, it is important to set modest and
realistic expectations about what can be achieved.

In addition, it is recognised that mass media campaigns are expensive, particularly
those involving television broadcasts, and it may be that other approaches are more
cost-effective. Mental health literacy programs that target the general public but do
not involve mass media approaches appear to be less common, but show some
evidence of effectiveness in terms of attitude change. Importantly, studies of such
programs have found that direct contact with individuals with mental illness is
associated with the development of more positive attitudes. Previous reviews of the
literature have also indicated that smaller scale approaches such as educational texts
and seminars may be more cost-effective for certain audiences.

It is recognized that a number of sub-groups within the population may be appropriate
for targeted mental health literacy programs. Earlier reviews of the literature have
recommended that the development phase of a program should involve consideration
of the audience and the overall goals, as these will help to determine the message and
the medium chosen for the campaign, and ensure that resources are used most
effectively.

With respect to programs targeting specific audiences, there is evidence from the
literature that school-based programs can improve mental health literacy among
adolescents. School-based programs included in this review differed in terms of
content and mode of delivery. For example, the School Education Program (SEP)
involved trained presenters visiting schools to provide information to students, while
the MindMatters program provided resources and training to teachers to enable the
program to be incorporated into the overall school curriculum (Evans Research 1999;
MindMatters Evaluation Consortium 2000; Wyn et al. 2000).

It should be noted that important methodological issues emerged in a number of
studies focusing on school-based mental health literacy programs, particularly those
conducted in Australia, which prevent firm conclusions being drawn. It is
disappointing that the evaluations of both MindMatters and the School Education
Program (SEP), which were conducted in Australian schools, were unable to provide
adequate data about impact on mental health literacy (Evans Research 1999;
MindMatters Evaluation Consortium 2000; Wyn et al. 2000). It is important that
future evaluations of school-based mental health literacy programs in Australia focus

83
on assessing the impact of programs on knowledge, attitudes and behaviour, in order
to provide a sound evidence base.

When considering the mode of delivery of school-based programs, it is important to
note that, in their review of the effectiveness of school-based health promotion,
Fletcher, Stewart-Brown and Barlow (1997) concluded that traditional educational
health programs are effective in improving knowledge of health issues but do not
produce lasting behavioural changes. They suggest that more innovative programs can
bring about significant changes in health behaviour, and propose that a promising
strategy for school-based health promotion campaigns is a more holistic approach
with a core mental health or emotional well-being program delivered throughout the
school years.

Some of the strongest evidence of effectiveness of mental health literacy programs
comes from studies of educational interventions for carers and family members of
people with mental illness. In particular, programs for family members of individuals
with schizophrenia have been evaluated in a range of studies and found positive
results in terms of improvements in knowledge and attitudes. In addition, a number of
studies found that programs resulted in improvements for mental health consumers,
although it was generally unclear whether the educational component of the
interventions was responsible for this outcome, or whether social aspects of the
intervention may have contributed. It may therefore be concluded that, while many of
the educational programs resulted in improved knowledge of mental illness, it was not
found that changes in knowledge had any significant impact on other variables.

When considering the evidence of effectiveness of health communication programs, it
is clearly important to bear in mind the theoretical basis for communication strategies.
It is apparent from the literature, however, that theoretical issues are not adequately
addressed in studies of mental health literacy programs. Research in this area tends to
focus on the possible effects of communication content on audiences in terms of
changes in knowledge, attitudes or behaviour. This is particularly true of studies
relating to the mass media. However, such an approach has been criticised for an
overemphasis on a linear model of mass communication effects, or the knowledge
attitudebehaviour paradigm.

It is important for campaign planners to recognise the factors that various audiences
bring to their understanding and reception of communication campaign messages.
Contemporary theory acknowledges that there are complex relationships between
campaign messages and audiences understandings. Research into mental health
literacy campaigns should take into account how various audiences acquire health
knowledge and what factors motivate audiences to attend to public health messages.
In order to achieve this, Bauman (2000) in particular emphasises the importance of
formative evaluation and process evaluation, to provide essential information about
message production and dissemination, and the responses of various audiences.
Importantly, Bauman recommends that campaign planners be clearly focused on
outcomes that are feasible, achievable and measurable.

84
Supplementary questions:
a) To what extent have such strategies improved levels of knowledge and awareness,
achieved attitudinal change and/or behavioural change and/or achieved positive
changes to broader community attitudes which may have had a flow-on effect to
mental health consumers?

There is evidence that mass media campaigns have achieved changes in
knowledge of and attitudes to mental illness, however such changes have been
quite small in magnitude. It is also unclear from a number of the studies whether
the campaigns themselves have resulted in the changes measured in the studies, or
whether other factors may have contributed. Community education programs
utilising other modes of delivery, such as education courses, similarly found
positive changes in attitudes and knowledge, however the number of studies
looking at this approach is relatively limited. Evaluation of school-based programs
for adolescents generally found that there was an impact on awareness and
attitudes, however it should be noted that the two school-based programs
conducted in Australia were unable to provide adequate assessments of
effectiveness.

Many studies did not attempt to measure behavioural change, and those that did
generally relied on self-report measures, which were unable to be validated. It is
possible that in a number of studies, reported changes in behaviour or intentions
were over-stated. As noted earlier, reviews of health communication campaign
literature have found that mass media campaigns alone are unlikely to achieve
widespread or long-term behaviour change. Media campaigns are important in
generating awareness and improving knowledge about health issue, however other
supportive activities are required to produce significant behavioural change.
Rogers and Storey (1987) point out, however, that, given the limitations of
communication campaigns, a program may be considered effective even if
behaviour change is limited to a very small segment of the target audience.

Reducing the level of stigma and discrimination experienced by people with
mental illness was recognised to be an important aim of many of the programs
included in this review, however the majority of studies did not actually attempt to
measure flow-on effects for mental health consumers. Evaluations of programs
targeted to carers and families of people with mental illness were the exception to
this. Overall, these studies found that rates of hospitalisation and relapse rates for
people with mental illness may be reduced by educational interventions targeted
to carers and family members. However, no direct association was found between
improvements in participants mental health literacy and beneficial effects for
mental health consumers.

b) What are the determinants of successful public health information strategies, for
example, strategy development, selling the message, communication tools (eg
print, radio, television and/or film), post-strategy follow-up and cost
effectiveness?

In terms of mental health literacy programs, it is clear that a number of elements
are associated with successful campaigns. In particular, determining the goals of

85
the campaign and the characteristics of the target audience are essential to ensure
that the message and mode of delivery of the campaign are appropriate. When
developing campaign messages, it has been found that campaigns that
communicate the benefits of a particular attitude or behaviour change to the
general public are more effective than attempting to convey concepts alone. This
is supported by the findings of Rogers and Storey (1987) in their review of the
communication campaign literature. They found that campaigns that promote
prevention are less likely to be successful than those with immediate positive
consequences, and that messages that are socially distant from the audience
member are not effective. A number of studies of mental health literacy programs
have also found that campaigns which are able to achieve direct contact between
the audience and mental health consumers are associated with improved attitudes.

Literature relating to general health communication strategies also recognises the
importance of campaign strategy development. In this context, formative
evaluation is viewed as a necessary part of a successful campaign. This involves
evaluating aspects of the campaign, especially message design and audiences
understandings, in the planning stages. This work can improve the effectiveness
of programs by producing messages that are specific to the goals of the campaign.

Determining the most appropriate communication tools depends largely on the
target audience and the goals of the campaign. In the current review, mass media
campaigns which have reached the largest proportion of the general public were
those which utilised television broadcasts in association with other media
promotional strategies. An example of this was the Norwegian Mental Health
Campaign, which achieved 94% awareness in the population (Fonnebo and
Sogaard 1995; Sogaard and Fonnebo 1995). The success of this campaign was
attributed to the wide variety of media and community activities undertaken, as
well as the support provided by government and high profile individuals and
organisations. Studies of other forms of health communication campaigns have
also found that positive changes in attitudes and awareness tend to be associated
with programs that utilise both mass media and community strategies, rather than
media or community activities alone.

Programs that are designed to reach particular target groups may be delivered
more effectively through approaches other than mass media. School-based
programs are effective at reaching school-aged adolescents, however it should be
noted that not all individuals in this age group will be reached through such
programs. Mental health literacy programs for carers and families have been
shown to be effective when delivered in a group educational setting. Such an
approach has been shown to be more effective than the provision of written
information alone.

It is important to note that none of the studies included in this review adequately
investigated cost-effectiveness of mental health literacy programs. While there is
some evidence that mass media approaches can achieve changes in awareness and
attitudes in the wider population, it is recognised that such strategies are costly.
Studies of cost-effectiveness are appropriate in this area, particularly as there is
evidence that community activities can enhance mass media approaches, and may
prove to be a more cost-effective approach for certain target groups.

86

c) Which determinants of successful strategies and campaigns apply to all
populations and which to particular target audiences?

Previous reviews of the literature have concluded that mass media campaigns may
be most effective at reaching the general public, while programs targeted to
specific sub-groups or which are designed to produce behaviour change may be
delivered more effectively through smaller group or community-based
approaches. It has also been found that mass media strategies may be more
effective at achieving long-term change in awareness and attitudes if they are
complemented by community activities.

The current review tends to support these findings. Campaigns involving large-
scale mass media approaches were often able to reach a significant proportion of
the general population. However, it was also found that changes in attitudes and
knowledge achieved through mass media approaches are limited, and therefore
smaller-scale strategies may be more appropriate and cost-effective for particular
target groups. In particular, community-driven activities and public education
courses combined with mass media campaigns may result in greater changes in
knowledge and attitudes than media approaches alone.

As stated earlier, programs that have focused on particular audiences have
generally been delivered in a school-based setting, or targeted to carers and
families of people with mental illness. While programs focusing on other target
groups may have been initiated, few evaluations have emerged from which to
make judgements about effectiveness. Overall, there is evidence that school-based
programs are effective in improving attitudes and knowledge among adolescents,
however the evidence of effectiveness of Australian programs is less strong.
Programs targeted to caregivers and relatives of people with mental illness have
also been shown to be effective, and, importantly, may result in beneficial effects
for people with mental illness.

It should be noted, however, that all studies of programs for carers and families
have been conducted in the US and the UK, and therefore such programs may not
be directly transferable to the Australian context. Despite this, it is clear that this
group is an important audience for targeted mental health literacy programs. In
addition, there is a need for further evaluation of strategies which will effectively
focus on other target groups, such as mental health consumers, people from non-
English speaking backgrounds, and individuals at high-risk of developing mental
illness.

d) Which successful public health information strategy models are transferable in
terms of content and/or process across topic areas and/or demographic groups in
Australia?

Most of the programs studied were conducted in countries other than Australia. It
is therefore difficult to determine to what extent successful programs may achieve
the same effects in the Australian context. The issue of transferability of programs
was recognised in a large-scale review of effectiveness of mental health
promotion programs conducted for the Health Education Authority in the UK

87
(Tilford, Delaney et al. 1995). The review found that most evidence came from
countries other than the UK, and therefore conclusions about applicability to the
UK context were tentative only. A similar recommendation may be made for the
current review, as only three of the studies were conducted in Australia. In
addition, significant methodological issues emerged in a number of these studies,
particularly those investigating school-based programs, and the strongest evidence
tends to come from evaluations of overseas studies.

In terms of transferability of content and process across different settings and
target groups, several issues need to be addressed. Program content may not be
transferable between different geographical regions, or between different
demographic groups. It has been noted that campaigns must be carefully tailored
to particular audiences, and therefore a program designed for adolescents that is
delivered in a school setting is not likely to be appropriate for older age groups, or
for target groups such as mental health consumers. It is important to recognise that
audiences are diverse, and, in particular, cultural and language differences must be
taken into account when designing or transferring program content. In terms of
geographical regions, information about resources, health services, and treatment
options may differ greatly between different countries and states, and even
between metropolitan and rural areas.

Selecting the most appropriate mode of delivery may also be quite specific to
particular regions and target groups. As has been noted, mass media campaigns
are generally suited to whole of community campaigns, while other strategies may
be more effective for targeting sub-groups of the population. Although a number
of overseas studies have found that mass media campaigns are more effective
when supplemented by community-based activities and direct approaches, there
have not been any evaluations of such techniques in the Australian setting.

e) In which areas may further research be commissioned on public health
information approaches to mental health literacy?

A number of important areas for future research have emerged from this literature
review. Firstly, there is a lack of strong evidence of effectiveness of mental health
literacy campaigns in the Australian context. Only three of the twenty-one
programs reviewed were conducted in Australia, and the findings of a number of
these studies were inconclusive. There is a clear need for evaluation of mental
health literacy programs in Australia, both in terms of campaigns targeted to the
general population, and those aimed at particular sub-groups.

While a number of target populations for mental health literacy campaigns have
been identified, relatively few programs in this area have been evaluated. For
example, no studies were identified which investigated programs designed
specifically for mental health consumers or individuals at risk of developing
mental illness. In addition, only one program targeted to people from non-English
speaking backgrounds was found for inclusion in the review (Bhugra, Baldwin
and Desai, 1997). As this was a small-scale pilot study conducted in the UK, it is
unclear whether the results would be applicable either to the wider population or
to the Australian context. There is therefore a need for evaluation of such

88
programs, in order to determine the characteristics of mental health literacy
campaigns that are effective for particular target groups.

The issue of cost-effectiveness has not been addressed in previous studies of
mental health literacy campaigns. This is clearly a key area for further research,
particularly as many programs tend to involve high cost strategies such as mass
media campaigns. It is important to determine to what extent particular outcomes
may be achieved using smaller-scale and less expensive methods, especially as
more direct, community-based approaches have been found to be an important
component of successful campaigns.

As discussed earlier, the health communication literature emphasises the
importance of formative evaluation and process evaluation of communication
campaigns. Much of the previous research has focused on evaluation of outcomes,
and has tended to neglect evaluation of the development and implementation
phases of communication and information programs. It is also recognised that
monitoring of linked or similar campaigns over time is important in assessing the
longer-term effectiveness of campaigns. It is clearly important that future research
involves appropriate resources and methods to achieve useful evaluation of
strategies to improve mental health literacy.
Methodological Issues
Important methodological limitations were identified in many of the studies in this
review. Issues about study design, in particular, arose in much of the literature. These
limitations must be taken into account when interpreting any findings, as they have an
important impact on the strength of any conclusions that may be drawn from the
literature.

The studies selected for inclusion in this review may be classified generally as
program evaluation research. In view of this, it is important to consider the nature and
methodological approaches of program evaluation, in order to inform future research
in the field of mental health literacy.
Program evaluation
Program evaluation involves the assessment of a program to determine its merit,
worth or value (Hawthorne, 2000; Scriven, 1991). A program may be defined as a
planned set of activities directed towards bringing about specified changes in an
identified and identifiable audience (Smith 1988). As such, the expected outcomes of
a program may be identified and measured, along with unforeseen or unexpected
program effects.

Evaluation research uses the scientific method to assess the worth of a program, in
order to make judgments about a programs intended and unintended outcomes
(Hawthorne 2000). The term scientific method refers to the use of research methods
that enable any findings or outcomes to be attributed to a particular cause, in this case
to the activities of a program (Hawthorne 2000). Such research methods involve:
a) a strong research design that minimises bias, distortion or confounding and
that maximises the generalisability of findings;
b) the use of sensitive, valid and reliable measurements;

89
c) the generation of outcome data that are standardised in some way so they are
stable, and they can be identified and described; and
d) conclusions drawn from logical reasoning, based on deductive and inductive
thinking, such that they are stated with a degree of precision which can be
universally understood.
Forms of evaluation
Evaluation may be classified into three broad categories: formative evaluation,
process evaluation and summative evaluation (Scriven 1991; Hawthorne 2000).
Formative evaluation is generally conducted during the development stages of a
program, in order to provide feedback to program planners during the design phase.
Process evaluation involves monitoring the implementation and operation of a
program, to determine whether program activities are conducted as intended.
Evaluation conducted after the completion of a program is generally classified as
summative evaluation.

Summative evaluation involves assessment of the effects of a program, and can be
categorised as either impact evaluation or outcome evaluation (Hawthorne 2000).
Impact evaluation aims to measure the immediate or short-term effects of a particular
program, such as changes in knowledge, attitudes or behavioural intentions. These
measures may be considered surrogate criteria for the actual long-term aims of a
program, e.g. changes in a populations health status or behavioural change. In
contrast, outcome evaluation assesses the long-term effects of a program, such as
actual behavioural changes, rather than merely the immediate impacts.
Evaluation study design
Evaluations of health or social programs, such as those designed to improve mental
health literacy, may involve a number of different approaches. Selection of a study
design will depend on a number of important factors. It is necessary to consider
general issues about the aims, resources and context of the evaluation, as well as
specific issues relating to the validity of the research (Hawthorne 2000; Grembowski
2001).

The selection of a study design will depend largely on the purpose of the evaluation
(Hawthorne 2000). Where an evaluation aims to determine causality, it is generally
appropriate to choose an experimental research design. In contrast, for a study that
aims to understand an aspect of human behaviour, an observational design may be
more suitable. In addition, it is important to consider the actual context and setting of
the evaluation. While a particular study design may be considered most appropriate to
achieve certain aims, it may not be feasible to implement such a design in all
situations.
Types of study design
Study designs are generally classified as one of three basic types (Colton 1974;
Kumar 1996; Scriven 1991; Hawthorne 2000; Grembowski 2001):
experimental;
quasi-experimental; or
pre-experimental / observational.


90
Experimental designs are those in which the investigator has control over participants,
treatment and observations. They involve two or more groups, at least one of which
consists of participants who receive a particular treatment, while a second group
forms a control or comparison group. An important feature of experimental designs is
the randomisation of participants into either the treatment or control group.

The most commonly referred to form of experimental design is the pre-test/post-test
control group design, or randomised controlled trial. This study design involves
randomisation of participants into treatment and control groups, with observations or
measurements conducted prior to and following the treatment or intervention phase.
Another common form of experimental design is the post-test only control group
design, which involves randomisation into treatment and control groups, with
observations conducted following the intervention only.

Quasi-experiments have some features that are similar to experimental designs. They
involve treatment and control groups, however there is no randomisation of
participants into these groups. Good quasi-experimental designs aim to match the
control group as closely as possible to the treatment group, in order to minimise
differences between the two groups.

One of the most common examples of quasi-experimental design is the pre-test/post-
test non-equivalent control group design. This study design involves control and
treatment groups without randomisation of participants. Selection or matching criteria
are often applied to minimise differences between the groups. Observations are
conducted prior to and following the treatment phase. Another form of quasi-
experiment is the separate samples pre-test/post-test design. This design is
commonly used when studying interventions in large populations. It involves the use
of two separate samples of participants, with observations conducted in one sample
prior to the treatment, and post-treatment observations conducted in the second
sample.

In pre-experimental or observational designs, the investigator has little or no control
over participants, treatments and observations in the study. Such designs are limited in
their ability to establish causality, i.e. whether observed changes are actually caused
by a particular intervention. One example of this design is the post-test only with
non-equivalent groups design. This involves the use of treatment and control groups
that have not been matched, with observations conducted in both groups following the
treatment only.
Research validity
When selecting a study design for a program evaluation, issues of internal and
external validity must be taken into account. The concept of internal validity refers to
a studys ability to make accurate causal inferences about the impacts of a particular
program (Grembowski 2001). In other words, the study should be able to determine
whether any observed changes caused by the program itself, rather than by other
factors. Certain study designs tend to have fewer threats to internal validity than
others (Hawthorne 2000; Grembowski 2001). In particular, experimental designs have
higher internal validity than quasi-experimental designs, which in turn have higher
internal validity than pre-experimental, or non-experimental, designs.


91
The issue of external validity arises when considering whether the results of a
particular study can be generalised to other settings, populations or time periods. In
order to consider external validity, it is first necessary to determine that the study has
internal validity. When determining external validity, issues to consider include
whether the study setting is comparable to other potential settings, and whether the
sample population included in the study can be generalised to the wider population.
Selection of study design
Studies included in this literature review tended to be summative evaluations, i.e.
studies that aimed to measure the effects of a particular program. When selecting a
study design for a summative evaluation, it is important to note that some study
designs will facilitate more accurate and generalisable findings than others. Studies
involving a before-and-after, or pre-test/post-test, design are generally considered to
be the most appropriate for summative evaluations (Kumar 1996; Hawthorne 2000).

Summative evaluations tend also to be conducted from an experimental evaluation
perspective (Hawthorne 2000). The aim of such an investigation is to measure the
effects of a program in a rigorous manner, to determine whether any observed
changes are in fact caused by the activities of the program, rather than by other
factors. In order to achieve this purpose, studies involving an experimental design
with comparison groups and randomisation are preferred (Grembowski 2001). One of
the most common examples of this form of experimental design is the pre-test/post-
test control group design, or randomised controlled trial (RCT).

It is important to note, however, that an experimental study design is not always
feasible when evaluating a health program (Hawthorne 2000; Grembowski 2001). In
view of this, evaluators often use study designs that are defined as either quasi-
experimental or pre-experimental / observational. Where true experimental designs
are not used, it is important that threats to internal validity are reduced. One example
of a study design commonly used in summative evaluation research is the pre-
test/post-test non-equivalent control group design. This is a form of quasi-experiment
involving treatment and control or comparison groups without random allocation of
participants. This is considered to be a strong design, particularly where there are
selection or matching criteria, such as age and gender, to minimise differences
between the groups of participants (Hawthorne 2000; Grembowski 2001).
Program logic
Evaluations of public communication campaigns, such as mass media campaigns,
raise specific methodological issues. In particular, it is often difficult to separate the
effects of such campaigns from those due to external influences (Owen 1993). The
use of experimental study designs is often not feasible when evaluating this type of
program, as mass communication approaches are generally conducted at a population-
wide level, and it may not be possible to control for external factors in this setting.

These difficulties may be overcome to a certain extent by the use of program logic
approaches as part of the evaluative process. Program logic methodology involves the
clarification of the logical causal path underlying a programs activities (Hawthorne
2000). The aim of this process is to elucidate intended program outcomes, as well as
the causal mechanisms underpinning these outcomes. It involves clarification of the

92
programs theory of action, which is particularly important in the evaluation of
complex programs.

Importantly, program logic modelling allows for evaluation of outcomes at different
stages of the program. For example, intermediate outcomes that form part of the chain
of events leading to a programs ultimate outcomes can be clarified and measured
(Owen 1993). This process provides information about the characteristics of
successful and unsuccessful programs at each stage, rather than simply relying on
measurement of ultimate outcomes.

As stated earlier, the causal mechanisms underlying a particular programs activities
and any observed effects may be difficult to ascertain. It is important to recognise that
summative evaluation is not the only approach to investigating the merit or worth of a
particular program, and may not always be appropriate. In many circumstances
consideration should be given to conducting either a formative or process evaluation
of a program, for which the development of a program logic model is particularly
appropriate.
Summary
Evaluations of mental health literacy programs may involve a number of different
approaches. Studies included in this literature review tended to be summative
evaluations, i.e. research designed to measure the effects of a particular program. The
aim of such an investigation is to measure the impact of a program in a rigorous
manner, to determine whether any observed changes are in fact caused by the
activities of the program, rather than by other factors. When choosing the most
appropriate study design for a summative evaluation, it is important to recognise that
some study designs will facilitate more accurate and generalisable findings than
others.

In general, a before-and-after, or pre-test/post-test, design is considered to be the most
appropriate for a summative evaluation. In addition, an experimental study design
involving randomisation of participants into treatment and control groups is preferred,
as such designs tend to have high internal validity. It is important to note, however,
that a true experimental study is not always feasible when evaluating a health
program, and therefore evaluators often use either quasi-experimental or pre-
experimental / observational study designs. Where such study designs are used for a
program evaluation, it is important that threats to the internal validity of the study are
identified and reduced.

Evaluations of public communication campaigns raise specific methodological issues.
Mass communication approaches are generally conducted at a population-wide level,
and often it is not possible to control for external influences. The use of experimental
study designs may therefore not be possible in these settings. When evaluating such a
program, consideration should be given to developing a program logic model.
Program logic methodology involves clarification of the programs theory of action
and the logical causal pathway underpinning a programs activities. This process can
assist in elucidating the characteristics of successful and unsuccessful programs at
each stage, rather than measuring only the ultimate outcomes. In many circumstances
it may also be appropriate to conduct a formative or process evaluation of a program,
for which the development of a program logic model is often a key component.

93
Appendix 1 Previous reviews of the literature
Reviews of Mental Health Literacy Programs
The literature relating specifically to improving mental health literacy is not large, and
consists largely of studies of individual programs, papers providing background
information, and policy framework documents. In addition, a number of large-scale
reviews of the literature have been conducted in recent years. Most of these involved
reviews of mental health promotion and mental illness prevention programs in
general, and therefore many of the programs reviewed do not specifically relate to
improving mental health literacy. An overview of this previous research is provided in
this section, as a number of the findings are of relevance to the development of
effective mental health literacy programs.
Day (1987)
Improving community education strategies for mental health
promotion.
In an early review of the literature relating to mental health education programs, Day
(1987) provided a number of recommendations for the development of effective
mental health promotion campaigns. While these recommendations specifically
referred to the development of Canadian programs, it is worth considering their
relevance to the Australian context. In the review, Day examined a number of aspects
of mental health education programs, in particular: the message, the audience, the
medium, and the goals and objectives of the program. The review included 39
references, comprising both studies and books, most of which were published prior to
1980 and are therefore not included in the current literature review.

With respect to the theme and content of mental health education campaigns, Day
found that messages should be interesting and informative, but also simple enough for
the information to be conveyed easily to the target audience. The content of the
message and theme of the campaign may vary according to the aims of the program.
Increasing awareness generally requires the presentation of simple and direct
information, while modifying attitudes may require more persuasive techniques. A
program that aims to modify behaviour requires more complex content with a sound
theoretical basis, such as social psychology theory. The review also stated that
authoritarian pronouncements should be avoided, as these tend to create anxiety in
the audience when applied to the subject of mental illness.

Day found that most mental health education campaigns were directed towards the
general public, and that such an approach often did not succeed as it did not take into
account the varied characteristics of the audience. Day recommended that programs
designed mainly to increase awareness and interest in mental health issues should be
targeted to the general population, however programs designed to modify certain
behaviours should be targeted to specific groups. Three groups were identified to
whom mental health education should be directed: those vulnerable to emotional
disorder, those in positions of power in the community, and those with caregiving
roles.


94
When considering the appropriate medium for conveying mental health messages,
Day noted that the mass media were the most important method for the presentation
of such information. However, he pointed out that mass media formats are costly, and
may oversimplify issues. He stated that small-group discussion formats might be more
effective at achieving long-term changes. Day recommended moving towards a
participant model of mental health education, rather than more passive approaches.
He stated that the most effective campaigns would involve media presentations to
improve perception and awareness of the issues, which were then followed by small
group presentations and discussions in order to promote attitude and behaviour
change. Overall, Day recommended that the development of effective campaigns
involved taking into account all the elements of the program already outlined, and that
future programs should be evaluated to increase the body of literature regarding
effectiveness.
Tilford, Delaney et al (1995)
Effectiveness of mental health promotion interventions: a literature
review.
More recently, a large-scale review of mental health promotion interventions was
undertaken for the Health Education Authority in the UK (Tilford, Delaney et al.
1995). This review included 72 studies, the majority of which (71%) were from the
United States. The aim of the review was to identify interventions that had been
shown to be effective in preventing mental disorders and promoting positive
wellbeing. While a number of studies related specifically to improving mental health
literacy, the majority did not. Those that related to mental health literacy were
generally mass media interventions directed to the whole community. It was found
that there was evidence that mass media campaigns can modify knowledge and
attitudes to mental illness, however it was acknowledged that the impact of such
campaigns is limited. The authors noted that the impact of media campaigns might be
enhanced by complementary community activities, which corresponds with the
findings of the review conducted by Day (1987).

Mental health promotion studies targeted to specific groups generally did not involve
programs to improve mental health literacy, but were instead focused more
specifically on interventions designed to prevent mental illness and promote overall
wellbeing, such as courses on self-esteem and coping skills. Despite the relatively
small number of mental health literacy programs included in the review, the authors
made the recommendation that children as a group should have access to health
education curriculum that incorporates mental health components.
Hodgson, Abbasi and Clarkson (1996)
Effective Mental Health Promotion: a Literature Review.
Another major review of the literature relating to mental health promotion
interventions was undertaken by Hodgson, Abbasi and Clarkson (1996). They defined
mental health promotion as the enhancement of the capacity of individuals, families,
groups or communities to strengthen or support positive emotional, cognitive and
related experiences. The review focused on evidence from studies that were either
randomised controlled trials or quasi-experimental designs. As with the review by
Tilford et al (1995), most of the studies identified for the review were conducted in

95
the US, however the focus for this review was slightly narrower, and very few of the
programs reviewed related specifically to mental health literacy.

The authors concluded that there was clear evidence that mental health promotion
programs can be effective, and that many successful programs utilise a targeted rather
than universal approach in order to modify particular risk or protective factors. They
stated that the identification of individuals who are likely to receive benefit from a
particular program is an important issue, to ensure that resources are used wisely. The
authors also recommended the implementation of multi-national studies to determine
the generalisability of study findings between different countries and settings.
Krupinski and Burrows (1989)
Mental health promotion policy strategies for Australia.
An Australian review of mental health promotion and prevention programs by
Krupinski and Burrows (1989) differed from those discussed previously in that it
aimed to assess the state of mental health promotion and prevention activities in
Australia at the time, rather than provide a detailed review of the literature. A total of
50 programs relating to mental health were identified through the computerised data
base Health Education and Promotion Information System (HEAPS), and the majority
of these related to relaxation and stress management. Information about a further 268
programs was obtained through a survey of relevant organisations. Of these, 21%
were educational programs, however it is unclear whether any of these were designed
to improve aspects of mental health literacy. The authors noted that very few of the
programs had undergone systemic evaluation.

The recommendations of the review were that mental health promotion programs
should be targeted to the population as a whole, and prevention activities should be
targeted to particular at-risk or mental illness groups. The authors proposed that
programs directed to the general population should focus primarily on increasing
community knowledge and awareness of mental illness and issues related to mental
health, as well as altering negative community attitudes to mental illness. They stated
that the best method of conveying information to the general population was through
the mass media, and proposed that broadcast media, periodicals, and local papers may
be the most appropriate vehicles for mental health education. The authors also
recommended educational books and brochures as an inexpensive method of
disseminating information, although they acknowledged that such information would
probably be most effective at reaching those who were already interested in mental
health issues.

96
Reviews of Communication Campaigns
Given the relatively small amount of literature focusing on mental health literacy
programs, it is useful to extend the literature review to other areas of health
communication. The following section provides an overview of selected major
reviews of communication campaigns on related health issues such as, alcohol,
tobacco and other drug use, drink driving, sexual matters, HIV/AIDS, road safety, and
youth issues.
Shanahan, Elliott and Dahlgren (2000).
Review of public information programs addressing youth risk-
taking.
This report, commissioned by NYARS, involves a critical literature review focused
on evaluations of national and international mass media communication campaigns
designed to improve the health of young people. It includes a study of attitudes of
selected managers of Australian mass media campaigns directed at youth and
addressing youth risk taking.

In our view, this is a significant paper that deserves special attention by Australian
communication campaign planners. Although focused on youth risk-taking, the
conclusions and suggestions have wider implications. Overall, the authors concluded
that barriers to the effective development of a public communication campaign
included the following:

Unrealistic expectations;
The absence of a clear set of objectives;
Poorly defined target groups or audiences; and
The failure to develop successful messages for its intended audience.
Additionally, campaign managers raised the pragmatic constraints of limited
budget and time, a scarcity of personnel and resources, as well as the need to
satisfy political objectives.

Unrealistic expectations and unachievable goals emerged as a prime barrier to the
effectiveness of public communication campaigns; a point made in earlier reviews of
the campaign literature.

In general, campaigns aimed to achieve one or more of the following:

Agenda setting: increasing the salience of a particular risk-taking behaviour by
attracting community attention;
Improving levels of knowledge and awareness;
Achieving changes in behavioural intent;
Achieving changes in social norms;
Sustaining safer behaviours by young people; and
Achieving attitudinal changes among the broader community, which have a
flow-on effect to young peoples attitudes and behaviour.


97
Achieving behavioural change was generally acknowledged as an extremely difficult
goal. Evidence from the literature indicated that advertising on its own rarely led to
wide behavioural change, particularly in the area of health.

Changes in behaviour were more likely to eventuate over a long period of time, and
only if the mass media communication was supported by other activities (such as
community-based interventions, sponsorship, public relations). Changes in awareness
or salience of a particular health issue can be achieved in the relative short term, and
awareness raising or signposting the need to change, can be a legitimate campaign
goal.

The report identified elements of a successful campaign:

The implementation of a thorough planning stage;
The use of research: to help define the target groups, to understand the issue
from the target groups point of view, to test alternative messages, and to
evaluate the campaign;
The establishment of realistic and achievable objectives;
The linking of media campaigns to other supporting activities (eg community
and/or school-based activities);
The utilisation of more than one form of media; and
The provision of sufficient time and resources to enable the campaign to
achieve its objectives

It is suggested that health communication campaigns need to adopt broader and more
aggressive strategies. Campaigns must target children younger than has been the
norm. It is suggested planners: micro target strategies to the needs and interests of
different ages and environments; provide consistent messages from a variety of
sources and over a long period of time; and emphasise giving children control and
ownership of their own destinies.

The report also highlighted the need to adopt a step by step process in planning
procedures. This relates directly to setting realistic aims and a workable strategy, the
use of an appropriate theoretical model, and the implementation of a range of research
procedures.

The report noted that campaign managers interviewed for the study made specific
mention of the need at the planning stage to include on the management team relevant
expertise for the various campaign components. This strategy development, they said,
might include expertise in research, public relations, advertising, and media.
Processes involve the development of a communications brief, the gathering of
existing research and data on the campaign issues, and the conduct of developmental
or exploratory research. (As in formative research, mentioned above).

Accurately identifying the target audiences for a proposed mass media campaign was
highlighted. Extreme care needs to be taken in determining the target groups and in
understanding their attitudes. Planners need to understand the world view of the so-
called youth target groups. Planners should examine closely the likely age, gender and
demographic differences among a youth target group, as well as differing attitudes

98
and behaviours. Youth is not a homogeneous group and careful differentiation is
essential.

The report also notes the importance of developing meaningful messages. Campaign
managers interviewed were adamant that the key to reaching the target groups
effectively for a mass-media-led public campaign was knowledge of the target
audiences, as well as the use of images and language with which they could readily
identify.

A range of issues were examined including the benefits of using research to pre-test
alternative messages (formative research), and of involving youth in communication
development, as well as discussion of the use of negative and positive approaches,
and fear or threat appeals, in communications to youth.

Evidence suggested that most effective media campaigns use a range of media,
choosing different media according to their different strengths to create a synergistic
communication. The report noted the importance of choosing appropriate media,
effective use of placement, and related audience experiences in the use of television,
radio and print. Other media vehicles, such as comics and videos, were examined ,
which may be useful in reaching alienated youth.

The report also noted the role and importance of complementary and coordinated
activities, such as public relations, sponsorship, and school and community based
activities. Generally, there was strong support among those campaign managers
interviewed for complementary activities to any mass media campaign. The use of
community based activities, promotional events, and the like, often give teeth to the
campaign and provide some tangible way of reaching the target audiences through a
social or cultural channel, the managers said.

There was considerable evidence, the report said, that mass media campaigns will
only have a substantial impact if they are integrated with other intervention strategies.
The report noted that adequate evaluation techniques are infrequently used.

The researchers identified the following factors that limit the potential of the mass
media:

The amount of activity contrary to health campaign objectives that appear in
the media;
The shortcomings of the media (eg failure to reach the target audiences,
insufficient time, etc);
Insufficient time allowed for the campaigns;
Lack of funding;
Poor media placement and timing;
The sometimes over-simplification of complex behaviours;
Cultural factors working against the aims of health campaigns; and
The inherent difficulties of communicating to youth.

The report concluded:


99
Expectations of what mass media campaigns can and cannot do need to be
carefully considered.

There is a tendency to believe that mass media can reach everyone and,
on exposure, change behaviour. This belief follows the theory of
mass media influence known as the bullet theory, hypodermic
needle theory or direct effects model. The assumption is that the
audience is passive and the mass media is powerful and capable of
influence and persuasion, and of affecting attitudes and behaviours.
(See Section 5).

Evidence suggests that mass media campaigns, aimed at improving public
health, can:

Increase awareness of a problem, or at-risk behaviour;
Raise the level of information about a topic or issue;
Help form beliefs, especially where beliefs are not held firmly;
Make a health issue more salient and thereby sensitise the audience to
other forms of communication (eg personal communication,
school/community-based activities, public relations, brochures etc);
Simulate interpersonal influences via conversations with family or
friends, teachers etc;
Generate forms of self-initiated information seeking; and
Reinforce existing attitudes, beliefs and behaviours.

Determining appropriate gaols of a mass media campaign emerges as one of
the key considerations.

Goals should be set at the outset, and they need to be realistic and
attainable. Successful campaigns have achievable goals and have not
attempted to create too much change. Many campaigns have raised
awareness of an issue or signposted the need for behavioural change,
which, in turn, can be supported by other means. Random Breath
Testing media campaigns and complementary legislation is an
example.

Evidence also suggests that it is better to seek a slight change in
attitudes or behaviours and, where possible, build upon existing
attitudes and opinions.

The more successful campaigns have used a variety of media and
implemented support activities as an adjunct to the main messages conveyed
through the mass media.

In developing any campaign directed at reducing or minimising youth risk-
taking, it is important that at the outset a clear understanding is gained (and
agreement reached) on who are the target audiences.

Accompanying this requirement is the need to have an understanding
of the target audiences attitudes and motivations. That is, how do the

100
target groups construe risk taking? What is and, importantly, what is
not risk-taking from their perspectives? What are the situational and
environmental factors impacting on their attitudes, behaviours and
motivations? (A review of risk communication campaigns is provided
in Section 5.)

Understanding the audience is critical.

The way an audience currently behaves and what it believes will
determine what it will eventually do with the campaign messages.
Audiences, especially youth audiences, are active recipients of
campaign messages, interpreting and accepting or rejecting what is
being communicated to them.

The diversity of sub-cultures within the youth population makes it difficult to
develop a message that will gain uniform understanding or acceptance. Target
segmentation and the implementation of different messages for different sub-
groups should always be considered. There is no single target group or
audience. The focus should be on audiences.

The diversity of youth attitudes and behaviours indicates that there are
some who, for various reasons, will not respond to a communication
campaign at all. Other approaches, such as comics, community-based
activities and direct personal interventions, need to be considered for
these subgroups.

101
Fletcher, Stewart-Brown and Barlow (1997).
Systematic review of the effectiveness of school-based health
promotion
This report on several reviews critically evaluated the effectiveness of school-based
health promotion campaigns concerning alcohol abuse, substance abuse, tobacco
control, sexual health, accident prevention and mental health issues. The goal was to
identify common attributes of successful and meaningful interventions. [Method of
data collection is included with the review paper].

Most of the reviews and primary studies were carried out in America. The review
identified two main approaches to health promotion activities in schools
traditional and innovative. Traditional approaches are pedagogic, focusing on
provision of information to students. Teaching method involve lectures, question and
answer sessions, and provision of reading materials. Innovative approaches based on
active methods include programs such as:

Decision support programs, which teach children how to make rational
decisions about particular behaviours.

Self esteem programs focusing on the development of individual feelings of
self worth and value.

Resistance skills training, which teach students to identify pressures and
assertively resist influences towards risk-taking health behaviours.

Life skills training, which helps students to develop generally, and teaches
broad social skills such as communication skills, human relations skills and
ways of solving interpersonal conflict.

Norm setting programs, which help establish conservative norms within the
group and focus on correcting erroneous assumptions that everyone is doing
it.

Counselling and assistance programs, which use peer help methods.

Pledge programs, which encourage students to state publicly that they will
behave in a certain way as a form of social reinforcement.

Value clarification programs, which examine tensions between individuals
stated values and the likely consequences of risk-taking health behaviour, and
seeking to demonstrate that the two are incompatible.

Overall, the paper concluded that traditional pedagogic health programs are
effective in increasing childrens knowledge of health topics but do not produce
lasting behavioural changes. The report suggested that more innovative programs
could bring about significant changes in health behaviour but that it is difficult to
quantify the impact of the interventions from the results presented in the reviews
identified.

102


The report suggested that a promising strategy for school-based health promotion
campaigns is likely to be a generic or holistic approach with a core mental health or
emotional well-being program delivered throughout the school years. This should be
combined with knowledge-based modules on smoking, drugs, sexual behaviour,
accidents and other aspects of looking after yourself, such as diet and exercise.
Further trials of this approach need to evaluate their impact in combination with
community-based interventions. This model has many features in common with
WHOs Health Promoting Schools initiative.

Alcohol abuse campaigns:
Effects of alcohol prevention campaigns in schools, in terms of behavioural outcomes,
are modest at best. The traditional pedagogic programs produced changes in
knowledge similar to those produced by the more innovative programs, but they were
much less effective in terms of behavioural change.

Substance abuse campaigns:
The results are consistent with the findings of reviews in other areas. When
knowledge is the outcome of interest, many programs are effective in bringing about
changes. Change in knowledge, however, does not necessarily translate into changes
in behaviour, and this calls into question the assumptions of traditional, rational
methods of behaviour change.

Students are less receptive to adult-led campaigns than to peer-led campaigns, and
even more resistant to authority figures such as the police advising them to change
their attitudes and behaviours. Interactive programs (with perhaps some skills
training) led by people not perceived by students to be in authoritarian roles or
establishment positions appear to work better. Motivation (as measured by volunteer
status) is a useful marker in successful behavioural change.

Tobacco control campaigns:
While the traditional methods focused on information provision produce effective
results in terms of influencing knowledge acquisition, they were much less effective
than the innovative methods in changing behaviours. Traditional approaches produced
greater knowledge change in the short-term but smaller behavioural changes than the
newer approaches in general. The report suggests adopting social reinforcement
programs (McAlester et al 1980). The use of programs based on social or
developmental approaches are also recommended as effective alternatives.

Sexual health:
Very few evaluations have been conducted of sexual health campaigns in schools, and
most existing studies were conducted in North America. Results show that many
factors, in addition to school-based campaigns, influence childrens and young adults
behaviours with the result that campaigns may only have only a small impact on
behaviours.


103
Accident prevention reviews:
The report points to conflicting findings, perhaps attributed, in part, to the large
number of methodologically flawed studies. For example, one review showed road
education to be effective while another suggested such interventions were ineffective.
Educational interventions aimed at increasing bicycle helmet use were found to be
generally effective. There was some fairly convincing evidence (from one review)
that a number of other educational interventions aimed at young children are
effective, suggesting that young children can be taught using school-based campaigns
to wear bicycle helmets, ride bicycles more safely, wear seat-belts, learn to swim and
to take care to avoid burns.

The report says, however, that there are difficulties in predicting responses of
adolescents to the content of different campaigns programs highlighted by the
reviews. For example, one review showed that interventions designed to improve the
safety of young drivers could actually produce the opposite effect; that is, higher
accident or mortality rates in the intervention groups. Two reviews included studies
on school-based interventions combined with community interventions and concluded
that this could be a more promising approach. (Also see Elliott, 1989).
White and Pitts (1998).
Educating young people about drugs: A systematic review.
The report assessed the effectiveness of campaigns directed at the prevention (or
reduction of use) of illicit substances by young people, and campaigns directed at
reducing harm caused by continuing use. [Methods used are included with the paper].

The majority of studies identified were evaluations of campaigns in schools about
alcohol, tobacco and marijuana use. These studies were methodologically stronger
than interventions targeting other drugs and implemented outside schools.

The report concluded that the impact of evaluated interventions was small with
dissipation of program effects over time. Interventions targeting hard to reach groups
have not been evaluated adequately, and there is still insufficient evidence to assess
the effectiveness of the range of approaches to drugs education. The report concluded
that there is a need to target interventions to reflect the specific needs and experiences
of recipients.
Coleman et al (1996)
The effectiveness of interventions to prevent accidental injury to
young persons aged 15-24 years: Review of the evidence.
This review assessed the effectiveness of campaigns aimed at preventing accidents, or
injury minimisation, among adolescents and young adults aged 15 to 24 years. It is an
important report because it compares direct interventions with educational
campaigns. Interventions were classified into three broad categories: engineering,
educational and enforcement. Outcomes assessed in the review included: decrease in
rates of accidents; reduction in the severity of injury; and increased knowledge and
attitudinal change.

Not surprisingly, the report concluded that the most effective interventions appear to
be legislative or regulatory controls, which in road, sports and workplace settings are

104
associated with fewer accidental injuries in adolescent populations, although reported
changes in numbers of accidents occurring may be because of variations in exposure.

Interventions evaluated in well-designed trials for which there was good evidence to
support their recommendation were: raising the minimum legal drinking age between
18-21 years, motorcycle helmets, environmental engineering changes to sports
environment and prophylactic injury prevention programs.

Interventions in which there was fair evidence to support their recommendation were:
bicycle helmets, area wide urban traffic safety, sped control hubs, curfew, airbags and
seat belts, subsidised public transport, warning notices combined with low cost
compliance measures to encourage use of protective devices, smoke detectors.

Interventions in which there was good or fair evidence to reject their recommendation
were: formal enhanced pre-car licence driver training and education, driver
improvement programs for problem drivers, and periodic motor vehicle safety checks
and random roadside inspections.

Thus, the report supports Shanahan et als (2000) suggestion that communication
campaigns may increase salience of a health issue, but that other interventions are
necessary to achieve behavioural outcomes.
Sowden and Arblaster (2001a).
Community interventions for preventing smoking in young people.
The report determined the effectiveness of community interventions in preventing the
uptake of smoking in young people. The authors examined the effectiveness of
community interventions compared to no intervention in influencing the smoking
behaviour of young people. Secondly, the report examined the effectiveness of
community interventions compared to other single component interventions (eg
school-based programs) in influencing smoking behaviour of young people. [The
report includes the method of selecting studies for review].

Of nine studies comparing community interventions with no interventions, two
studies (part of cardiovascular disease prevention campaigns) reported lower smoking
prevalence. Of three studies comparing community interventions with school-based
campaigns, only one found differences in reported smoking prevalence. One study
reported a lower rate of increase in prevalence in a community receiving a multi-
component intervention compared to a community exposed to a mass media campaign
alone. One study reported a significant difference in smoking prevalence between a
group receiving a media, school and homework intervention compared with a group
receiving the mass media component only.


105
The report concluded that there is some limited support for the effectiveness of
community interventions in helping prevent the uptake of smoking in young people.
The report recommended that:

Communication planners build upon results of existing programs that have
been shown to be effective rather than repeating methods that have achieved
limited success;

Programs need to be flexible and recognise difference between communities
so that the various components of a given campaign can be modified to
achieve acceptability;

Developmental work with representative samples of those individuals to be
targeted should be carried out so that appropriate messages and activities can
be implemented;

Campaign messages and activities should be guided by theoretical constructs
about how behaviours are acquired and maintained (for example, social
learning theory); and

Community activities must reach the intended audience if they are to stand any
chance of success influencing the behaviour of that audience.
Sowden and Arblaster (2001b)
Mass media interventions for preventing smoking in young people.
The report assessed the effectiveness of mass media communication campaigns in
preventing the uptake of smoking in young people. [The method of selecting studies is
included with the report].

Two studies concluded that the mass media were effective in influencing the smoking
behaviour of young people. Both of the effective campaigns had a solid theoretical
base, used formative research in designing the campaign messages, and message
broadcast was of reasonable intensity over extensive periods of time. In one study,
provocative messages were developed and used to cause affective personal reactions.
It was hypothesised that this would lead to discussion and interpersonal
communication, which would lead to reductions in smoking.

In the other study reporting reductions in smoking behaviour, a program based on the
social influences or social learning theory approach was developed.

The report concluded that there is some evidence the mass media can be effective in
preventing the uptake of smoking in young people, but overall the evidence is not
consistently strong.

The report recommended the following for communication campaign planners:

Build upon elements of existing campaigns that have been shown to be
effective rather than repeating methods that have been successful;


106
Developmental work with representative samples of the target audience should
be carried out so that media messages appropriate to the group can be created;

Campaign messages should be guided by theoretical concepts about how
behaviours are acquired and maintained;

Media messages must reach the target audiences (via media channels preferred
by the target audiences at the most appropriate times);

Broadcasting of campaigns should be of sufficient intensity, frequency and
duration to have a reasonable chance of being effective;

Preference for either radio or television is likely to depend on age.
Serra et al (2000).
Interventions for preventing tobacco smoking in public places.
The report evaluated the effectiveness of campaigns to reduce tobacco consumption in
public places. [The method of selecting studies for review is included with the report].

The most effective campaigns used comprehensive, multi-component approaches to
implement policies banning smoking within institutions. These were where
institutions developed, resourced and supported comprehensive programs to achieve
compliance with a policy decision to ban smoking. Two hospitals in Baltimore, USA,
showed high rates of success from a strategy that included education, dissemination of
information, training for managers, and support in quitting for individual smokers.
Less comprehensive strategies, such as posted warnings and educational material, had
a moderate effect. Five studies showed that prompting individual smokers had an
immediate effect, but such strategies are unlikely to be acceptable as a public health
intervention.

The report concluded that carefully planned and resourced, multi-component
campaigns effectively reduced smoking within public places. Less intensive strategies
have a partial effect, but there is little effect from regulations or signage not supported
by other means. Requests to smoking individuals can reduce short-term smoking but
are not an acceptable public health strategy for reducing exposure to smoke.

All the studies used relatively weak experimental designs. Most studies were
undertaken in the USA and there is a need to identify ways in which these strategies
could be adopted and used in countries with different attitudes to tobacco use. The
report recommended that future studies should consider the use of more rigorous
evaluation methods.

107
Cochrane Tobacco Addiction Group (1999)
Preventing the uptake of smoking in young people.
The report noted that the uptake of smoking is a complex process and is rarely a
single, distinct or discrete event. The influence of family members and peers is
strongly associated with the decision to start smoking. The report found the following:

School based campaigns:
School-based programs have achieved limited success, although social reinforcement
and social norms type programs seem to be more successful than simple knowledge-
based campaigns. These former social campaigns include curricular components on
the short-term health consequences of smoking combined with information on the
social influences that encourage smoking. Training on how to resist the pressures to
smoke was also included.

The authors noted that, in addition to considering the specific components that should
be included in a campaign, other significant issues need to be addressed. These
include training given to teachers who deliver the campaign, and research on how
well each component is delivered and implemented. This information is important in
assisting effectiveness. Consideration must also be given to the age of young people
targeted.

Mass media campaigns:
Mass media campaigns can influence smoking behaviour but have limited
effectiveness. Both the intensity and duration of the messages delivered appear to be
important factors. In evaluating these campaigns, the authors noted difficulties with
evaluation research methods such as high dropout rates, and differences between
groups in baseline smoking rates.

Regulation:
Enforcement of the law relating to cigarette sales to underage youth can have an effect
on retailer behaviour but the impact on smoking behaviour is likely to be small.
Community approaches involving different intervention components can influence
smoking behaviour, particularly when multiple sites within a community are targeted.

Community campaigns:
Despite methodological problems in evaluation, there is some limited support for the
effectiveness of community programs to prevent the uptake of smoking in young
people. Although there were few similarities across studies in terms of individual
components, two studies that were successful in influencing smoking rates both
targeted multiple sites within the community (such as schools, work sites and
churches). Differing media were used simultaneously in order to reinforce messages.

Community interventions are likely to be influenced by local factors and are therefore
difficult to replicate in other settings. Specific components, however, involving
schools, work-places, the media and other community groups, can be modified so as
to achieve acceptability with identified target groups.

Most programs have targeted 11 to 17 year olds. Yet attitudes to smoking and
experimentation with cigarettes may already be established by this time. The

108
implementation of programs before regular patterns of smoking behaviour are formed
should be considered, which may even involve targeting children as young as 4 to 8
years of age.

The report argued that prevention programs should be aimed at the social factors that
influence decisions to smoke, and provide training to develop the skills necessary to
resist the social pressures to smoke and drink alcohol. The importance of the school
environment needs to be recognised and schools should aim to create supportive
environments for their pupils. Parents and other community members should be
encouraged to participate in local initiatives so as to create consistent messages.
Campaigns to encourage smoking cessation, as well as targeting smoking prevention,
could be developed. Mass media campaigns can be used to reinforce anti smoking
messages.
Dobbins et al (1996)
The effectiveness of community-based health projects: A
systematic review.
This report aimed to summarise evidence about the effectiveness of community based
heart health campaigns in public health nursing practices in Canada. The review
focused on campaigns where community involvement is used in implementing
strategies. The campaigns had a clear theoretical framework (social learning theory,
diffusion of innovation theory) and involved the mass media, health campaigns and
screening clinics. [The method of selecting studies is included in the review].

There is a wide diversity of evaluation research reviewed and it is difficult to
generalise. Seventeen heart health projects were included in the review.

The authors concluded that community-based initiatives can have positive effects on a
variety of heart health outcomes such as decreased smoking rate, increased physical
activity level, smoking cessation, weight loss, decreased risk assessment score,
decreased blood pressure, and decreased serum cholesterol level. Outcome measures
that were most positively affected were program process measures, health risk
behaviour change, and physical health status.

There was evidence to support the use of multiple strategies that include mass media
and issue-specific health classes. The findings of the review, however, demonstrated a
diminishing effect over a period of time greater than 10 years.
Shepherd et al (1999)
Interventions for encouraging sexual lifestyles and behaviours
intended to prevent cervical cancer. Cochrane Review.
The report evaluated the effectiveness of health education campaigns promoting
sexual risk reduction behaviours among women to reduce transmission of HPV,
which is one of the major risk factors for cervical cancer. [The method of selecting
studies is included in the report].

All studies reviewed had the primary aim of preventing HIV and other STDs rather
than cervical cancer per se. Of the studies evaluated, all showed a statistically
significant positive effect on sexual risk reduction, typically with increased use of

109
condoms. This positive effect was generally sustained up to three months after
intervention. Factual information provision delivered with sexual negotiation skill
development is more effective in comparison to no treatment or groups receiving
generic health promotion.

The report concluded that educational campaigns, in which information provision is
complemented by development of sexual negotiation skills, and targeted at socially
and economically disadvantaged women, can encourage at least short-term sexual risk
reduction behaviour. This has the potential to reduce the transmission of HPV, thus
possibly reduce the incidence of cervical carcinoma. Thus, health education
interventions in which factual information on STD transmission and prevention is
presented alongside skill development and motivation building can achieve short-
term increases in reported condom use for vaginal intercourse.

The report noted that information provision is a useful first step, but factors such as
attitudes, motivation, the influence of significant others, wider social influences, as
well as practical skills, all play an important part in the ability to change behaviour.

The findings of this review are similar to those conducted by Windgood et al (1996)
that examined a range of sexual risk reduction interventions. This report found that
successful interventions were those that were based upon socio-psychological models
of behaviour, paid attention to gender issues in the negotiation of safer sex, employed
peer educators and used multiple intervention sessions.

The report recommended greater attention to gender and culture issues, greater
integration between sexual health and cervical cancer information, and longer time
spans for interventions.

Paul, C. & Redman, S. (1997)
A review of the effectiveness of print material in changing health-
related knowledge, attitudes and behaviour.
The report identifies five review papers and 43 studies that met the defined inclusion
criteria. [The method for including studies is included in the paper].

The authors conclude that pamphlets are potentially effective in changing knowledge,
attitudes and behaviour for a wide range of health related issues, but the evidence is
very mixed.

They argue that effectiveness varies according to three factors. Pamphlets were more
likely to be effective when used for patient education than in public education. The
effects on behaviour varied according to whether a pamphlet was used alone or as an
addition to another form of intervention. Pamphlets appeared to be more consistent in
changing knowledge and attitudes than changing behaviour.

110
References

Adams, J (1995). Risk. London: UCL Press.
Alasuutari, P (1999). Rethinking the Media Audience. Thousand Oaks, Calif: Sage.
Amir, Y. (1976). The role of intergroup contact in change of prejudice and ethnic
relations. Towards the elimination of racism. P. A. Katz. New York,
Pergamon.
Atkin, C (1981). Mass media campaign effectiveness. In Rice, R & Paisley, W (Eds)
Public Communication Campaigns. Thousands Oaks, Calif: Sage.
Atkin, C, & Wallack, L (1990). Mass Communication and Public Health. Newbury
Park, Calif: Sage
Australian Health Ministers (1992a). National Mental Health Policy. Canberra:
Australian Government Publishing Service
Australian Health Ministers (1992b). National Mental Health Plan. Canberra:
Australian Government Publishing Service
Australian Health Ministers (1998). Second National Mental Health Plan. Canberra:
Mental Health Branch, Commonwealth Department of Health and Family
Services
Australian Health Ministers (1999). Mental Health Promotion and Prevention
National Action Plan. Canberra: Mental Health Branch, Commonwealth
Department of Health and Aged Care
Barker, C., N. Pistrang, et al. (1993). You in Mind: A preventive mental health
television series. British J ournal of Clinical Psychology 32: 281-93.
Battaglia, J ., J . H. Coverdale, et al. (1990). Evaluation of a mental illness awareness
week program in public schools. American J ournal of Psychiatry 147(3): 324-
329.
Bauman, A (2000), Precepts and principles of mass media campaign evaluation in
Australia, Health Promotion J ournal of Australia, 10 (2), pp. 89-92.
Beck, U (1992), Risk Society: Towards a New Modernity. (trans. M. Ritter).
Thousand Oaks, Calif: Sage.
Beck, U, Giddens, A & Lash, S (1994), Reflexive Modernization: Politics, Tradition
and Aesthetics in the Modern Social Order. Cambridge, UK: Polity.
Berkowitz, R., R. Eberlein-Freis, et al. (1984). Educating relatives about
schizophrenia. Schizophrenia Bulletin 10(3): 418-29.
Berkowitz, R., N. Shavit, et al. (1990). Educating relatives of schizophrenic patients.
Social Psychiatry & Psychiatric Epidemiology 25(4): 216-220.
Bhugra, D, Baldwin, D and Desai, M (1997). A pilot study of the impact of fact sheets
and guided discussion on knowledge and attitudes regarding depression in an
ethnic minority sample. Primary Care Psychiatry, 3: 135-140.

111
Blood, R. W, Tulloch, J . & Enders, M. (2000), Risk Communication and Reflexivity:
Conversations about the Fear of Crime, Australian J ournal of Communication
27(3), pp.15-38.
Bradbury, J (1989), The policy implications of differing concepts of risk. Science,
Technology & Human Values 14 (4), pp. 381-399.
Brockington, IF, Hall, P, Levings, J and Murphy, C (1993). The community's
tolerance of the mentally ill. British Journal of Psychiatry 162(1): 93-99.
Brown, J & Campbell, E (1991), Risk communication: Some underlying principles.
J ournal of Environmental Studies, 38, pp. 297-303.
Chien, W., C. Kam, et al. (2001). An assessment of the patients needs in Mental
Health Education. J ournal of Advanced Nursing 34(3): 304-311.
Coleman et al (1996), The effectiveness of interventions to prevent accidental injury
to young persons aged 15-24 years: Review of the evidence.
Colton, T (1974). Statistics in medicine. Boston: Little, Brown and Company.
Commonwealth Department of Health and Aged Care (2000a) National Action Plan
for Promotion, Prevention and Early Intervention for Mental Health. Canberra:
Mental Health and Special Programs Branch, Commonwealth Department of
Health and Aged Care.
Commonwealth Department of Health and Aged Care (2000b) Promotion, Prevention
and Early Intervention for Mental Health: A Monograph. Canberra: Mental
Health and Special Programs Branch, Commonwealth Department of Health
and Aged Care.
Commonwealth Department of Health and Family Services (1996). Promoting mental
health and emotional well-being within a health promoting schools
framework, draft guidelines. Canberra, Commonwealth Department of Health
and Family Services.
Corrigan PW and Penn DL (1999) Lessons from social psychology on discrediting
psychiatric stigma. American Psychologist 54(9): 765-776.
Covello, V, McCallum, D & Pavlova, M (Eds.) (1986), Effective Risk
Communication: The Role and Responsibility of Government and
Nongovernment. New York: Plenum Press.
Dake, K (1992), Myths of nature: Culture and the social construction of risk, J ournal
of Social Issues, 48(4), pp. 21-37.
Davison, C, Davey Smith, G & Frankel, S (1991), Lay epidemiology and the
prevention paradox: The implications of coronary candidacy for health
education. Sociology of Health & Illness 13(1): 1-19.
Day, D. M. (1987). Improving community education strategies for mental health
promotion. Canadas Mental Health 35(4): 6-10.
Delgado, M. (1980). A model for mental health education in Hispanic communities.
J ournal of Psychiatric Nursing & Mental Health Services 18(8): 16-20.
Dobbins et al (1996), The effectiveness of community-based health projects: A
systematic review.
Elliott, B (1989), Effective Road Safety Campaigns: A Practical Handbook. Canberra:
Federal Office of Road Safety.

112
Elliott, B (1987), A re-look at why its so hard to sell brotherhood like soap. Australian
J ournal of Communication, (11), pp. 20-39.
Esters, I. G., P. G. Cooker, et al. (1998). Effects of a unit of instruction in mental
health on rural adolescents conceptions of mental illness and attitudes about
seeking help. Adolescence 33(130): 469-476.
Evans Research (1999). Report on the review of mental health information brochures
produced under the Community Awareness Program (CAP). Canberra, Mental
Health Branch, Commonwealth Department of Health and Aged Care.
Farquhar, J , Maccoby, N & Solomon, D (1984), Community applications of
behavioral medicine. In Gentry, W (Ed) Handbook of Behavioral Medicine.
New York: Guilford.
Fischhoff, B, Slovic, P, Lichenstein, S, Read, S, & Coombs, B (1978), How safe is
safe enough. Policy Sciences, 8, 127-152.
Fisher, A. (1991), Risk communication challenges. Risk Analysis 11(2), 173-179.
Fletcher, Stewart-Brown and Barlow (1997), Systematic review of the effectiveness
of school-based health promotion.
Fonnebo, V. and A. Sogaard (1995). The Norwegian Mental Health Campaign in
1992. Part I: population penetration. Health Education Research 10(3): 257-
266.
Giddens, A (1999), Risk. BBC 1999 Reith Lectures. London: BBC.
Giddens, A (1998), The Third Way: The renewal of social democracy. Cambridge,
UK: Polity Press.
Giddens, A & Pierson, C (1988), Conversations with Anthony Giddens: Making sense
of modernity. Stanford, Calif: Stanford University Press.
Gitlin, T (1978), Media sociology: The dominant paradigm. Theory and Society, 6,
pp. 205-253.
Graham. L (1981), Between Science and Values. New York: Columbia University
Press.
Grembowski, D (2001). The practice of health program evaluation. Thousand Oaks,
Calif.: Sage.
Hadden, S (1989), Institutional barriers to risk communication. Risk Analysis, 9(3),
301-308.
Handmer, J (1995), Communicating uncertainty: Themes and perspectives. In Norton,
T et al (Eds.) Risk and Uncertainty in Environmental Risk Management.
Canberra: Australian Academy of Science.
Hawthorne, G (2000). Introduction to health program evaluation. West Heidelberg:
Program Evaluation Unit, Centre for Health Program Evaluation.
Hayward, P and Bright, J A (1997) Stigma and mental illness: a review and critique.
Journal of Mental Health 6(4), 34554.
Hodgson, R., T. Abbasi, et al. (1996). Effective Mental Health Promotion: a
Literature Review. Health Education J ournal 55: 55-74.

113
Holmes, E. P., P. W. Corrigan, et al. (1999). Changing attitudes about schizophrenia.
Schizophrenia Bulletin 25(3): 447-56.
Hyman, H & Sheatsley, P (1947), Some reasons why information campaigns fail.
Public Opinion Quarterly, 11, pp. 412-423.
J orm, A. F., A. E. Korten, et al. (1997). Mental health literacy: a survey of the publics
ability to recognise mental disorders and their beliefs about the effectiveness
of treatment. Medical J ournal 0f Australia 166(4): 182-186.
Kitzinger, J (1994), The Methodology of focus groups: The importance of interaction
between research participants, Sociology of Health & Illness, 16 (1), pp. 103-
119.
Kommana, S, Mansfield, M, and Penn, D (1997) Dispelling the stigma of
schizophrenia. Psychiatric Services 48(11), 139395.
Kotler, P & Roberto, EL (1989), Social Marketing: Strategies for Changing Public
Behavior. New York: Free Press.
Krupinski, J . and G. D. Burrows (1989). Mental health promotion policy strategies for
Australia. Mental Health in Australia April 1989: 2-16.
Kumar, R (1996). Research methodology. A step-by-step guide for beginners.
Melbourne: Longman Australia.
Lash, S, Szerszynski, B & Wynne, B (Eds.) (1996), Risk, Environment and
Modernity: Towards a New Ecology. London: Sage.
Leff, J ., L. Kuipers, et al. (1982). A controlled trial of social intervention in the
families of schizophrenic patients. British J ournal of Psychiatry 141: 121-34.
Leff, J ., L. Kuipers, et al. (1985). A controlled trial of social intervention in the
families of schizophrenic patients: two-year follow-up. British J ournal of
Psychiatry 146: 594-600.
Leiss, W (1998), Risk Communication and public knowledge. In Crowley, D &
Mitchell, D (Eds.) Communication Theory Today. Oxford, UK: Polity Press.
Leiss, W (1995), Down and dirty: The use and abuse of public trust in risk
communication. Risk Analysis, 15 (6), pp. 693-698.
Lesser, G. S (1974), Children And Television. Lessons from CTW Sesame Street.
New York: Random House.
Link, BG and Cullen, FT (1986). Contact with the mentally ill and perceptions of how
dangerous they are. Journal of Health and Social Behaviour, 27(4): 289-303.
Lupton, D (1999). Risk. London: Routledge.
Mannion, E., K. Mueser, et al. (1994). Designing psychoeducational services for
spouses of persons with serious mental illness. Community Mental Health
J ournal 30(2): 177-190.
Marmot, M (1996), Editorial: From alcohol and breast cancer to beef and BSE
Improving our communication of risk. American J ournal of Public Health,
86(1), pp. 921-923.
McGuire, W. (1989), Theoretical foundations of campaigns. In Rice, R & Atkin, C
(Eds), Public Communication Campaigns. Thousand Oaks, Calif: Sage.

114
McQuail, D (1987), Mass Communication Theory. Newbury Park, Calif: Sage.
Medvene, L. and R. Bridge (1990). Using television to create a more favourable
attitude toward community facilities for deinstitutionalised psychiatric
patients. J ournal of Applied Social Psychology 20(22/2): 1863-78.
Meiser, B. and R. Gurr (1996). Non-English-speaking persons perceptions of mental
illness and associated information needs: an exploratory study of the Arabic-,
Greek- and Italian-speaking communities in New South Wales. Health
Promotion J ournal of Australia 6(3): 44-49.
MindMatters Evaluation Consortium (2000). National Mental Health in Schools
Project. MindMatters Evaluation Project. Evaluation Report. Newcastle,
Hunter Institute of Mental Health.
Needleman, C (1987), Ritualism in communicating risk information. Science,
Technology and Human Values, 12 (3/4), pp. 20-25.
Nutbeam, D & Harris, E (1998), Theory in a Nutshell: A practitioners guide to
commonly used theories and models in health communication. Sydney:
University of Sydney.
Nutbeam, D (2000). Health literacy as a public health goal: a challenge for
contemporary health education and communication strategies into the 21
st

century. Health Promotion International, 15(3): 250-267.
Owen, J .M. (1993). Program evaluation. Forms and approaches. St Leonards: Allen &
Unwin.
Palyer, D & Leathar, D (1981), Socially sensitive advertising. In Leathar, D, Hastings,
G & Davies, J (Eds) Health Education and the Media. London: Pergamon
Press.
Paul, C. & Redman, S. (1997), A review of the effectiveness of print material in
changing health-related knowledge, attitudes and behaviour.
Pavlik, J , Wackman, D, Kline, FG, J acobs, D, Pechacek, T & Pirie, P (1985),
Cognitive structure and involvement in a health communication campaign.
Refereed paper presented to the Health Communication Division of the
International Communication Association, Honolulu.
Paykel, E. S., D. Hart, et al. (1998). Changes in public attitudes to depression during
the Defeat Depression campaign. British J ournal of Psychiatry 173: 519-522.
Paykel, E. S., A. Tylee, et al. (1997). The Defeat Depression campaign: psychiatry in
the public arena. American J ournal of Psychiatry 154(6S): 59-66.
Penman, R (2000), Reconstructing Communicating: Looking to a future. Mahwah,
New J ersey: Lawrence Erlbaum Associates.
Pettegrew, L & Logan, R (1987), The health care context. In Berger, C & Chaffee, S.
(Eds) Handbook of Communication Science. Newbury Park, Calif: Sage.
Pickett-Schenk, S. A., J . A. Cook, et al. (2000). J ourney of Hope program outcomes.
Community Mental Health J ournal 36(4): 413-24.
Priest, R, Vize, C, Roberts, M and Tylee, A (1996). Lay peoples attitudes to treatment
of depression: results of an opinion poll for Defeat Depression campaign just
before its launch. British Medical J ournal, 313(7061), 858-859.

115
Rahman, A., M. H. Mubbashar, et al. (1998). Randomised trial of impact of school
mental-health programme in rural Rawalpindi, Pakistan. Lancet 352(9133):
1022-5.
Raskin, A., R. Mghir, et al. (1998). A psychoeducational program for caregivers of
the chronic mentally ill residing in community residencies. Community
Mental Health J ournal 34(4): 393-402.
Rice, R & Atkin, C (Eds)(1989), Public Communication Campaigns. Thousand Oaks,
Calif: Sage.
Rothschild, M (1979), Marketing communications in non-business situations or why
its so hard to sell brotherhood like soap. J ournal of Marketing, 43 (Spring), pp.
11-20.
Rogers, E & Storey, J D (1987), Communication campaigns. In Berger, C & Chaffee,
S. (Eds) Handbook of Communication Science. Newbury Park, Calif: Sage.
Rohrmann, B (1992), The evaluation of risk communication effectiveness. Acta
Psychologica, 81, pp. 169-192.
Rowan, F (1996), The high stakes of risk communication. Preventive Medicine, 25,
pp. 26-29.
Scriven, M (1991). Evaluation Thesaurus. 4
th
Ed. Newbury Park, Calif.: Sage.
Serra, C, Cabezas, C, Bonfill, X, & Pladevall-Vila, M (2000), Interventions for
preventing tobacco smoking in public places, Rostlinna Vyroba, 47(4): 693
Shanahan, P., Elliott, B., Dahlgren, N. (2000). Review of public information
campaigns addressing youth risk-taking. Hobart: Australian Clearinghouse for
Youth Studies.
Shepherd, J , Weston, R, Peersman, G, & Napuli, IZ, (2000), Interventions for
encouraging sexual lifestyles and behaviours intended to prevent cervical
cancer. (Cochrane Review), Cochrane Database of Systematic Reviews,
(2):CD001035.
Simkins, J & Brenner, D (1984), Mass communication and health. In Voight, M &
Dervin, B (Eds), Progress in Communication Science (Vol. 5). Norwood, New
J ersey: Ablex.
Slovic, P (1987), Perception of risk. Science 236 (April), pp.280-286.
Slovic, P. Fischhoff, B & Lichtenstein, S (1981), The assessment and perceptions of
risk. London: The Royal Society.
Smith, J . and M. Birchwood (1987). Specific and non-specific effects of educational
intervention with families living with a schizophrenic relative. British J ournal
of Psychiatry 150: 645-652.
Smith, M.F. (1988) Evaluation Utilization Revisited, New Directions for Program
Evaluation, Evaluation Utilization, eds J . McLaughlin, L.J . Weber, R.W,
Covert & R.B. Ingle, vol 39, Fall, pp.7-20.
Sogaard, A. and V. Fonnebo (1995). The Norwegian Mental Health Campaign in
1992. Part II: changes in knowledge and attitudes. Health Education Research
10(3): 267-278.

116
Solomon P, Draine J , Mannion E and Meisel, M (1996). Impact of brief family
psychoeducation on self-efficacy. Schizophrenia Bulletin, 22(1): 41-50.
Sowden A, & Arblaster L (2001a), Community interventions for preventing smoking
in young people (Cochrane Review). In: The Cochrane Library, 4, Oxford:
Update Software.
Sowden AJ , Arblaster L (2001b), Mass media interventions for preventing smoking
in young people (Cochrane Review), In: The Cochrane Library, 4,Oxford:
Update Software.
Tilford, S., F. Delaney, et al. (1995). Effectiveness of mental health promotion
interventions: a literature review. London: Health Education Authority.
Tolomiczenko, G. S., P. N. Goering, et al. (2001). Educating the public about mental
illness and homelessness: a cautionary note. Canadian J ournal of Psychiatry -
Revue Canadienne de Psychiatrie 46(3): 253-7.
Tulloch, J (1992), Using TV in HIV/AIDS education: Production and audience
cultures, Media Information Australia, 65, pp. 10-27.
Tulloch, J & Lupton, D (1997), Television, AIDS and Risk: A cultural studies
approach to health communication. Sydney: Allen & Unwin.
Tulloch, J . & Moran, A. (1986). A Country Practice: Quality Soap. Sydney: Currency
Press.
Wearing, M. and M. Edwards (1994). School Education Program (SEP). Final report
of the external evaluation, ARAFMI.
White and Pitts (1998), Educating young people about drugs: A systematic review
Wilson, M., J orgensen, C. & Cole, G. (1996).
Wirthlin Worldwide Australasia Pty Ltd (2001) National Mental Health Benchmark
Study. North Sydney: Wirthlin Worldwide Australasia Pty Ltd.
Wolff, G., S. Pathare, et al. (1996a). Community attitudes to mental illness. British
J ournal of Psychiatry 168(2): 183-190.
Wolff, G., S. Pathare, et al. (1996b). Community knowledge of mental illness and
reaction to mentally ill people. British J ournal of Psychiatry 168(2): 191-198.
Wolff, G., S. Pathare, et al. (1996c). Public education for community care: a new
approach. The British J ournal of Psychiatry 168(4): 441-447.
Wyn, J ., H. Cahill, et al. (2000). MindMatters: a whole-school approach to promoting
mental health and wellbeing. Australian and New Zealand J ournal of
Psychiatry 34(4): 594-601.
Wynne, B (1996). May the sheep safely graze? A reflexive view of the expert-Lay
knowledge divide. In Lash, S, Szerszynski, B & Wynne, B (Eds.) (1996),
Risk, Environment and Modernity: Towards a New Ecology. London: Sage.

You might also like