Chaplaincy Research Its Value Its Quality and Its
Chaplaincy Research Its Value Its Quality and Its
Chaplaincy Research Its Value Its Quality and Its
net/publication/23155419
CITATIONS READS
31 2,485
3 authors, including:
Kevin J Flannelly
Center for Psychosocial Research
235 PUBLICATIONS 6,756 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Kevin J Flannelly on 13 March 2015.
ABSTRACT. The article is divided into four major sections, the first
of which presents and discusses various reasons given by major
researchers in the field why chaplains should do research. The second
section summarizes findings on the sophistication of research on reli-
gion and health published in (a) medical and other healthcare journals,
and (b) specialty journals on religion and health, chaplaincy, and
pastoral care and counseling. The third section revisits suggestions
that have been made by prominent chaplain researchers to increase
and improve research by chaplains. The last section offers some sug-
gestions for expanding several lines of current research in the future,
including research: (1) to elucidate the nature of spiritual care
chaplains provide to different populations, including patients, families
and staff; (2) to assess the prevalence and intensity of patients’ spiri-
tual needs and the degree to which they are being met; (3) to identify
that subset of patients who are spiritually at risk in terms of having
high needs and slow religious resources; (4) to identify the biological
INTRODUCTION
Should chaplaincy become more scientific? That was the basic
question posed in a 2002 issue of the Journal of Health Care Chap-
laincy. While several of the contributors to that issue answered with
a resounding ‘‘Yes’’ (e.g., Burton, 2002; Fitchett, 2002; Handzo,
2002), many were ambivalent, and others were opposed to chaplaincy
becoming scientific. Some, such as McCurdy, were concerned that
science was too reductionistic, and that measurement might not
capture and might ‘‘even distort the very nature of pastoral care
itself’’ (McCurdy, 2002, p. 157).
Is chaplaincy becoming more scientific despite such resistance? A
review of all the articles published in the major pastoral counseling
journals from 1980–1989 found that only 5.3% of them were quanti-
tative studies (Gartner et al., 1990). Of the articles published in the
Journal of Pastoral Care—the flagship journal for the various chap-
laincy and clinical pastoral care associations in the United States—
only 4.7% were quantitative studies. We conducted a similar survey
for the years 1990–1999, but we used a more restrictive definition
of what to count as an article and we did not report the results for
individual journals (Flannelly, Liu, et al., 2003). Therefore, we
decided to redo our survey of 1990–1999 for the Journal of Pastoral
Care, using the identical criteria used by Gartner and his colleagues.
Based on new analysis, it appears that the proportion of quantitative
studies more than doubled to 11.9% in the 1990s. Another 4.7% were
qualitative studies, which would generally be excluded under Gartner
et al.’s criteria of what constitutes an empirical study. If we exclude
personal reflections from the base count of articles, as Flannelly,
Liu et al. (2003) did, the percentage of quantitative studies rises to
18.4%. Their findings suggest that chaplaincy is becoming more
scientific.
Weaver, Flannelly, and Liu 5
et al. (2004) found that studies such as these, in which religion was
not a major focus of the study, used less sophisticated measures of
religiosity than those that were designed to examine the association
between religion and health, specifically.
Levin and Schiller say in their historical analysis of the research up
to the mid 1980s: ‘‘Although many epidemiologists continue to
collect some information about subjects’ religious preference, back-
ground, or practice as part of their inquiries, next to nothing has been
accomplished in terms of the refinement of concepts or measures
(Levin & Schiller, 1987, p. 9–10). However, Flannelly et al.’s (2004)
analysis of studies published through the year 2000 found that the
number of questions used to measure religion increased over time,
suggesting the sophistication of the religious measures that research-
ers use has increased over the years.
As mentioned earlier, the various types of research methods or
designs (case studies, cross-sectional surveys, experiments, etc.) can
be thought of as forming a hierarchy. This hierarchy at least partly
reflects the degree to which different designs provide the capacity to
make causal inferences (Greenhalgh, 2001; Flannelly et al., 2004).
Case studies form the lowest rung of the ladder and true experiments
form the top rung. Cross-sectional studies, which include most
survey research, are located just above case studies in terms of their
sophistication. Longitudinal surveys, in which individuals complete
the same questionnaire at two or more points in time, are considered
more sophisticated because being able to track changes over time
is very important for making causal inferences. Flannelly and his
colleagues (2004) found that the research designs of studies on religi-
on and health have become more sophisticated over the years, partly
because of an increase in the number of longitudinal studies.
Flannelly et al. (2004) did not find any improvement in the sampling
procedures used in the field, such as the use of random samples instead
of convenience samples; they did find a significant increase in the use
of statistical controls, however. Statistical control means that charac-
teristics or attributes (i.e. variables) of a sample of people are measured
and analyzed that might not be of interest in and of themselves (such
as age, gender, income, education, etc.), but may confound or obscure
the relationships that one is interested in studying. For example, if one
wanted to look at the relationship between private prayer and
health, one would have to control for age of study participants since
older people are more likely to be religious and they are more
Weaver, Flannelly, and Liu 9
likely to be ill. One should always try to control for gender, age, other
major demographic characteristics, and any factors that are known to
be associated with either religiosity or health.
How sophisticated is the research published in chaplaincy and
related specialty journals? Flannelly, Liu et al. (2003) tried to answer
this question using a number of different criteria. Most (86.7%) of
the quantitative studies in their 1990–1999 sample from three journals
(Journal of Pastoral Care, Journal of Religion and Health and Pastoral
Psychology) were cross-sectional surveys, so the research is relatively
unsophisticated, at least by medical standards; cross-sectional surveys
are widely used in sociology and other social sciences. However, since
very few studies used statistical controls, the research tends to
unsophisticated by the standards of both medicine and the social
sciences. Ignoring one study that collected data on over 42,000 chap-
lain interventions, and another that examined religious themes in
over 17,000 articles published in medical journals, the sample size
of the survey studies ranged from 4 to over 5,000, with the median
being 160 participants. Sample sizes between 100 and 200 participants
are common in psychology, but larger samples are needed for surveys
when research questions are complicated, and many of the questions
one might ask about chaplaincy and pastoral care are inherently
complicated, especially in healthcare settings.
Flannelly, Liu et al. (2003) also evaluated the research in the field
using a set of criteria that were exactly the same criteria as those used
by Gartner et al. (1990). This allowed them to compare the results of
the two analyses directly, to see if research in the field was more soph-
isticated in 1990–1999 compared to 1980–1989. Table 1 makes that
comparison. Six measures of research sophistication are shown in
the table, which are broken into three categories: internal validity,
external validity, and interpretation.
Internal validity is a concept introduced by Campbell (1957),
which refers to the degree to which one can be confident about
making causal inferences from research conducted in experimental
and quasi-experimental settings. Whether or not a study used a
control group bears directly on this question. Control groups were
very rare in the 1980s and the 1990s because very few studies used
experimental or quasi-experimental designs.
The internal validity of a study also rests on the consistency or
reliability of the measurements made during an experiment. In the
case of mechanical and electronic equipment or instruments, this
10 JOURNAL OF HEALTH CARE CHAPLAINCY
Internal validity
Reliability 40 34
Control group 4 12
External validity
Sampling method 20 63
Response rate 33 43
Interpretation
Hypotheses stated 25 32
Limitations stated 4 58
Significant differences between the two samples: p < .05; p < .01.
Adapted from Flannelly, Liu, Oppenheimer, Weaver, & Larson (2003).
See text for details.
used, 82% reported response rates, and over 78% tested specific
hypotheses.
Our analyses indicate that the research published in pastoral care
and related specialty journals is relatively unsophisticated by the
standard of other disciplines, but it is improving. While we wish to
encourage this trend, we do not suggest that chaplaincy research
needs to follow the path taken by other disciplines who are investigat-
ing the link between religion and health. The methodology of chap-
laincy research still needs to improve, but there is plenty to learn
by surveying, interviewing and simply observing patients, families
and others in both healthcare and community settings. Indeed, we
have noticed that most of the people who suggest that chaplains
need to conduct experiments on the effectiveness of chaplain inter-
ventions, are not sophisticated about research, they are naı̈ve about
it. Studying processes must necessarily precede studying outcomes,
particularly when the processes and the outcomes are so complex,
and they are linked to many other factors.
answer them are selected by those outside the field, or directed from
the top-down. Clinical research is at its best when the research ideas
are generated by those working on the frontlines. Chaplains must
decide what questions to ask and how to try to answer them. When
doing so, it may be worthwhile to keep in mind that medical journals
do not contain studies about the effectiveness of physicians or
surgeons; they contain studies about the effectiveness of specific
medical treatments and procedures.
ACKNOWLEDGMENTS
The authors gratefully acknowledge the assistance of Research
Librarian Helen P. Tannenbaum and Research Assistant Kathryn
M. Murphy in preparing this article. The preparation of this article
was funded in part by grants to The HealthCare Chaplaincy
from the Henry Luce Foundation, the John Templeton Foundation,
and the Arthur Vining Davis Foundations.
REFERENCES
Babler, J. E. (1997). A comparison of spiritual care provided by hospice social work-
ers, nurses, and spiritual care professionals. Hospice Journal, 12(4), 15–27.
Burton, L. (2002). Chaplaincy is becoming more scientific. What’s the problem?
Journal of Health Care Chaplaincy, 12(1=2), 43–51.
Campbell, D. T. (1957). Factors relevant to the validity of experiments in social
settings. Psychological Bulletin, 54, 297–312.
Cavendish, R., Edelman, M., Naradovy, L., McPartlan Bajo, M., Perosi, I., &
Lanza, M. (2007, March). Do pastoral care providers recognize nurses as spiritual
care providers? Holistic Nursing Practice, 21(2), 89–98.
Emblen, J. & Halstead, L. (1993). Spiritual needs and interventions: Comparing the
views of patients, nurses, and chaplains. Clinical Nurse Specialist, 7(4), 175–182.
Fitchett, G. (2002). Health Chaplaincy as a research-informed profession: How we
get there. Journal of Health Care Chaplaincy, 12(1=2), 67–72.
Fitchett, G., Bradshaw, A. K., & Gibbons, G. D. (2003). Chaplains and research: I
feel a little excited. Ministry, Society, and Theology, 17(1,2), 90–104.
Fitchett, G. (1999a). Screening for spiritual risk. Chaplaincy Today, 15(1), 2–12.
Fitchett, G. (1999b). Selected resources for screening for spiritual risk. Chaplaincy
Today, 15(1), 13–26.
Fitchett, G., Meyer, P. M., & Burton, L. A. (2000). Spiritual care in the hospital:
Who requests it? Who needs it? Journal of Pastoral Care, 54(2), 173–186.
Weaver, Flannelly, and Liu 17
Fitchett, G., Murphy, P. E., Kim, J., Gibbons, J. L., Cameron, J. R., & Davis, J. A.
(2004). Religious struggle: Prevalence, correlates, and mental health risks in
diabetic, congestive heart failure, and oncology patients. International Journal of
Psychiatry in Medicine, 34(2), 179–196.
Flannelly, K. J., Ellison, C. G., & Strock, A. L. (2004). Methodologic issues in
research on religion and health. Southern Medical Journal, 97(12), 1231–1241.
Flannelly, L. T., Flannelly, K. F., & Weaver, A. J. (2002). Religious and spiritual
variables in three major oncology nursing journals: 1990–1999. Oncology Nursing
Forum, 29(4), 679–685.
Flannelly, K. J., Galek, K., Bucchino, J., Handzo, G. F., & Tannenbaum, H. P.
(2005). Department directors’ perceptions of the roles and functions of hospital
chaplains: A national survey. Hospital Topics, 83(4), 19–27.
Flannelly, K. J., Galek, K., & Flannelly, L. T. (2006). A test of the factor structure
of the patient spiritual needs assessment scale. Holistic Nursing Practice, 20(4),
187–190.
Flannelly, K. J., Galek, K., Tannenbaum, H. P., & Handzo, G. F. (2007a). A prelimi-
nary proposal for a scale to measure the effectiveness of pastoral care with family
members of hospitalized patients. Journal of Pastoral Care and Counseling, 61(1–2),
19–29.
Flannelly, K. J., Koenig, H. G., Galek, K., & Ellison, C. G. (2007b). Beliefs, mental
health, and evolutionary threat assessment systems in the brain. The Journal of
Nervous and Mental Disease, 195(12), 996–1003.
Flannelly, K. J, Liu, C., Oppenheimer, J. E., Weaver, A. J., & Larson, D. B. (2003).
An evaluation of the quantity and quality of empirical research in three pastoral
care and counseling journals, 1990–1999: Has anything changed? Journal of
Pastoral Care & Counseling, 57(2), 167–178.
Flannelly, K. J., Roberts, S. B., & Weaver, A. J. (2005). Correlates of compassion
fatigue and burnout in chaplains and other clergy who responded to the September
11th Attacks in New York City. Journal of Pastoral Care and Counseling, 59(3),
213–224.
Flannelly, K. J., Weaver, A. J., Smith, W. J., & Handzo, G. F. (2003). Psychologists
and health care chaplains doing research together. Journal of Psychology and
Christianity, 22(4), 327–332.
Galek, K., Flannelly, K. J., Vane, A., & Galek, R. M. (2005). Assessing a patient’s
spiritual needs: A comprehensive instrument. Holistic Nursing Practice, 19(2), 62–69.
Gartner, J., Larson, D. B., & Vachar-Mayberry, C. D. (1990). A systematic review of
the quantity and quality of empirical research published in four pastoral counsel-
ing journals. 1975–1984. Journal of Pastoral Care, 1990, 44(2), 115–123.
Greenhalgh, T. (2001). How to read a paper: the basics of evidence based medicine,
2nd ed. London: BMJ Books.
Handzo, G. F. (2002). Science and ministry: confusion and reality. Journal of Health
Care Chaplaincy, 12(1=2), 73–79.
Harding, S. R., Flannelly, K. J., Weaver, A. J., & Costa, K. G. (2005). The influence
of religion on death anxiety and death acceptance. Mental Health, Religion, and
Culture, 8(4), 253–261.
18 JOURNAL OF HEALTH CARE CHAPLAINCY