Checklist For Qualitative Research: Critical Appraisal Tools For Use in JBI Systematic Reviews
Checklist For Qualitative Research: Critical Appraisal Tools For Use in JBI Systematic Reviews
Checklist For Qualitative Research: Critical Appraisal Tools For Use in JBI Systematic Reviews
QUALITATIVE RESEARCH
Critical Appraisal tools for use in JBI Systematic Reviews
INTRODUCTION
JBI is an international research organisation based in the Faculty of Health and Medical Sciences at the
University of Adelaide, South Australia. JBI develops and delivers unique evidence-based information,
software, education and training designed to improve healthcare practice and health outcomes. With over
70 Collaborating Entities, servicing over 90 countries, JBI is a recognised global leader in evidence-based
healthcare.
© JBI, 2020. All rights reserved. JBI grants use of these Critical Appraisal Checklist for Qualitative Research - 2
tools for research purposes only. All other enquiries
should be sent to [email protected].
JBI CRITICAL APPRAISAL CHECKLIST FOR
QUALITATIVE RESEARCH
Reviewer ______________________________________ Date_______________________________
________________________________________________________________________________________________
________________________________________________________________________________________________
© JBI, 2020. All rights reserved. JBI grants use of these Critical Appraisal Checklist for Qualitative Research - 3
tools for research purposes only. All other enquiries
should be sent to [email protected].
DISCUSSION OF CRITICAL APPRAISAL CRITERIA
How to cite: Lockwood C, Munn Z, Porritt K. Qualitative research synthesis: methodological guidance for
systematic reviewers utilizing meta-aggregation. Int J Evid Based Healthc. 2015;13(3):179–187.
1. Congruity between the stated philosophical perspective and the research methodology
Does the report clearly state the philosophical or theoretical premises on which the study is
based? Does the report clearly state the methodological approach adopted on which the
study is based? Is there congruence between the two? For example:
A report may state that the study adopted a critical perspective and participatory action
research methodology was followed. Here there is congruence between a critical view
(focusing on knowledge arising out of critique, action and reflection) and action research (an
approach that focuses on firstly working with groups to reflect on issues or practices, then
considering how they could be different; then acting to create a change; and finally identifying
new knowledge arising out of the action taken). However, a report may state that the study
adopted an interpretive perspective and used survey methodology. Here there is
incongruence between an interpretive view (focusing on knowledge arising out of studying
what phenomena mean to individuals or groups) and surveys (an approach that focuses on
asking standard questions to a defined study population); a report may state that the study
was qualitative or used qualitative methodology (such statements do not demonstrate rigour
in design) or make no statement on philosophical orientation or methodology.
2. Congruity between the research methodology and the research question or objectives
Is the study methodology appropriate for addressing the research question? For example:
A report may state that the research question was to seek understandings of the meaning of
pain in a group of people with rheumatoid arthritis and that a phenomenological approach
was taken. Here, there is congruity between this question and the methodology. A report may
state that the research question was to establish the effects of counselling on the severity of
pain experience and that an ethnographic approach was pursued. A question that tries to
establish cause-and effect cannot be addressed by using an ethnographic approach (as
ethnography sets out to develop understandings of cultural practices) and thus, this would be
incongruent.
© JBI, 2020. All rights reserved. JBI grants use of these Critical Appraisal Checklist for Qualitative Research - 4
tools for research purposes only. All other enquiries
should be sent to [email protected].
3. Congruity between the research methodology and the methods used to collect data
Are the data collection methods appropriate to the methodology? For example:
A report may state that the study pursued a phenomenological approach and data was
collected through phenomenological interviews. There is congruence between the
methodology and data collection; a report may state that the study pursued a
phenomenological approach and data was collected through a postal questionnaire. There is
incongruence between the methodology and data collection here as phenomenology seeks to
elicit rich descriptions of the experience of a phenomena that cannot be achieved through
seeking written responses to standardized questions.
4. Congruity between the research methodology and the representation and analysis of data
Are the data analyzed and represented in ways that are congruent with the stated
methodological position? For example:
A report may state that the study pursued a phenomenological approach to explore people’s
experience of grief by asking participants to describe their experiences of grief. If the text
generated from asking these questions is searched to establish the meaning of grief to
participants, and the meanings of all participants are included in the report findings, then this
represents congruity; the same report may, however, focus only on those meanings that were
common to all participants and discard single reported meanings. This would not be
appropriate in phenomenological work.
5. There is congruence between the research methodology and the interpretation of results
Are the results interpreted in ways that are appropriate to the methodology? For example:
A report may state that the study pursued a phenomenological approach to explore people’s
experience of facial disfigurement and the results are used to inform practitioners about
accommodating individual differences in care. There is congruence between the methodology
and this approach to interpretation; a report may state that the study pursued a
phenomenological approach to explore people’s experience of facial disfigurement and the
results are used to generate practice checklists for assessment. There is incongruence
between the methodology and this approach to interpretation as phenomenology seeks to
understand the meaning of a phenomenon for the study participants and cannot be
interpreted to suggest that this can be generalized to total populations to a degree where
standardized assessments will have relevance across a population.
© JBI, 2020. All rights reserved. JBI grants use of these Critical Appraisal Checklist for Qualitative Research - 5
tools for research purposes only. All other enquiries
should be sent to [email protected].
6. Locating the researcher culturally or theoretically
Are the beliefs and values, and their potential influence on the study declared? For example:
The researcher plays a substantial role in the qualitative research process and it is important,
in appraising evidence that is generated in this way, to know the researcher’s cultural and
theoretical orientation. A high quality report will include a statement that clarifies this.
Is the potential for the researcher to influence the study and for the potential of the research
process itself to influence the researcher and her/his interpretations acknowledged and
addressed? For example:
Is the relationship between the researcher and the study participants addressed? Does the
researcher critically examine her/his own role and potential influence during data collection?
Is it reported how the researcher responded to events that arose during the study?
Generally, reports should provide illustrations from the data to show the basis of their
conclusions and to ensure that participants are represented in the report.
This criterion concerns the relationship between the findings reported and the views or words
of study participants. In appraising a paper, appraisers seek to satisfy themselves that the
conclusions drawn by the research are based on the data collected; data being the text
generated through observation, interviews or other processes.
© JBI, 2020. All rights reserved. JBI grants use of these Critical Appraisal Checklist for Qualitative Research - 6
tools for research purposes only. All other enquiries
should be sent to [email protected].