TRUSTWORTHINESS & INTEGRITY IN - You will not only interview the respondents once

but thrice to ensure that the response will be the

QUALITATIVE RESEARCH
same.
Lecturer: Marvie Joy Cabioc
EXPLICITNESS
Qualitative research is much more in terms of - The ability to follow the researcher’s decisions
methodology, it is just quite tricky when it comes to and interpretive efforts by means of carefully
clustering of the data. maintained records and explicitly presented
results.
Learnin objectives
By the end of the session, participants will be able to: VIVIDNESS
- Involves the presentation of rich, vivid, faithful,
• Discuss the relevance Of trustworthiness in and artful descriptions and highlight salient
qualitative evaluations themes in data.
• Justify the choice Of qualitative approach to be
applied to a particular evaluation CREATIVITY
• Develop a plan for establishing trustworthiness - Reflects challenges to traditional ways of
in a qualitative component of an evaluation thinking, as demonstrated through innovative
approaches to collecting, analyzing, and
Definition interpreting data.
- Words in research so that your readers will
know what you are trying to tell them, what you THOROUGHNESS
are trying to portray and the message of your - Refers to adequacy of the data as a result of
research, especially in qualitative research we sound sampling and data collection decisions
have to define terms that are not familiar (saturation), as well as the full development of
ideas.
VALIDITY
- "the state or quality of being sold, just, and well CONGRUENCE
founded" argued whether needed in qualitative - Interconnectedness between methods and
research question, between the current study and earlier
- A quality criterion referring to the degree to ones, and between the theory and approach;
which inferences made in a study are accurate also refers between study findings and contexts
and well-founded; in measurement, the degree outside the study situation.
to which an instrument measures what it is SENSITIVITY
intended to measure - Degree to which a research was done in a
- Meaning accurate, tama an research and tama manner that reflects respectful sensitivity to
an responses, something that is not fabricated and concern for the people, groups, and
FITTINGNESS communities being studied.
- Refers to the degree to which research findings
have meaning to others in similar situations.
- Later, they used the term transferability.
- Later on, they used the term auditability, a
concept that was later refined and called
dependability.
- For example, you are studying about the lived
experience of the nurses with meager pay either
in Indonesia or China, so different people but
using the same tool and questions. So, you can
transfer your tool, your methodology, your
research to other countries but would still have
the same results.

CRITICALITY
- Refers to the researchers’ critical appraisal to
every research decision.

INTEGRITY
- Demonstrated by ongoing self-reflection and
self-scrutiny to ensure that interpretations are
valid and grounded in the data. Criticality and
integrity are strongly interrelated and are
sometimes considered jointly.
GENERIC VS. SPECIFIC STANDARDS LINCOLN AND GUBA'S FRAMEWORK OF QUALITY
- generic standards for all versus specific CRITERIA
standards for different types of inquiry - Gold Standard for qualitative research
• argued that it depends on type of - Four criteria for developing trustworthiness:
qualitative tradition used o Credibility
• some believe there are some general o Dependability
criteria that are general to all of study o Confirmability
- There is a universal criteria in the naturalistic o Transferability
paradigm. Whittemore and associates (2001) - (parallel positivist paradigm – internal validity,
proposed four primary criteria that they viewed reliability, objectivity, and external validity)
as essential to ALL qualitative.
LINCOLN AND GUBA'S: CREDIBILITY
- Watson and Girard (2004) proposed that quality
- Confidence in the truth value of the data and
standards should be reflective of the research
interpretations of them
method used. and that they must be with the
- Two aspects:
philosophical supporting the research tradition
1. carrying out study in a way that enhances
endorsed."
the believability of the findings
- E.g. Grounded theory, phenomenology,
2. taking steps to demonstrate credibility to
hermeneutics, ethnography, descriptive
external readers
qualitative research, and critical research have
standards for specific forms of qualitative *Qualitative researchers must strive to establish
inquiry. confidence in truth of findings for the and contexts in
- There is a specific standard for a specific theory the research.

LINCOLN AND GUBA'S: DEPENDABILITY

- stability (reliability) of data over time and over
conditions
- would the studv findings be repeated if
the inquiry were replicated with the same
(Or similar) participants in the same (or
similar) contest?
- MCST have dependability to have credibility. if
there is no credibility, then there is no
dependability, same as saying if it is not valid.
not reliable

LINCOLN AND GUBA'S: CONFIRMABILITY

- Refers to objectivity, that is, the potential for
congruence between two or more independent
people about the or meaning-seek to establish
that the data represents the information
participants provided (not by the inquirer)
- MUST reflect participants voice, not
bias/motivations/perspectives of the researcher

LINCOLN AND GUBA'S: TRANSFERABILITY

- "generalizability" – extent to which qualitative
findings can be transferred to or have
applicability in Other settings / groups

LINCOLN AND GUBA'S: AUTHENTICITY

TERMINOLOGY PROLIFERATION AND CONFUSION - Extent to which researchers
- No common vocabulary for quality criteria in fairly/faith/fully/show a range of different
qualitative research (ex. truth, value. integrity.) realities
- hundreds of criteria have been suggested • emerges when it conveys the feeling
for evaluating quality of research tone of participants voices as they are
- Example, strategies are used to strengthen lived (put yourself in their shoes)
integrity of qualitative research. "points of - When a research is authentic, readers are
departure" for considering A study is sufficiently better able to understand the lives being
rigorous, trustworthy, insightful, or valid portrayed "in the round" (research) with some
sense of the mood, feeling, experience,
language, and context of those lives.
 - Understanding instead of judging about previous life experiences impact on
- You are representing a group of people phenomenon of inquiry
- For example, you are studying about women
QUALITY-ENHANCEMENT: STRATEGIES RELATING TO
who are victims of abuse or rape, the
CODING AND ANALYSIS
interviewer must not be an abuse or rape victim
Investigator and Theory Triangulation
themselves because there will be a bias in terms
- Triangulation offers opportunities to sort out
of the result.
“true” information from irrelevant or erroneous
- When we are representing people in our study
information by using multiple methods and
we should represent them well.
perspectives.
- Investigator triangulation refers to the use of
two or more researchers to make data
collection, coding, and analytic decisions.
• The underlying premise is that through
collaboration, investigators can reduce
the possibility of biased decisions and
idiosyncratic interpretations of the data.
• Conceptually, investigator triangulation is
analogous to interrater reliability in
quantitative studies, and is a strategy that
is often used in coding qualitative data.
• One form of investigator triangulation is
called stepwise replication, a strategy
most often mentioned in connection with
QUALITY-ENHANCEMENT: STRATEGIES DURING DATA Lincoln and Guba’s dependability
COLLECTION criterion. This technique involves having a
- Strategies to increase reader's confidence in the research team that can be divided into
integrity of study results two groups. These groups deal with data
1. prolonged engagement and persistent sources separately and conduct,
observation essentially, independent inquiries through
2. reflexivity strategies which data can be compared.
3. data and method triangulation - With theory triangulation, researchers use
4. comprehensive and vivid recording of competing theories or hypotheses in the
information analysis and interpretation of their data.
5. member checking - Theory triangulation can help researchers to
QUALITY-ENHANCEMENT: PROLONGED ENGAGEMENT rule out rival hypotheses and to prevent
- The investment of SUFFICIENT TIME collecting premature conceptualizations.
data to have an in-depth understanding Of the QUALITY-ENHANCEMENT: DATA AND METHOD
language, or Of the people or group under TRIANGULATION (OVERVIEW)
study - use of multiple referents to draw conclusions
• testing for misinformation and distortions about what constitutes truth
• ensure SATURATION of important - aim to overcome the intrinsic bias that comes
categories from a single-method/observer/ theory
- provides SCOPE - help capture a more complete picture of
QUALITY-ENHANCEMENT: PERSISTENT OBSERVATION phenomenon
- concerns the salience of the data being
DATA TRIANGULATION
gathered -researcher's focus on characteristics
- the use of multiple data sources for the purpose
or aspects of a situation that are relevant to the
of validating conclusions
phenomena being studied
- Three types:
- provides DEPTH
1. time
QUALITY-ENHANCEMENT: REFLEXIVITY STRATEGIES 2. person
- involves awareness that the researcher as an 3. space
individual brings to the inquiry a unique
Time Triangulation
background, set of values, and a
- involves collecting data on the same
social/professional identity that can affect the
phenomenon or about the same people at
research process
different points of time
- ex. may use a journal/diary to maintain
- -similar to test-retest relativity assessment
reflexivity - make notes to record thoughts
 - do NOT want to see how it changes, but to - Do we believe what the evaluator has reported?
establish a CONGRUENCE of the phenomenon - Menu of options: CREDIBILITY
over time 1. Prolonged engagement
- Multiple points of contact with the
Space Triangulation
participants
- involves collecting data on the same
2. Referential adequacy
phenomenon in multiple sites, to test for
- Method used to store raw data in
consistency
records to examine later and
Person Triangulation compare to other future studies to
- involves collecting data from different types or show the credibility of data
level of people with the aim of validating data 3. Triangulation
through multiple perspectives on the - Using multiple data sources and
phenomenon. methods in an evaluation to
ensure the best possible
METHOD TRIANGULATION understanding
- Involves using multiple methods of data 4. Peer debriefing
collection about the same phenomenon. - Having colleagues review and
- Multiple data collection methods provide an question your findings and
opportunity to evaluate the extent to which a emergent hypotheses to see if
consistent and coherent picture of the they seem reasonable and
phenomenon emerges. plausible.
DIFFERING SCHOOLS OF THOUGHT 5. Negative case analysis
How to assess quality - Data that may indicate that there
- Rigor and quality of qualitative data should be are different patterns for different
measured according to the same standards as groups of participants, or that
quantitative data (Morse, et al.) something is different in a certain
- Qualitative data should adhere to set standards case.
specifically designed for qualitative research 6. Member checks
(Kvale, Lincoln, Guba) - Going back to the participant and
- This should be assessed for each individual asking if they agree with the
study findings or if there are other
explanations for the findings
ESTABLISHING QUALITY - Menu of options: TRANSFERABILITY
Shaking up the establishment 1. Thick/rich descriptions
- Kvale (1989) questioned the appropriateness of • Participants’ voices
the "holy trinity of science" used in quantitative • Context
evaluation when applied to quantitative • Methodology
evaluation. - Menu of options: DEPENDABILITY AND
• Reliability CONFIRMABILITY
• Validity 1. Audit trail
• Generalizability • Raw data (notes, transcripts,
- The paradigm behind qualitative evaluation photos, etc.)
differs from quantitative evaluation. In • Data reconstruction and synthesis
qualitative evaluation, we acknowledge products (codebook)
multiple constructed realities. • Process notes (memos and notes)
TRUSTWORTHINESS IS BORN • Material relating to intentions and
dispositions (evaluation diaries and
reflexivity)

*Ekis na daw an internal validity, generalizability,

reliability ngan objectivity ha qualitative research kay
ginffollow na kuno naton ito nga new criteria hit
trustworthiness.

TRUSTWORTHINESS
How we have confidence in our findings
- To what extent can we place confidence in the
outcomes of the study?
A note of caution...
You may come across other evaluators who adhere to a
different paradigm

- Critical of trustworthiness for shifting the

responsibility from the evaluators to the reader
to decide it the findings are worthy of trust
- Most strategies to ensure credibility,
transferability. dependability, and confirmability
happen in the analytic stage, instead of during
the evaluation design or data collection stages

More strategies
- Verification strategies for establishing reliability
and validity in qualitative research (Morse. et
al., 2002):
• Investigator responsiveness
• Methodological coherence
• Theoretical sampling and sampling
adequacy
• An active analytic stance
• Saturation

SUMMARY
- Rigorous qualitative research adheres to
standards of:
• Credibility—have we measured what we
set out to measure?
• Transferability—how applicable are our
results to other subjects and other
contexts?
• Dependability—would our findings be
repeated if our evaluation were replicated
in the same context with the same
subjects?
• Confirmability—to what extent are Our
findings affected by interests and biases?