Brondani Gatas
Brondani Gatas
Brondani Gatas
Objective—To refine and test construct validity and reliability of a composite pain scale for
use in assessing acute postoperative pain in cats undergoing ovariohysterectomy.
Sample Population—40 cats that underwent ovariohysterectomy in a previous study.
Procedures—In a previous randomized, double-blind, placebo-controlled study, a compos-
ite pain scale was developed to assess postoperative pain in cats that received a placebo
or an analgesic (tramadol, vedaprofen, or tramadol-vedaprofen combination). In the present
study, the scale was refined via item analysis (distribution frequency and occurrence), a
nonparametric ANOVA, and item-to-total score correlation. Construct validity was assessed
via factor analysis and known-groups discrimination, and reliability was measured by as-
sessing internal consistency.
Results—Respiratory rate and respiratory pattern were rejected after item analysis. Fac-
tor analysis resulted in 5 dimensions (F1 [psychomotor change], posture, comfort, activity,
mental status, and miscellaneous behaviors; F2 [protection of wound area], reaction to
palpation of the surgical wound and palpation of the abdomen and flank; F3 [physiologic
variables], systolic arterial blood pressure and appetite; F4 [vocal expression of pain], vocal-
ization; and F5 [heart rate]). Internal consistency was excellent for the overall scale and for
F1, F2, and F3; very good for F4; and unacceptable for F5. Except for heart rate, the identi-
fied factors and scale total score could be used to detect differences between the analgesic
and placebo groups and differences among the analgesic treatments.
Conclusions and Clinical Relevance—Results provided initial evidence of construct valid-
ity and reliability of a multidimensional composite tool for use in assessing acute postopera-
tive pain in cats undergoing ovariohysterectomy. (Am J Vet Res 2011;72:174–183)
Σ
κ
to palpation of the surgical wound could be used to
α F = (k/[k – 1])•(1 – [{ •Ci2•si2}/s2TF]) identify pain but not to distinguish the placebo group
i=1 from the analgesic-treated group. Respiratory pattern
was the only item rejected at the first hour after the
where k is the number of items of the factor (although end of surgery because it could not be used to identify
each factor was represented only by items with factor the presence of pain nor distinguish the placebo group
loading > 0.5, the factor included all items of the scale), from the analgesic-treated group.
Ci2 is the square of the factor loading of i items, si2 is the
variance of i items, and s2TF is the total variance of the fac- Table 1—Results of item analysis of a composite pain scale
used for assessing acute postoperative pain in cats undergoing
tor. Factors that did not have minimally acceptable inter- ovariohysterectomy for evaluations conducted at the first hour
nal consistency were deleted from the scale, and the classi- after the end of surgery and at the second day after surgery in a
cal raw Cronbach α coefficient32 based on item correlation previous study.23
was calculated for the overall scale. Values for the α coeffi- First hour after Second day after
cient were categorized as follows: 0.60 to 0.64, minimally Item the end of surgery surgery
acceptable; 0.65 to 0.69, acceptable; 0.70 to 0.74, good;
HR CD B C D*
0.75 to 0.80, very good; and > 0.80, excellent.34 RR A C D* A B C D*
Respiratory pattern B C D* B C D*
Results SABP — B C D*
Posture — BD
Refinement of the composite pain scale (phase Comfort — B C D*
Activity — —
1)—Results were determined for phase 1.
Reaction to palpation of the — —
surgical wound
Item analysis Reaction to palpation of the — C
Items rejected in ≥ 3 of the statistical analyses were abdomen and flank
deleted from the scale (Table 1). Vocalization C B C D*
Mental status — C
Appetite C B C D*
Frequency distribution Miscellaneous behaviors — B C D*
Reaction to palpation of the surgical wound did Exclusion criteria were as follows: A = Frequency distribution,
not change over time. Low variability was observed for B = Occurrence distribution, C = Nonparametric ANOVA, and D =
respiratory pattern, vocalization, and miscellaneous be- Item-to-total score correlation coefficient.
haviors at the first hour after the end of surgery and for *Variable was excluded from the final version of the composite
pain scale because it was rejected in $ 3 statistical analyses.
respiratory pattern, SABP, posture, comfort, activity, vo- — = Not rejected in any statistical analysis.
calization, and miscellaneous behaviors at the second
Table 2—Spearman rank correlation coefficient for item score to total score of a composite pain scale for
use in assessing acute postoperative pain in cats undergoing ovariohysterectomy for evaluations conducted
at the first hour after the end of surgery and at the second day after surgery in a previous study.23
Factor loading*
Item Factor 1 Factor 2 Factor 3 Factor 4 Factor 5 Communality†
HR 0.056 0.005 0.021 –0.033 0.968‡ 0.942
SABP 0.179 –0.472 0.574‡ 0.333 0.278 0.773
Posture 0.848‡ –0.282 0.385 0.114 0.046 0.962
Comfort 0.860‡ –0.258 0.349 0.077 –0.008 0.934
Activity 0.815‡ –0.321 0.390 0.193 0.049 0.959
Reaction to palpation of 0.577 –0.629‡ 0.063 0.317 0.074 0.839
the surgical wound
*Factor loading represents correlations between the variables and factors. †Communality represents the
proportion of the variance for each item that can be explained by the factor. ‡Item was substantially loaded
for the factor.
NA = Not applicable.
Nonparametric ANOVA Figure 1—Schematic depiction of rank Spearman correlation coefficients for interfac-
Heart rate, RR, respiratory pattern, tors, factor-to-total score, and item-to-total score for a 4-factor model of a composite
vocalization, and appetite were rejected at pain scale for use in assessing acute postoperative pain in cats undergoing ovario-
hysterectomy. All coefficients reported were significantly (P < 0.001) different from
the evaluation conducted 1 hour after the 0. *Total score did not include the excluded items HR, RR, and respiratory pattern.
end of surgery. Comfort, activity, reaction
to palpation of the surgical wound, reaction to pal- ble 2). Heart rate, RR, and respiratory pattern were re-
pation of the abdomen and flank, mental status, and jected because their correlation coefficients were < 0.4.
miscellaneous behaviors could not be used to identify Item-to-total score correlation at the second day after
treatment with vedaprofen. At the evaluation on the surgery ranged from 0.074 to 0.892. Heart rate, RR, re-
second day after surgery, only reaction to palpation spiratory pattern, SABP, posture, comfort, vocalization,
of the surgical wound could be used to discriminate appetite, and miscellaneous behaviors were rejected.
treatment with tramadol or vedaprofen. Posture and
activity remained in the composite pain scale because Validity and reliability testing (phase 2)—Results
they could be used to distinguish between the times of were determined for phase 2.
assessment.
Construct validity of factor structure
Item-to-total score correlation coefficient Inappropriate items (RR and respiratory pattern)
Item-to-total score correlation at the first hour after were removed on the basis of the previously defined
the end of surgery ranged between 0.280 and 0.942 (Ta- criteria. Exploratory factor analysis was then performed
with the 11 remaining items for the evaluation at the pain) to 28 (maximum pain). Alternatively, the total fi-
first hour after the end of surgery. nal score could be adjusted to a scale of 0 to 100 by
Three components attained eigenvalues > 1.0 on multiplying the total score by 3.47 (ie, total score X
the unrotated factor solution; however, the interpre- [100/28] = adjusted score). This procedure can facili-
tation of the pattern matrix (with varimax rotation) tate the ranking of pain intensity because it is generally
resulted in a 5-factor solution with eigenvalue magni- accepted that when a scale of 0 to 100 is used, scores
tudes of 3.93, 1.72, 1.55, 1.45, and 1.12. All items had < 30, from 30 to 70, and > 70 are considered indicative
satisfactory factor loadings and communality (Table 3). of mild, moderate, and severe pain, respectively.
Factor-to-total score and interfactors correlations were The short form of the scale designed for use in eval-
high (Figure 1). uating acute pain during the late postoperative period
Dimensions were labeled F1 (psychomotor change (> 24 hours after surgery) was composed of 5 items
[posture, comfort, activity, mental status, and miscel- (posture, activity, mental status, reaction to palpation
laneous behaviors]), which accounted for 35.8% of the of the surgical wound, and reaction to palpation of the
total variance; F2 (protection of wound area [reaction abdomen and flank). The total score of this short form
to palpation of the surgical wound and reaction to pal- ranged from 0 (no pain) to 15 (maximum pain).
pation of the abdomen and flank]), which accounted
for 15.7% of the total variance; F3 (physiologic vari- Discussion
ables [SABP and appetite]), which accounted for 14.1%
of the total variance; F4 (vocal expression of pain [vo- The study reported here was focused on the refine-
calization]), which accounted for 13.2% of the total ment and initial psychometric evaluation of a com-
variance; and F5 (HR), which accounted for 10.2% of posite postoperative pain scale for cats. Reliability and
the total variance. validity of pain assessment tools are important criteria
when selecting instruments for use in clinical practice
and for research purposes.16 The results provided ini-
Construct validity of known-groups discrimination tial evidence of construct validity and internal consis-
The total score and scores for F1, F2, F3, and F4 tency of a multidimensional composite tool for use in
could be used to distinguish the placebo group from the assessing acute postoperative pain in cats undergoing
analgesic-treated group as well as to distinguish among ovariohysterectomy.
groups receiving the various analgesic treatments. Fac- Behavioral and physiologic measures have been
tor 5 (HR) could not be used to distinguish the pla- used to assess pain in cats in clinical and research set-
cebo group from the analgesic-treated group or to dis- tings.24,25,35 Although behavioral observation is the pri-
tinguish among groups receiving the various analgesic mary approach for the assessment of pain in animals,
treatments (Table 4). On the basis of this result, the physiologic indicators (such as increases in HR and
total score did not include values for HR or items re- SABP and changes in RR and respiratory pattern) can
jected in the item analysis (RR and respiratory pattern). be used to provide information about an animal’s re-
sponse to noxious stimuli.36 Therefore, construction of
Reliability of internal consistency the scale included the selection of behavioral and phys-
Internal consistency of each domain (subscale) iologic items supported by the relevant literature8,9,24–27
as expressed by the modified Cronbach α coefficient as well as pain behaviors observed in the previous
was excellent for F1 (0.8985), F2 (0.8841), and F3 study23 conducted to assess postoperative pain in cats.
(0.8025); very good for F4 (0.7662); and unacceptable Refinement of the pain scale by use of item analy-
for F5 (0.2835). On the basis of these results, HR was sis allowed the selection of the most appropriate items
removed from the composite pain scale. The Cronbach to measure pain in cats in the immediate and late (>
α coefficient for the overall scale with the remaining 24 hours after surgery) postoperative period. Resira-
items was 0.8672, which indicated excellent internal tory rate and respiratory pattern had poor performance
consistency. and were deleted from the scale. Although physiologic
The final version of the composite pain scale rep- measures are considered to be more objective than are
resented 10 items scored categorically and distributed behavioral measures, they generally have been incon-
in 4 domains (subscales; Table 5). The total score was clusive for use in determining the presence of pain in
based on a sum of 4 subscales and ranged from 0 (no animals37–40 and children.41 Hence, emphasis has fo-
Guidelines for use of the composite pain scale—The observer should choose only 1 value within each item that best fits the cat’s condition. Initially,
the cat’s behavior may be assessed from outside the cage. Observe whether the cat is at rest or moving, interested or not interested in its surroundings,
and silent or vocalizing. Then assess specific behaviors (miscellaneous behaviors). Open the door of the cage and call the cat’s name to encourage it
to approach to allow assessment of evoked behaviors and interaction with the observer. Assess its reaction (friendly, aggressive, scared, indifferent,
or vocal). Touch the cat and interact with it while observing whether it is receptive. If the cat is resting, encourage it to move by placing it in a standing
position. Observe whether the cat moves spontaneously or is reluctant to move. When possible, the cat should be removed from the cage to assess
activity. Observe the cat’s response after stimulating its interest in its surroundings by playing with it, offering it food, or talking to it. Gently place the cat in
lateral or ventral recumbency and measure SABP. Finally, assess the cat’s reaction when the area around the surgical wound is touched and then gently
pressed; perform the same procedure with the abdomen and flank, if appropriate.
*Categories were as follows: A = Satisfied (cat is alert and interested in its surroundings; it is friendly and interacts with the observer), B = Uninterested
(cat does not interact with the observer), C = Indifferent (cat is not interested in its surroundings), D = Anxious (cat is nervous or frightened and attempts to
hide or escape), and E = Aggressive (cat is aggressive and tries to bite or scratch the observer after the slightest manipulation). †The 4 behaviors were as
follows: the cat wags its tail excessively, contracts and extends its pelvic limbs or contracts the abdominal muscles, has partially closed eyes (ie, squinted
eyes), or frequently licks or chews the wound area. ‡Only for abdominal surgery. §It is necessary to record a preoperative (baseline) value for comparison.