Book To See Bilingual Verbal Ability Test (BVAT) .
Book To See Bilingual Verbal Ability Test (BVAT) .
Book To See Bilingual Verbal Ability Test (BVAT) .
This manuscript has been reproduced from the microfilm master. UMI films the
text directly from the original or copy submitted. Thus, som e thesis and
dissertation copies are in typewriter face, while others may be from any type of
computer printer.
W
In the unlikely event that the author did not send UMI a complete manuscript and
there are missing pages, these will be noted. Also, if unauthorized copyright
IE
material had to be removed, a note will indicate the deletion.
EV
Oversize materials (e.g., maps, drawings, charts) are reproduced by sectioning
the original, beginning at the upper left-hand comer and continuing from left to
right in equal sections with small overlaps. Each original is also photographed in
PR
one exposure and is included in reduced form at the back of the book.
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
W
IE
EV
PR
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Copyright
by
W
August, 1999
IE
EV
PR
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
W
IE
EV
PR
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
A THEORETICAL AND EMPIRICAL STUDY
W
IE
In Partial Fulfillment
EV
o f the Requirements for the Degree
Doctor of Education
PR
by
August, 1999
R ep ro d u ced with p erm ission of the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
UMI Number: 9939678
W
Copyright 1999 by
Alvarado, Criselda Guajardo
UMI
300 North Zeeb Road
Ann Arbor, MI 48103
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
A THEORETICAL AND EMPIRICAL STUDY
Doctor of Education
by
W
Approved by Dissertation Committee:
7. IE
Dr. Kip T. Tellez, Chairperson
EV
nYolanda N. Padron, Committee Member
Q jl
Dr. Allen R. Warner, Dean
College o f Education
August, 1999
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
Acknowledgements
wonderful father, Elias Tam ez G uajardo for devoting his life to his family. Thank you
for the values you not only imparted, but demonstrated everyday o f your life. Thank you
W
for the motivation to continually pursue learning. Thank you for the love. This
Nicolas Antonio A lvarado, had to give up the most, a mother’s time, so that I could
PR
finish my doctoral work. Thank you from the bottom o f my heart. I am also most
fortunate to have a sister like Alma G u ajard o who helped me raise my children.
My life has been blessed with many extraordinary friends and colleagues. Special
thanks are due to Dr. A na M unoz-Sandoval for her wonderful advice, support, and
professional counsel. I would also like to thank Dr. R ichard W oodcock for encouraging
me to begin my doctoral work and providing guidance. M ary R uef must also be singled
iv
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
A THEORETICAL AND EMPIRICAL STUDY
An Abstract
of
A Dissertation Presented to the
Faculty o f the College o f Education
University of Houston
W
IE
In Partial Fulfillment
o f the Requirements o f the Degree
EV
Doctor of Education
PR
by
August, 1999
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
Alvarado, Criselda G. “A Theoretical and Empirical Study o f the English/Spanish
Bilingual Verbal Ability Tests.” Unpublished Doctor o f Education Dissertation,
University of Houston, August, 1999.
ABSTRACT
This study examined the English/Spanish Bilingual Verbal Ability Tests (B VAT)
associations with external criteria. Based on the premise that bilingual individuals have a
W
together with the knowledge unique to each language.
Index of the Wechsler Intelligence Scale for Children-HI (WISC-EU) (Wechsler, 1991),
the WJ-R COG, Perceptual Organization Index o f the WISC-HI, and Test o f Nonverbal
subtests o f the BVAT: Picture Vocabulary, Oral Vocabulary, and Verbal Analogies. The
vi
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout p erm ission .
BVA mean was compared to the mean scores o f the English and Spanish monolingual
verbal ability tests and found to be significantly higher for the total sample, but not
consistently higher for all bilingual groups. The BVA means across the bilingual groups
were compared to determine if the test consistently assessed BVA for students with
different levels o f bilingualism. Homogeneous BVA means were found for the bilingual,
English-dominant and balanced bilingual groups, but not for the bilingual Spanish-
dominant group. Finally, the comparison between the BVAT and the visual-spatial
examining the BVAT’s relation to other standardized tests, this study investigated the
W
educational uses and potential benefits o f the BVAT for bilingual students.
IE
EV
PR
v ii
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout p erm ission .
TABLE OF CONTENTS
Chapter Page
I. INTRODUCTION......................................................................................... 1
Assessment o f Culturally and Linguistically Diverse Students 2
Testing in English.......................................................................... 2
Testing in the Dominant Language.............................................. 3
Using Nonverbal Intelligence Tests............................................. 6
Testing BilinguaUy........................................................................ 6
Bilingual Verbal Ability Tests............................................................ 7
Research Questions............................................................................... 8
Purpose o f the Study .......................................................................... 11
Need for Studies on Bilingualism ................................................ 11
Educational Importance o f Studying the Bilingual Verbal
Ability Tests................................................................................... 12
W
Definition o f Terms ............................................................................. 14
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
m RESEARCH DESIGN AND METHODOLOGY........................................ 51
Objectives o f the S tu d y ......................................................................... 51
Hypotheses.............................................................................................. 52
Participants.............................................................................................. 54
Specific Student Identification P ro cess......................................... 55
School Selection Process................................................................. 58
Setting.............................................................................................. 58
Instrumentation and Procedures for Determining
Bilingual C ategories................................................................... 58
Procedures.............................................................................................. 60
Quantitative M easures....................................................................... 61
Bilingual Verbal Ability T ests..................................................... 62
Reliability and validity studies................................................ 63
Two-way verbal ability study.................................................. 64
Correction procedure for the “Dominance Effect” ................ 66
Correlational study between the Bilingual Verbal Ability
Tests and the Raven Standard Progressive Matrices............. 67
W
Intercorrelations o f the Bilingual Verbal Ability Tests 67
English Language Proficiency C lu ster........................................ 67
Spanish Language Proficiency C luster........................................ 68
Verbal Comprehension and Perceptual Organization Indices
IE 69
Visual Processing C lu ster..................................................................... 71
Tests o f Nonverbal Intelligence-3........................................................ 72
Data Analyses............................................................................................73
EV
Summary Statistics.............................................................................73
Intercorrelations................................................................................ 74
Group Differences........................................................................... 74
Supplemental T estin g .................................................................. 74
PR
IV RESULTS....................................................................................................... 75
Descriptive Statistics........................................................................ 76
Results of Hypotheses T estin g .......................................................... 81
Hypothesis 1: Subtests o f the Bilingual Verbal Ability Tests... 81
Hypothesis 2: The Bilingual Verbal Ability Tests and the
Monolingual Verbal Ability T e sts............................................... 82
Hypothesis 3: The Bilingual Verbal Ability Tests Across
Bilingual G roups............................................................................. 85
Hypothesis 4: The Bilingual Verbal Ability Tests and the
Visual-Spatial Performance M easures......................................... 87
Supplemental A nalyses..................................................................... 88
Summary Statistics and Intercorrelation of the Subtests o f the
Bilingual Verbal Ability T ests........................................................ 89
Descriptive Statistics by Grade and G ender.................................. 90
Correlations o f the Bilingual Verbal Ability Tests and the
Monolingual Verbal Ability T ests.................................................. 92
Exploratory Factor Analysis o f Verbal Ability and Visual-Spatial
Performance M easures................................................................ 94
iv
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
V. SUMMARY AND D ISCU SSIO N ......................................................................... 97
Discussion o f R e su lts........................................................................... 97
Hypothesis 1: Subtests o f the Bilingual Verbal Ability Tests ... 98
Interpretation o f results............................................................. 98
Implications................................................................................ 100
Hypothesis 2: Bilingual Verbal Ability Tests and Monolingual
Verbal Ability T e s ts....................................................................... 101
Interpretation o f results............................................................. 101
Implications................................................................................ 105
Hypothesis 3: Bilingual Verbal Ability Tests Across Bilingual
G roups.............................................................................................. 106
Interpretation o f results............................................................ 107
Implications............................................................................... 107
Hypothesis 4: Bilingual Verbal Ability Tests and the Visual-
Spatial Performance Measures.................................................. 108
Interpretation o f results............................................................ 108
Implications............................................................................... 110
W
Supplemental A nalyses......................................................................... 110
Summary Statistics o f the Subtests o f the Bilingual Verbal Ability
T e sts.................................................................................................. 110
Intercorrelations o f the Subtests o f the Bilingual Verbal Ability
IE
Tests by Bilingual G roups............................................................... I l l
Descriptive Statistics by Gender and Grade.................................. I l l
Correlations o f the Bilingual Verbal Ability Tests and the Verbal
Ability Tests Across Bilingual Groups........................................... 112
EV
Exploratory F actor Analy sis.......................................................... 112
Summary o f R e su lts................................................................................ 112
Lim itations............................................................................................... 113
Implications o f this Study....................................................................... 114
Educational Im plications.............................................................. 114
PR
REFERENCES................................................................................................................. 121
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
APPENDIX F .................................................................................................................. 148
W
IE
EV
PR
VI
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
LIST OF TABLES
Table Page
3 Summary Statistics o f the Seven Test Measures for the Total Sample 78
W
7 Tukey Post-Hoc Comparisons o f the Verbal Ability Tests for the Total
Sam ple............................................................................................................ 84
M easures........................................................................................................ 88
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
18 Pearson correlation M atrix o f the Verbal Ability Tests for the
Bilingual Spanish-Dominant G roup.............................................................. 94
W
IE
EV
PR
Ytii
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
LIST OF FIGURES
Figure Page
1 BVA Equation.................................................................................................... 48
W
IE
EV
PR
v iv
R ep ro d u ced with p erm ission of the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
CHAPTER I
INTRODUCTION
Alvarado, & Ruef, 1998a) are new aptitude tests that claim to measure bilingual verbal
ability (BVA), that is, the holistic verbal ability o f bilingual individuals (Munoz-
Sandoval, Cummins, Alvarado, & Ruef, 1998b). Based on the premise that bilingual
W
together with the conceptual/linguistic knowledge that is unique to each language
second and third grade students from two urban school districts participated in this study.
PR
The BVAT were compared to two English verbal ability tests, a Spanish verbal ability
correlational studies.
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
2
In recent years, educators and psychometricians have become acutely aware o f the
1988; Castellano, 1998, Cummins, 1980a, 1980b; Figueroa, 1989; Valdes & Figueroa,
1994). Current assessment practices are blamed for the overrepresentation o f culturally
and linguistically diverse students in special education programs (Ortiz & Yates, 1983;
Plata, 1993) and underrepresentation in gifted and talented programs (Cohen, 1990; Ortiz
& Yates, 1983; Saccuzzo, Johnson, & Guetin, 1994). Educators and scholars argue that
current tests and testing procedures designed for bilingual children are limited at best
W
(Figueroa, 1990; Nuttall, 1987; Perez & Ochoa, 1993), leading Figueroa (1989) to lament
IE
that “bilingualism is like random chaos for psychometrics” (p. 145).
identification, and program placement; using nonverbal intelligence tests; testing in the
1980b; Figueroa, 1989; Ortiz & Yates, 1983), and testing bilingually (Figueroa, 1989;
Testing in English
Testing bilingual children in English alone can lead to such psychometric issues as
bias, and lack of construct validity o f the measurement tools (Hamayan & Damico,
1991). The effects o f bilingualism have often caused a negative effect on assessment
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
results (Figueroa, 1985; Ortiz & Yates, 1983). Numerous studies have documented lower
scores on IQ tests, vocabulary tests, and achievement tests for bilingual students (Dean,
1979, Kush & Watkins, 1994, McEvoy & Johnson, 1989, Mishra, 1983, Olivarez,
Palmer, & Guillemard, 1992, Ortiz, Garcia, Holtzman, Polyzoi, Snell, Wilkinson, &
Willig, 1985, Vasquez & Nuttall, 1989). Alvarado (1999a) contends that assessing ability
in the bilingual’s second language often yields lowered scores because the bilingual
individual has not had the same amount o f language exposure as the test’s norming
population. Three professional organizations set forth the following statement regarding
W
students.
For a non-native speaker and for a speaker of some dialects of English, every test
IE
given in English becomes, in part, a language or literacy test. . . Test results may
EV
not reflect accurately the abilities and competencies being measured if test
Testing in the primary or dominant language of bilingual students has very similar
problematic issues as the testing bilingual students in English. The corollary o f the
AERA, APA and NCME statement above can read: every test given in Spanish becomes,
in part, a Spanish language or literacy test. Figueroa (1985) declares that the validity of
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
4
Testing bilingual children in their primary language leads to four testing options for
the test, use an interpreter, and/or use primary Ianguage-normed tests. The last option is
for a bilingual psychologists to conduct the testing either by translating the test or using
psychometric properties of the test can not be translated and often are lost (Figueroa,
W
1989). Figueroa uses the Mexico City Escala de inteligencia para nivel escolar Wechsler-
IE
Revisada (WISC-RM), the Spanish form of the Wechsler Intelligence Scale for Children-
Revised (WISC-R) (Wechsler, 1974a) to point out that the difficulty level o f a translated
EV
word is, in effect, not the same as in English. For example, in the Spanish form o f the
WISC-R, it was found that the vocabulary words needed reordering because o f different
difficulty levels.
PR
linguistically diverse students (Figueroa, 1985). Langdon (1989) defines the role of the
interpreter as one who conveys information from one language to another in the oral
modality, while a translator conveys information using the written modality. Research on
the effect o f interpreters in psychological testing is scant (Figueroa, 1989). Most who use
this assessment option, do so without knowing the affect on test results (Figueroa, 1989;
Langdon, 1989). Figueroa, Sandoval, and Merino (1984) state that the use o f interpreters
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.
5
in school psychology “is almost totally devoid o f research concerning the impact of this
The third option is to test in the student’s native language, however, this practice
can also have limitations. Alvarado (1999a) contends that testing in the native language
can yield lowered scores because the bilingual individual often has not had the native
language actively maintained or the bilingual individual may be experiencing the natural
raises validity questions (Figueroa, 1989). Rueda, Figueroa, Mercado, and Cardoza
W
(1984) found that the error rate for the U.S.-educated, Spanish-speaking students was too
IE
high on the Spanish System o f Multicultural Pluralistic Assessment (Spanish SOMPA)
and the Kaufman Assessment Battery for Children (K-ABC). Fifty-three percent o f the
EV
nonhandicapped students in the study could qualify for special education services with a
learning disabled label, while 46% of the currently labeled mentally retarded students
qualified instead as learning disabled. Pearson, Fernandez, and Oiler (1993) suggest that
PR
comparing verbal ability one language at a time neglects the totality o f the bilingual’s
abilities, especially the knowledge unique to each language. On the other hand, they
continue, to sum measures in the two languages fails to correct for abilities, if any, that
the child shares between the languages. Neither method is appropriate (Figueroa, 1989;
The statistics (Bernstein, 1989; Perez & Ochoa, 1993) regarding bilingual
R ep ro d u ced with p erm ission o f th e copyright ow ner. Further reproduction prohibited w ithout perm ission.
6
(Figueroa, Sandoval, and Merino, 1984). These are proficiency in the student’s primary
acquisition process, and knowledge o f assessment tools and techniques needed for
bilingual students.
The use o f nonverbal tests to reduce inequities is a common strategy (Perez &
Ochoa, 1993). Nonverbal measures are generally less influenced by language and culture
(Cummins, 1984), and are attractive to examiners. However, this strategy limits
W
II, language and cognition are so strongly interlinked that separation o f language from
IE
cognition severely limits the thinking process. Separation o f language from cognition in
testing severely limits the test’s capabilities to assess the thinking process.
EV
Testing Bilinguallv
existence of numerous and persistent irregularities in the test scores o f bilingual students.
PR
He concluded that the practice o f testing bilingual children in English or in the primary
bilingual pupils to “needless levels o f error and misdiagnosis” (pg. 145). Figueroa
advocates the testing o f bilingual children bilingually, but concedes that the technology
for doing this was currently not available. Figueroa is careful to differentiate between the
difference between testing in two languages and testing bilingually. Bilingual testing is
not simply assessing knowledge in the first and then the second language, but accessing
information shared by the two languages as well as information unique to either the first
R ep ro d u ced with p erm ission o f the copyright ow ner. Further reproduction prohibited w ithout p erm ission.