Edl Grammar Tests
Edl Grammar Tests
Edl Grammar Tests
35
- C H A P T E R THREE.
GRAMMAR TESTS
be checked without having them speak or write anything. This can be done by means of directed physical responses and visuals. This section presents two basic ways to measure the grammar skills of these beginning-level students: (1) testing them one at a time, and (2) testing them in groups.
Individual Testing
Grammar tests are designed to measure student proficiency in matters ranging from inflections (bottle-bottles, bake-baked) to syntax. Syntax involves the relationship of words in a sentence, including matters such as word order, use of the negative, ques tion forms, and connectives. Each of the four sections of this chapter covers a different approach to testing grammar. T h e first section, limited response, is especially useful for students at the beginning level. T h e remaining sections discuss multiple-choice completion, simple completion, and cloze tests. As indicated earlier, Part I of this book covers vocabulary, grammar, and pronunciation exams. Of these three, grammar tests seem to be the most popular. There are several reasons for this: Much ESL teaching has been based on grammar; and unlike various measures of communicative skills, there is general agreement on what to test. Grammar items, such as auxiliary verbs, are easy to identify, and errors in grammar can be quickly spotted and counted. As with vocabulary exams, either passive or active skills can be checked. Also, grammar can be tailored to beginners or advanced learners. Of course, in testing grammar, we dont pretend to measure actual communication. But we can do a good job of measuring progress in a grammar class, and we can diagnose student needs in this area.
You can test students individually by using oral requests, These requests can ask for easy spoken replies or simply for nonverbal actions. When teaching students who know almost no English, you can even permit answers in their native language.
Example: (studentshear in English) How many books are on the table? (students answer in their language) [There are] six.
Remember, of course, to use familiar vocabulary in your test questions as well as structures that students have been taught. For example, you may want to test understanding of the preposition between; so you tell a student to Put the red folder between the two green ones. But if he doesnt know what a folder is or what the command put means, he will miss the ques tion-even though he knows the preposition. When the numbers, colors, and familiar classroom objects are learned, then you can test, for instance, wh-questions confidently. You might ask, Where are the three yellow notebooks? or Which two pens are red? T h e beginning student can answer simply by touching L or pointing to the objects. Pictures like the one on the next page can be used to test students individually or in groups. T o test preposition recogni tion, we can ask, Is the lady on the house? Or we can say, Point to the child behind the car. Pictures can also be used to test other matters such as verb tense: If students can tell time, clock faces can show when each of a series of activities took place (for example, sketches of a man eating lunch at noon, working at 2:OO p.m., and driving home at
LIMITED RESPONSE
T h e grammar of students with very little ability in English can
34
Chapter Three
37
530 p.m.). T h e past tense can be evaluated by asking, What did he do before he went back to work? T h e picture on page 36 can also be used with more chal lenging questions; for example, (checking present progressive) What is the lady doing? (or checking the conditional) What would happen if she dropped the can of paint? (Several correct answers are possible.)
Group Testing You can also test students in groups by using directed physical
responses. T h e following drawing activity can test prepositions
of place: First, explain and illustrate any new vocabulary words.
Then have students make a drawing according to your spoken
instructions: Draw an airplane in the middle of the paper.
[Pause while students draw.] Now draw a house below the air
plane. [Pause.]Next draw a cloud in front of the airplane.
Using a picture like the first one in this chapter, you can test your students understanding of prepositions. For example, we can say, Draw a circle around the person on the house or Draw an X on the boy behind the car. Sets of three or four related pictures can evaluate mastery of a number of grammar points. Here is a set that tests the comparative:
(nonverbal) Circle the picture that illustrates this sentence: The boy is as big as the girl. Cyes-no) Look at picture B. Is the boy as big as the girl? (true-false) Look at picture C. The girl is taller thin the boy.
38
Chapter Three
Chapter Three
39
Normally we would use only one type of question on a test-all yes-no or all true-false, for example.
Advantages of Limited Response 1. It puts students at ease and avoids unnecessary stress.
kind of sentence context (or stem) for the grammar structure; (3) select three logical distractors; and (4) prepare clear, simple instructions.
Grammar Choice
2. It avoids skills such as reading and writing that have not yet been developed. 3. It can be scored easily and objectively.
Limitations of Limited Response 1. Individual testing takes longer than group testing. 2. It is difficult to find suitable pictures (although the teacher
can make needed sketches). 3. Only a limited number of grammatical structures can be tested.
MULTIPLE-CHOICE COMPLETION
T h e test type presented in this section includes an incomplete sentence stem followed by four multiple-choice options for com pleting the sentence. Here is an easy sample item:
(3.1) She
Choosing grammar points to test is usually rather easy: Just determine what structures you have taught since the last test. T h e results on quizzes or homework assignments can show those things that students have learned well and those things that need reviewing. T h e points they know well can be largely ignored. A few of these, however, could be included at the beginning of the test to encourage students. A related matter is how to give different weight to various grammar points. Lets say you spent three times longer on modal auxiliaries than on two-word verbs. You could prepare two or three times as many questions on the modals. This is part of the planning that is necessary. Before starting to write the questions, you need to decide how many of each grammar type to include.
Context Preparation
While multiple-choice completion is an efficient way to test grammar, teachers need to be cautioned about the temptation to use this kind of item for all of their testing needs. Many people are very excited about objective tests, feeling that multiplechoice objective exams in particular should be used to test every thing. However, any given test is a kind of tool; it may be very useful for some jobs but not for others. For example, while mul tiple-choice tests can be used successfully in testing grammar, they dont seem to work as well in testing conversational ability. Preparing multiple-choice completion grammar items fol lows about the same procedure as that described in Chapter 2 for writing multiple-choice completion vocabulary items: (1)Choose the grammar points that you need to test; (2) prepare the right
Lets assume that you have decided what points to test, what multiple-choice type to use, and how many questions to prepare. You are now ready to start writing the items. First, choose a structure and then use it correctly in a sentence. Remember, a good context is very important! Sometimes only a few words are enough, such as I dont want to go (in testing to plus verb). But notice how much context is needed for other, grammar points. In the following sentence, must is used to express a con clusion or deduction: Jimmy hasnt eaten anything, and he wont talk or play. He must be ill, When many of your test items require a lot of context like this, you will want to use a two-sen fence approach. The two-sentence item above has the same speaker saying both sentences.
Distractor Preparation
We are now ready for distractors. You will recall that these are the incorrect options which we put with the correct word or
40
Chapter Three
Chapter Three
41
phrase to complete the sentence. Experienced teachers usually have a good sense for what to use, but inexperienced teachers need some help. For example, could of has sometimes been used as a distractor for could have. This wont work, because it is a native English-speaker error and is almost never made by non-native English speakers. Also, avoid using distractors that sound alike. Look at this item from an inexperienced teachers test: -the ones who know the answers. *A. They are B. There C. Theyre D. Their This is really just a spelling item. It might be used on a writing test, but not on a grammar test. Another problem is that both A and C are correct options. It is also a good idea to avoid items that test divided usage, or items that only test different levels of formality.
(3.2) (poor)
Because we are discussing grammar tests, we will not discuss the errors in mechanics (spelling, capitalization, and punctuation) in this student essay. One of several grammar items that we can see is the tense error, which is circled. I study English should be I studied English. Prepare a question like the one below, if you have studied the past tense.
(3.4)
D. will study
If you have studied time words, you can use the error since one year, which is also circled:
(3.5) I lived with them __ one year.
D. while
-he sold it to. A. which B. who *C.whom D. why Debatable items like this just confuse non-native speakers. Notice that choice C is in the correct case. But choice B is closer to what native speakers would actually say. T h e easiest way of saying the sentence isnt even provided-dropping out the relative pronoun altogether (You can get it from the lady he sold it to). In addition, the whoiwhom choices tend to stick out as the obvious pair to choose from; and why is a very weak distractor. But even with this help, how can the inexperienced teacher write distractors that sound right? One way is to look at the errors that students make on exercises or cloze passages. These errors can be used as distractors. Another source of distractors is errors on compositions. Consider these:
(3.3) (poor) You can get it from the lady
And if you have taught relative clauses, you can use the error it which I like - now, which is circled in the essay:
(3.6) English
(Notice that choice D means that no word should be added.) So far, we have been looking for distractors that sound right. But there are other things to keep in mind also. It is good not to confuse or tire your students by having them reread unnecessary material. Take out any repeated words from the dis tractors and put these in the stem.
(3.7) (poor)
When I was in _Middle -chool 4 year ago I S . B u t ( z ) o n e year english and didnt like know Canada familie. -have many omortunitv for to practice my e z l i s h . Which I like
If I had a new fur coat, A. I showed it to everyone. *B. Id show it to efery one. C. Ive shown it to everyone. D. Ill show it to everyone. (better) If I had a new fur coat, it to everyone. A. I showed *B. Id show C. Ive shown D. Ill show
__.
42
Chapter Three
Chapter Three
43
In addition to having students identify the error, it is also possible to have them give the correct form (any in 3.11 and the Neth erlands in 3.12).
Advantages of Multiple-Choice Completion 1. It is impossible for students to avoid the grammar point being
evaluated. 2. Scoring is easy and reliable. 3. This is a sensitive measure of achievement (and like other multiple-choice language tests, it allows teachers to diagnose specific problems of students).
Limitations of Multiple-Choice Completion 1. Preparing good items is not easy.
the stem:
(3.9) Tom lives (A. at,
Center Street.
2. Dialog context.
(3.10) Did she ask you to go with her?
3. Error identification. Unlike previous test items in this section, error identification does nor require students to complete a sen
tence. Instead, they have to find the part containing an error. This kind of test question is particularly useful in testing gram mar points for which there are few logical options, such as the choice between few and a few, little and a little, some and any, much and many, or this and that.
2. It is easy for students to cheat. (It is possible to create a second form of the test by rearranging the items, but this is time con suming for the teacher.) 3. It doesnt appear to measure students ability to reproduce lan guage structures (although in actual fact this kind of test is a good measure of the grammar subskill). 4. This can have a negative influence on classwork if used exclu sively. (Students may see no need to practice writing if tests are objective.)
A
(3.11) One
*C D some money - the game. for (or) *A B C (3.12) I visited Netherlandslfor a week last yearlwhilel
44
Chapter Three
good instructions. But it is also necessary to decide what kind of simple-completion question to use. Some are easier than multi ple-choice completion, and some are much more difficult. Most of this section will deal with the three basic kinds of simple-com pletion grammar tests: (1) the option form, (2) the inflection form, and (3) the free-response form. These three forms vary not only in difficulty but also in objectivity and in the degree of active or passive response that is required. As a result, you can tailor the test to the students that you have. Your advance planning will determine which general ques tion type to use. If you need to check mastery of many structures, you will probably select multiple-choice completion. If you have to test sentence combining, word order, or sentence transfor mation skill, you can use a guided writing procedure.
(3.13) Combine these two sentences:
Chapter Three
45
(3.17)T h e
lost)
(3.18)T h e magician performed some
(astonishing, astonished) Often there are three or four choices listed, and at times even . more, __. For example, here is a nine-option completion item from . an ESL text. Students choose the best question word from among the following: who, whom, where, what, when, why, how many, how much, how.
~
QUESTION
ANSWER
She knew something. / He loved her. (Answer) She knew that he loved her. But if you want a quick way to check the mastery of a few specific points for only one or two classes of students, simple completion is ideal.
(3.14) He
Testing the mastery of inflections provides for a productive response. These vary from simple comparatives to verb tense questions:
(3.21)Hes the (tall) person in the class. (3.22)They M E C C (be) in Colorado last week.
bhd.--
The Option Form T h e easiest simple-completion items are like multiple-choice questions with only two options.
Directions: Complete the following sentences with do or make. (3.15) 1. H e made a lot of money last year. (3.16) 2. I always domy best.
This option form can easily be adapted from exercises in your textbook. Sometimes a new pair of options is given for each sentence.
When students have to write in their own answer like this, you have to be careful about context. For example, new teachers might think that if they write a sentence like He __ (sing) a song, only is singing will fit. If theyre testing the progressive, they may be disappointed to find that several other answers are possible, such as sings, sang, has been singing, had been singing, will sing, etc. This problem can be solved by giving partof the verb or adding more context.
(3.23)He is dlX+iJ+
(sing). (or) He i singing s now. (Add one word.) (3.24) Whats Tom doing now? Oh, he &Q$ (sing). Another technique is to use a separate blank for each word in the verb phrase:
46
(3.25) eH
Chapter Three
Chapter Three
47
were here, if we had some medicine for you. Obviously, this last kind of simple-completion question requires the most real productivity of all. It also provides flexibility; and it is perhaps the most communicative.
Advantages of Simple Completion (Sentences) 1. These are generally easier to prepare than are multiple-choice
Sometimes a few simple terms can be used, if everybody in the class knows what they mean. T h e free-response form illustrates how that common terminology can occasionally be used. Here are some sentences from an ESL text:
items. 2. These give the appearance of measuring productive skills because some items.permit flexibility and original expression. 3. There is no exposure to incorrect grammatical forms. 4. These provide a sensitive measure of achievement.
Limitations of Simple Completion (Sentences) 1. These are usually more time consuming to correct than are
Example: Add a question tag to these sentences: (3.26) Hamlet was indecisive, bl(acI nt he ? (3.27) Polonius knew a lot of aphorisms, dLdn\ he *
?2
It is good to use an example to make sure that no one is confused. Here are some illustrations from a widely used ESL text.
multiple-choice questions. Not only can poor penmanship be a problem but also irrelevant errors beyond those being tested. 2. Occasionally students can unexpectedly avoid the structure being tested.
Directions: Write in the missing part of the two-word verb. (3.28)Example: What time did he get .+this morning? Directions: Write in a two-word verb that has the same meaning as the key word. (3.29)Example: Jack + (arose) later than usual.3
T h e final example illustrates free response with a minimum amount of contextual control. (Here the conditional is being tested.)
(3.30)You would get better sooner if
CLOZE PROCEDURE
Cloze tests are prose passages, usually a paragraph or more in length, from which words have been deleted. T h e student relies on the context in order to supply the missing words. At the present time, no single test format is more pbpular than the cloze procedure. It is easy to prepare and rather easy to score. Teachers like it too because it is integrative-that is, it requires students to process the components of language simul taneously, much like what happens when people communicate. Moreover, studies have shown that it relates well to various lan guage measures-from listening comprehension to overall per formance on a battery of language tests. In brief, it is a good measure of overall proficiency. But as we have seen in the introductory chapter, proficiency tests such as the cloze do have some limitations. For one thing, they usually dont measure short-term gains very well. A good
___.
These take longer to correct than other completion types, and they also take more language skill to evaluate properly. Consider a few acceptable ways that students could complete example 3.30: if you dressed warmer, if youd see a doctor, if Mother
48
Chapter Three
Chapter Three
49
achievement test could show big improvement on question tags studied over a two- to three-week period. But a proficiency test generally would not show much if any improvement. Fortu nately a simple change in the cloze format can overcome this problem. After looking at regular cloze tests, we will discuss the modified cloze, which can evaluate grammar skills. Before examining how to prepare this kind of test, lets con sider briefly the principle that underlies it. T h e cloze is simply a story or essay from which a number of words have been deleted. We fill in the missing words much as we do while conversing. In a noisy restaurant, we guess at the words that we dont hear by relying on the whole conversation. So in cloze tests, the overall meaning and surrounding grammar help us replace the missing parts. Sentence-completion vocabulary and grammar items are similar in a way to cloze tests. Cloze passages simply have much larger contexts.
passage that is full of proper nouns, numbers, and technical words. When these are left out, it is often impossible to know what to write in. Also, we usually do not pick an article contain ing a lot of quoted material. The latter might not be at the same level as the rest of the passage. But if there are only a few trouble spots in a good selection, you can edit or rewrite them. With the passage chosen, you are ready to decide which words to take out. Leaving the first sentence or two and the last one as they are will help students understand the overall mean ing. Words are then taken out at regular intervals-the shortest interval being one in five (every fifth word deleted) and the long est one in ten. The most frequently used deletion is one in seven. Unless the passage is quite easy, the one-in-five deletion may not give enough context and the one-in-ten can be somewhat inef ficient. T h e following example shows that deleting every fifth word can make the passage too difficult for your students.
(3.31) (poor)
(Not enough context for this passage) We lost two superstars in 1977. Neither mans admirers have -able to understand the -of the other one. -this tells us something -the difference 4 between the __that the two singers -. (This is from a low-intermediate ESL reader. The missing words:.been, success, And, of, generations, represent.)
,
How many words need to be deleted altogether? If you use the test by itself, we suggest about 50 blanks. This will require a passage of just over 350 words. Better still would be two hfferent kinds of selections, with close to 200 words in each. But<ifyour cloze is part of a larger test, you may get by with 25 to 30 blanks. Naturally, more blanks make the test increasingly stable and reliable. An alternate form of this test is called selected-deletion cloze. Approximately the same percentage of words is removed. But now you can choose which words you want to leave outsuch as only the content words or only the function words. Another application is to take out every seventh word except for
so
Chapter Three
Chapter Three
51
duplications and proper nouns or numbers; when you find these, you can skip to the next word. In taking a cloze test, students can normally do better if they look over the whole passage first. Therefore, it is good to prepare instructions that mention this. Here is a set of directions for stu dents who have done cloze exercises in class:
Instructions: First, read over the whole story quickly. T h e n read it carefully and fill in the blanks. Finally read it again to see that your words make sense.
And here is a sample set for those who have not had practice with cloze:
There are a few special problems that come up when scor ing cloze. One of these is misspellings. Some teachers take off half a point for each different kind of spelling error. Many of us take off points for spelling only when it seems the required word is no longer recognizable. Then the student gets no credit for that answer. Another problem is bad handwriting. Here the same standard applies: no credit for words that the teacher cannot rec ognize. A third difficulty occurs when students use two or more words in the blank and the two words fit perfectly. Still no credit is given. Directions say that only one word is possible in each blank.
Adapting the Cloze to Test Grammar
Instructions: Here is a small story. Fifty words have been taken out of it. You must decide what goes in each blank. (1) Before you write anything, read the story quickly. (2) Then read it carefully and write a word in each blank. T h e word must fit the sentence. Write only one word in each blank. (3) When you fin ish, read over the story again and see if all of your words fit.
Scoring the Cloze There are two possible ways to score cloze tests. One is to give credit for only the exact word from the story. Another is to allow full credit for equivalent words as well. Both methods rank stu dents about the same, but students feel strongly that the second method is more fair. We recommend allowing full credit for equivalent words (but no partial credit for words that are a little off). We do not recommend that non-native speakers decide what equivalent words to use. If the test is very important, you can give the cloze to a group of native speakers. Any word that two or more of these native speakers put in any blank you can count as a good equivalent. But suppose you arent able to get people whose first language is English and you are a non-native speaker of English. Then use the exact-word scoring method, or ask a native English teacher to say which words are equivalents.
running slowly for long distances-become so popular? Donald Robbins, who is forty-two years old -(1) works in an office, began jogging -(2) few years ago because he felt - 4 3 ) was too fat. At first he - 4 4 ) only run about 100 yards, and -(5) took able to run a full him almost three months to -(6) two years later, he ran in -(8) east mile. -(7) ern marathon race-over twenty-six miles. -(9) you jog too? If you decide -(lo), be sure to ask your doctor -( 11) advice. Does jogging cost much? No, - 4 1 2 ) costs almost nothing. But most agree -(13) good run ning shoes are very important. -(14) protect your shock of running on hard feet and legs from -...-(15) surfaces.
52
Chapter Three
If you start jogging, it could make your heart stronger and also help you to feel better about your self. (Key: (1) and, (2) a, (3) he, (4) could, (5) it (antic ipatory pronoun), (6) be, (7) But, (8) an, (9) Should, (10) to, (11) for, (12) it (personal pronoun), (13) that, (14) They, (15) the.)
In preparing a selected-deletion grammar cloze like the one illustrated above, remember that it is not necessary to have exactly the same number of words between each blank. Be care ful not to delete the same word too many times.
Alternate Forms of Clore
ACTIVITIES
There are many variations of the standard cloze. These do not have a fixed ratio of word deletions from a prose passage. Here are three that are referred to in this book:
1, Multiple-choice cloze. (See Chapter 2, p. 23.) 2, Selected-deletion cloze. (See discussion directly above Adapting the Cloze to Test Grammar.) 3. Inflectional cloze. (See Chapter 2, p. 30.)
Advantages of Clore 1. It is easy to prepare and quite easy to score.
A. LIMITED RESPONSE. (See pages 34 to 38.) 1. Write out five items to test students individually. If possible, use grammar points from your students text.
a. Three commands should test prepositions of place (such as in, on, under, next to, between). b. Two items should test understanding of eitherlor questions (such as Am I sitting or standing?).
2. Choose two grammar points (preferably ones your students
2. It is a good measure of integrative English skills. 3. Standard cloze is a good measure of overall ability in English.
Limitations of Cloze 1. It is not a sensitive measure of short-term gains.
3. Test the past tense with an action picture and a clock face.
Provide the picture, the question, and the expected answer.
(Example: Tell what she did this morning.
She wrote a letter [at 9:OOl.)
2. It is difficult for teachers who are non-native English speakers to choose acceptable equivalent words.
53
54
Chapter Three
Chapter Three
55
4. Test the use of before or after as a subordinator. (Or you may choose another subordinator-one your students have studied.) Find or sketch a set of two or three pictures that show a sequence of activities. Then write out instructions that tell your students what to do. Include the sketches, instructions, and appropriate sample student answer (ExampZe: Before he ate, he washed his car ).
c. Since as an expression of time (as in Theyve been here since 1O:OO). d. A question tag (as in She works hard, doesnt she?).
C. SIMPLECOMPLETION (SENTENCES). (See pages 43 to 47.) 1. Write down as many words as you can (not phrases) that appropriately complete this sentence: He walked , . . the house.
2. Prepare four two-option form items testing the toolenough contrast (that is, too big to versus big enough to). Prepare good contexts. Include the answers.
>
3. Prepare four verb-inflection items-a different verb and verb tense for each item. Include the uninflected form. Supply the [drink] it this morning.) answers. (Example: She 4. Write four free-response items (see item 3.30). Each one should test a different grammar point. (One of these can be the conditional as in the example.) Name the grammar points being tested. Include two sample correct answers for each of the four items.
tomorrow?
A. ought to B. can *C. may
D. wouldnt
D. CLOZE PROCEDURE. (See pages 47 to 52.) 1. Write out the major problem that you see in the following cloze test. Disregard its short length.
There was much conflict in early Vermont. It remained an unbroken wilderness until , when a French officer established Fort ___ on Isle La Motte. In 1924 Massachusetts -fearing attacks by the , built Fort Dummer near the pres French and ent -of Brattleboro. The French forts at -and Crown Point were used as -for attacks. (Key: 1666, St. Anne, colonists, Indians, site, Chimney Point, bases)6
2. Construct a multiple-choice completion question for each of the following grammar points. Or choose five grammar points that you have taught to your students. Give the instructions and the answers.
a. T h e subordinator although (as in Although he was tired, he walked to work). b. Subject-verb agreement with some form of the verb be (as in One of the boys was here last night).
56
Chapter Three
2. Two different cloze passages were prepared from a single essay. T h e actual key to each test is listed here, though the essay is not printed. Compare their usefulness as grammar tests. Key #1: basically, drawings, called, reappear, story, a, a, a, of, outlined, page, of. Key #2: by, can, the, in, to, so, Their, of, who, a, the, have.
3. Prepare a full-length cloze test. It should test grammar, and it should be on the right level for your students. Write out the instructions and the passage (with numbered blanks). Include a key at the end. Optional activity: Administer the test and choose equivalent correct answers. Tell what they are and how you chose them.
ANSWER KEY
B1
a. repeated words; b. two correct answers; c. mixed grammar points; d. divided usage
D
1
too many proper nouns
D2