3 SPM Instructions For Speaking Examiners V3
3 SPM Instructions For Speaking Examiners V3
3 SPM Instructions For Speaking Examiners V3
ENGLISH LANGUAGE
KPK
(National Chief
Examiner)
KPN
(State Chief
Examiners)
KPKw
(District Chief
Examiners)
PKw
(District
Examiners)
Speaking
Examiners
Training
All SEs must complete an annual training phase prior to the Speaking test window. This may
be conducted face-to-face or remotely. Regardless of mode of delivery, the following must
be covered in training:
Standardisation of Procedure
This focuses on ensuring examiners know how to administer the test in a
standardised manner.
Standardisation of Assessment
This focuses on ensuring that examiners are able to interpret the assessment scales
consistently and appropriately.
The Speaking Test is arguably the most challenging for examiners, in that they are involved
not only in the assessment of the candidates’ language but also in the generation of that
language.
Training may also periodically cover aspects such as preparing the test room, minimizing
security risks, catering for candidates with special requirements, completing mark sheets
and uploading of recordings for monitoring or double-marking activities.
Performance feedback
Feedback is provided to examiners following consideration of various aspects of their
performance.
Examiners must respond positively to guidance given in the context of training and/or
monitoring.
maintain the security and confidentiality of the Speaking test and assessment criteria
ensure that all candidates are treated fairly and in accordance with the instructions in
this booklet
be familiar with all relevant sections of this booklet
be familiar with the appropriate test procedure
be familiar with the appropriate test materials and use them as instructed
be familiar with the appropriate assessment criteria and apply them as instructed
familiarise themselves with all relevant updates and revisions as appropriate
be professional in their dress and behaviour, to meet candidate expectations.
Clothing should be clean and tidy. All electronic devices must be switched off.
Examiners should be supportive and flexible, as appropriate.
minimise security risks by:
varying the test materials, using the full range of tasks in the pack
ensuring that all test materials remain clean and unmarked
retrieving materials exactly as instructed in the interlocutor frame
ensuring that no test materials are taken out of their possession
checking with local centre staff before the examining session begins that
arrangements have been put in place to prevent contact between candidates who
have taken the test and those who are about to take it
maintaining the confidentiality of the examination materials throughout the
examining period and thereafter.
take the following to each examining session:
all the current test materials for the examination level
the current Instructions for Speaking Examiners booklet, which includes the
assessment scales
soft pencils, a pencil sharpener and an eraser
a reliable clock or watch which shows seconds, and which doesn’t have a loud
tick. Clocks/watches must not be set to emit noises to signal the timings of the
different parts of the test
examining assignment details
paper or a notepad for candidate names and timing of tests
post-it notes / rulers / sheets of plain paper for identifying the test packs to be
used in each test.
maintain a friendly but professional manner at all times with candidates and bear in
mind that all candidates should be treated in the same way.
create a non-intimidating atmosphere so as to encourage candidates to perform to
the best of their ability. This may involve making adjustments to furniture layout,
lighting and ventilation. The available furniture should be arranged in the most
suitable way possible, creating an informal but professional atmosphere. For
example, in a very large room the table used should be placed near the door, as
candidates can find it intimidating to have to walk the length of the room under the
gaze of examiners. It is important to check that the candidates, as well as the
examiners, have enough light to see the test materials clearly and that light is not
shining directly into the candidates’ eyes.
The appropriate arrangement of the Speaking test examination room layout is illustrated
below.
The Interlocutor (INT) should sit in front of the two candidates (who are sat side by side).
The Assessor (ASR) should sit to one side near enough that they can see and hear
everything clearly.
Speaking Examiner roles
Two Speaking Examiners are always required for the test.
Speaking Examiners must be familiar with the two different roles and responsibilities of
interlocutor and assessor. The assessor is the teacher from a nearby school/centre
appointed by the Assessment and Examination Sector in the State Education Department
(SPP, JPN) while interlocutors are teachers who teach in the candidate’s school/centre. The
Principal or School Administrator is responsible in appointing the interlocutor(s) and
arranging the interlocutors’ schedules throughout the Speaking exam period. The role of
interlocutor will be assigned by the head teacher within each school/centre.
The interlocutor manages the interaction in the test and assesses the candidates using the
overall spoken performance assessment scale. In order to deliver the test equally to all
candidates, the interlocutor must:
adhere strictly to the interlocutor frame and instructions, using the candidates’ names
correctly at the required points in the test. Research has shown that the use of
unscripted comments and asides creates an unfair test and can, therefore, have a
negative impact on a candidate’s performance.
keep a discreet eye on their clock/watch to ensure they keep to the prescribed
timings for all parts of the test
ensure that all candidates are treated fairly and are given an equal opportunity to
speak
follow the Missing Marks Checklist to ensure the assessor completes the marks fully
and accurately on mark sheets.
The assessor assesses the candidates’ performance using the analytical assessment
scales and is responsible for ensuring the mark sheets are completed accurately and fully. In
order to ensure all candidates are treated fairly, the assessor must:
sit a little to one side where s/he can see the candidates’ faces and is able to hear
the candidates clearly (see Figure 1)
listen to the candidates (but not distract them by engaging them in eye contact), and
take no active role in the interaction
finalise the analytical scales marks by the end of the test and enter them on the mark
sheets
make their assessments independently, using the appropriate scales. They must not
adjust their marks in light of those given by their co-examiner. Each Speaking
Examiner makes their assessment from a different perspective, using different
criteria. Both sets of marks are used to calculate the candidate’s final Speaking test
mark.
Level of interlocutor involvement
The interlocutor’s role in the Speaking tests is largely confined to setting up tasks and
delivering scripted rubrics. Certain principles of interlocutor behaviour should be borne in
mind, however, and should guide interlocutors where it may be necessary to intervene.
Equal opportunities
Care should always be taken to ensure that all candidates are given equal opportunities to
show their language abilities. This does not mean that candidates will necessarily contribute
equally, as their contribution is likely to reflect their ability, but they should have an equal
opportunity to take part. Adherence to the scripted rubrics ensures the appropriate level of
language input and equality of opportunity amongst candidates.
Eye contact
Eye contact suggests interest in what people are saying and is thus important in those parts
of the test where candidates are addressing the interlocutor. However, in order to encourage
candidate-to-candidate interaction, it may sometimes be necessary to withdraw eye contact
to prevent candidates addressing the interlocutor rather than their partner(s). The
interlocutor must be careful to ensure this is not interpreted as a lack of interest or
engagement with what candidates are saying.
Non-verbal redirection
Attempts to ‘help’ candidates who are slow to respond or reluctant to take part may not
always be helpful. Verbal intervention from the interlocutor, especially unscripted rephrasing,
can be a further source of confusion or lead to a break in concentration. Interlocutors should,
therefore, use eye contact and gestures in the first instance to indicate that, for example, one
candidate needs to take a fuller part, or that another aspect of the prompt material might be
addressed.
Redirection through prompting
When interaction has clearly broken down, or fails to develop initially, the interlocutor will
need to intervene. This should take the form of additional prompts to redirect the candidates
towards the tasks. Interlocutors must not appear to be taking part in the tasks themselves,
however, and so direct questions related to the material or topic under discussion must be
avoided. Redirection may take the form of:
Note: sample mark sheets are provided on pages 22 and 24 of this booklet.
The Interlocutor
The interlocutor uses the overall spoken performance scale and refers to it after the end of
the test (as well as while the candidates are involved in the collaborative tasks and possibly
during the long turns).
The interlocutor must be able to refer to the scale easily but out of view of the candidates.
The interlocutor uses the ‘Missing Marks Checklist’ (see overall spoken performance scale
page for details) to ensure that the assessor has entered analytic marks fully and accurately
(e.g. ‘Have you got two marks for …’)
The interlocutor asks whether the assessor has finished checking their mark sheets before
calling any further candidates in.
The Assessor
The assessor uses the analytical scales and refers to them constantly during the test.
The assessor finalises all the analytical marks and enters them onto the mark sheets by the
end of the test. Marks are entered directly onto their mark sheets out of view of the
candidates.
The assessor uses the ‘Missing Marks Checklist’ (see overall spoken performance scale
page for details) to ensure that the interlocutor has entered overall spoken performance
marks fully and accurately (e.g. ‘Have you got two marks for …’).
The assessor then carefully checks that all marks and other details have been entered on
their mark sheets. The omission of any of the required information or the addition of
unnecessary information may have an adverse effect on the accurate processing of
candidates’ results.
Where a test is being recorded for monitoring purposes it is also the responsibility of the
assessor to ensure the recording is made, is clear and is submitted to ES or the relevant
senior examiner, as instructed.
Both examiners
Examiners must not confer on the marks they award.
Examiners must not divulge marks to anyone, and no separate record of marks is to be kept.
Mark sheet completion
All examiners will be provided with a mark sheet with candidates’ names and index numbers
on the day of the exam, before the beginning of the first session. The details in the mark
sheet will be completed before the speaking test by the school/center. The mark sheet can
be downloaded from ES registration application.
Note: sample mark sheets are provided on pages 22 and 24 of this booklet.
All examiners must study the mark sheets (candidates’ numbers, date, Speaking Examiners’
numbers) carefully before examining to ensure details are correct.
Under no circumstances must a candidate’s marks be entered on a row bearing the name
and number of another candidate.
Completed mark sheets must be kept secure during the examining session. Marks must be
keyed in after each session of the speaking test by both examiners according to their roles.
Mark sheets should then be securely kept in the safety box located in the principal’s room by
following the guidance provided by ES.
Recording of tests
As mentioned above, schools may be required periodically to supply recordings of speaking
tests in order to ensure standardisation of assessment more broadly and as a means to
monitor SE performance.
Schools and SEs will be notified by ES in advance of the testing window for Speaking if this
will be required, providing details of how to submit recordings for review.
Recordings may also be used by senior examiners for more localised monitoring, again, you
will be notified by your senior examiner if this is required.
The notification will include instructions regarding how to submit materials (audio and mark
sheets).
The SPM Speaking test
This section outlines the design and content of the SPM English Speaking test.
The Speaking exam is one of four SPM components, each contributing an equal share to
candidates’ overall marks.
CEFR
Number of
Component Timing Task types Weighting main
items/parts
focus
interview
Speaking
individual long turn based on
25% of overall B1-B2
13 minutes text/verbal prompt
Paper 3 test parts candidate CEFR
Code:
(approx.) discussion based on mind grade range
map stimulus
1119/3
further discussion task
While the main focus of the test is B1-B2 levels, there is some allowance within the test
design and assessment criteria for levels below or above this range of proficiency (the scale
goes from A2 to C1 level descriptors).
The speaking test is intended to cover as wide a range of interaction patterns as feasible
within the practical limits of testing – examiner-candidate interviews, presentation-like ‘long
turns’, peer-peer discussion and further discussion led by an examiner.
Part 2 An individual long- Examiner asks candidate to speak Sustaining a long turn. Giving information of a
Individual turn task (1-2 for about 1 minute on a particular Managing discourse: non-personal kind.
long-turn minutes) with a topic related to the candidate’s Coherence and Talking about
task listening-candidate own experience, based on written clarity of past/present/future
3-4 minutes response question input in the form of a general message. experience.
(20-30 seconds). instruction and content-focused Explaining and giving
prompts. Then repeat for Organisation of reasons.
Candidate B with a different language and Expressing and justifying
task/theme. ideas. opinions.
Accuracy and Describing people,
Each candidate is also given a appropriacy of places and situations.
short response question on their linguistic Speculation (limited).
partner’s task topic. Naming personal
resources.
characteristics, objects
and activities.
Paraphrasing words and
ideas, if necessary.
Part 3 Discussion task Candidates are asked to speak on Turn-taking and Explaining and giving
Discussion (mind-map) a topic for about two minutes with responding reasons.
task a central focus question and appropriately. Exchanging information
Further surrounding ideas to help them. Negotiating. and opinions (likes/
discussion Initiating. dislikes, preferences,
task They are then given a decision Developing topics. experiences, habits,
4-5 minutes question to focus on and discuss etc.).
for 1 minute. Expressing and justifying
opinions.
Next, candidates are given one Negotiating agreement.
further minute to answer the final Making and responding
joint question. to suggestions.
Discussing alternatives.
1
In situations where a candidate is visibly distressed, interlocutors should consider if the test
should continue or be halted.
A1 Basic User Can understand and use familiar everyday expressions and very basic phrases aimed
at the satisfaction of needs of a concrete type. Can introduce him/herself and others
and can ask and answer questions about personal details such as where he/she lives,
people he/she knows and things he/she has. Can interact in a simple way provided the
other person talks slowly and clearly and is prepared to help.
A2 Can understand sentences and frequently used expressions related to areas of most
immediate relevance (e.g. very basic personal and family information, shopping, local
geography, employment). Can communicate in simple and routine tasks requiring a
simple and direct exchange of information on familiar and routine matters. Can
describe in simple terms aspects of his/her background, immediate environment and
matters in areas of immediate need.
B1 Independent Can understand the main points of clear standard input on familiar matters regularly
encountered in work, school, leisure, etc. Can deal with most situations likely to arise
User whilst travelling in an area where the language is spoken. Can produce simple
connected text on topics which are familiar or of personal interest. Can describe
experiences and events, dreams, hopes & ambitions and briefly give reasons and
explanations for opinions and plans.
Can understand the main ideas of complex text on both concrete and abstract topics,
B2 including technical discussions in his/her field of specialisation. Can interact with a
degree of fluency and spontaneity that makes regular interaction with native speakers
quite possible without strain for either party. Can produce clear, detailed text on a wide
range of subjects and explain a viewpoint on a topical issue giving the advantages and
disadvantages of various options.
Can understand a wide range of demanding, longer texts, and recognise implicit
C1 Proficient meaning. Can express him/herself fluently and spontaneously without much obvious
User searching for expressions. Can use language flexibly and effectively for social,
academic and professional purposes. Can produce clear, well-structured, detailed text
on complex subjects, showing controlled use of organisational patterns, connectors and
cohesive devices.
Can understand with ease virtually everything heard or read. Can summarise
C2 information from different spoken and written sources, reconstructing arguments and
accounts in a coherent presentation. Can express him/herself spontaneously, very
fluently and precisely, differentiating finer shades of meaning even in more complex
situations.
The assessment criteria used in SPM Speaking are derived from the CEFR A2-C1 levels.
For example, the SPM Bandscore 1 (A2 level) Overall Spoken Performance describes a
candidate being able to ‘give basic information on familiar topics using short phrases’ which
is intended to equate to being able to ‘communicate in simple and routine tasks requiring a
simple and direct exchange of information on familiar and routine matters’ at A2 level. At the
other end of the proficiency spectrum, Bandscore 6 (C1 level) Overall Spoken Performance
refers to a candidate being able to ‘ask and respond to questions and suggestions, including
those on abstract and complex topics’ which finds a parallel in C1 where it refers to being
able to ‘use language flexibly and effectively for social, academic and professional
purposes’.
Interlocutor Assessor
Overall
Spoken Grammar
Performance
Vocabulary
Communicative
competence
LEMBAGA PEPERIKSAAN
KEMENTERIAN PENDIDIKAN MALAYSIA
2 0 1 2 3 4 5 6
3 0 1 2 3 4 5 6
4 0 1 2 3 4 5 6
5 0 1 2 3 4 5 6
6 0 1 2 3 4 5 6
7 0 1 2 3 4 5 6
8 0 1 2 3 4 5 6
9 0 1 2 3 4 5 6
10 0 1 2 3 4 5 6
11 0 1 2 3 4 5 6
12 0 1 2 3 4 5 6
13 0 1 2 3 4 5 6
15 0 1 2 3 4 5 6
16 0 1 2 3 4 5 6
17 0 1 2 3 4 5 6
18 0 1 2 3 4 5 6
19 0 1 2 3 4 5 6
Name of
Signature Date
Interlocutor
LEMBAGA PEPERIKSAAN
KEMENTERIAN PENDIDIKAN MALAYSIA
2 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
3 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
4 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
5 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
6 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
7 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
8 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
9 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
10 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
11 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
12 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
14 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
15 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
16 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
17 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
18 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
19 0 1 2 3 4 5 6 0 1 2 3 4 5 6 0 1 2 3 4 5 6
Name of
Signature Date
Assessor
Can communicate with reasonable accuracy. Can express him/herself clearly though there
Can use a range of appropriate vocabulary to is some hesitation.
Can show a good degree of control of simple talk about everyday situations and familiar
3 grammatical structures and attempt some topics. Can initiate, maintain, develop and close a
complex grammatical structures. conversation with little difficulty.
Can convey relevant meaning but may have
Can form longer sentences and link them errors in vocabulary choice. Can ask for clarification and further details in
together using basic cohesive devices. order to move a discussion forward.
0
Performance below Band 1 / Candidate does not produce sufficient language to be assessed / Candidate uses language(s) other than English.