Page 113 - DEDU504_EDUCATIONAL_MEASUREMENT_AND_EVALUATION_ENGLISH

Unit 8 : Test Construction

(c) marking schemes; Notes
(d) instructions;

(e) format and organisational pattern of questions;
(f) language and wording of questions; and
(g) mechanics of writing the questions.

A moderator who is not well trained in the technology of paper setting and role of
instructional objectives may spoil a good question paper set by a trained evaluator.

8.5.2 Moderators
(a) School-based Examinations
In term tests or annual examinations conducted by the school the moderation can be done in
different ways.
Moderation by Paper Setter Himself : Paper setter himself is the moderator and therefore it
is a quick review rather than a thorough moderation. Quality-control process lies with the
producer of the question paper. It is acceptable in unit testing and other class tests, where
the purpose of testing is formative and not summative. To improve the situation a check-list
can be prepared with the help of experts, for use in moderating the tests.
Moderation by a Co-class Teacher : Here the subject teacher of another section or class can
moderate the paper. Similar check list can be used by him for moderation. This brings some
externality in moderating the paper. Advantage of involving two teachers teaching the
same class or section is to utilise their experiences of teaching the same class.
Moderation by Senior Subject Teacher : A senior teacher of senior secondary classes can
moderate the paper of another teacher teaching the middle or secondary classes. Senior
teacher can discuss, ask for clarification, and get modifications accepted through mutual
discussions. Moreover, he acts as an external moderator.
8.5.3 External Public Examinations

Board examinations have high stakes of confidentiality because of significant role the public
examinations play in certification and selection of students for admissions and scholarships. This
requires appointment of external moderators more judiciously. For selection of moderator in
such external examinations, the moderator should possess the following qualities :
(i) must be a different person from that of a paper setter;

(ii) must be a subject specialist of long standing :
(iii) well conversant with the examination syllabus and instructional objectives;
(iv) trained in technology of paper setting; and
(v) a good item writer and item critic of proven ability.
8.5.4 Panel of Moderators
Sometimes a panel of 2 or 3 moderators is recommended when secrecy is not at stake. In that
case:
(i) subject specialist reviews the subject matter at the first-stage;
(ii) evaluation expert reviews the items to judge quality of items at the second stage; and

LOVELY PROFESSIONAL UNIVERSITY 107