Page 1 of 19

Syllabus
Designing
AND Testing

Course Code
ENG465
Page 2 of 19
 Page 3 of 19

TABLE OF CONTENTS
SYLLABUS: ................................................................................................................................................ 6
DIFFERENCES BETWEEN SYLLABUS & CURRICULUM: ........................................................ 6
WHAT IS SYLLABUS DESIGN? ............................................................................................................. 6
SYLLABUS DESIGN: ............................................................................................................................ 6
Effective syllabus design considers the needs and goals of the student, the requirements of the subject or
discipline, and strategies that will be used to facilitate learning. .................................................................. 6
PRINCIPLES OF SYLLABUS DESIGNING:..................................................................................... 6
1) A LEARNING FOCUSED SYLLABUS: .................................................................................. 6
2) ORGANIZE YOUR SYLLABUS AROUND BIG QUESTIONS AND THEMES: .............. 7
3) INCLUSIVE AND MOTIVATING LANGUAGE: ................................................................. 7
4) SUPPORTIVE COURSE POLICIES: ...................................................................................... 7
5) ACCESSIBLE DESIGN: ............................................................................................................ 7
NEEDS ANALYSIS/ NEED ASSESSMENT: .......................................................................................... 7
NEEDS: .................................................................................................................................................... 7
NEEDS ANALYSIS: ............................................................................................................................... 7
THE PURPOSE OF A NEEDS ANALYSIS: ....................................................................................... 8
THE USERS OF NEED ANALYSIS: ................................................................................................... 8
THE TARGET POPULATION: ........................................................................................................... 8
PROCEDURES FOR CONDUCTING NEEDS ANALYSIS: ............................................................ 8
TOOLS/PROCEDURES FOR COLLECTING INFORMATION: ................................................... 9
1) QUESTIONNAIRES: ................................................................................................................. 9
2) SELF-RATINGS: ........................................................................................................................ 9
3) INTERVIEWS: ........................................................................................................................... 9
4) MEETINGS: ................................................................................................................................ 9
5) OBSERVATIONS: ..................................................................................................................... 9
KINDS OF ELT SYLLABUS: ................................................................................................................... 9
1) PRODUCT ORIENTED SYLLABUS: ......................................................................................... 9
i STRUCTURAL OR GRAMMAR (FORMAL) SYLLABUS: .............................................. 10
STEPS TO DESIGN GRAMMAR/STRUCTURAL SYLLABUS: .............................................. 10
ii A NOTIONAL-FUNCTIONAL SYLLABUS: ....................................................................... 10
STEPS TO DESIGN A NOTIONAL-FUNCTIONAL SYLLABUS: ........................................... 10
iii SITUATIONAL OR TOPICAL SYLLABUS: ....................................................................... 10
 Page 4 of 19

STEPS TO DESIGN A SITUATIONAL SYLLABUS: ................................................................. 11

2) PROCESS-ORIENTED SYLLABUS: ........................................................................................ 11
i A SKILL-BASED SYLLABUS: .............................................................................................. 11
STEPS TO DESIGN A SKILL BASED SYLLABUS:................................................................... 11
ii A TASK BASED SYLLABUS: ................................................................................................ 12
STEPS TO DESIGN A TASK BASED SYLLABUS: .................................................................... 12
iii A CONTENT BASED SYLLABUS: ....................................................................................... 12
STEPS TO DESIGN A CONTENT BASED SYLLABUS: ........................................................... 12
PRINCIPLES OF LANGUAGE TESTING: .......................................................................................... 13
1) VALIDITY: ................................................................................................................................... 13
2) RELIABILITY:............................................................................................................................. 13
3) AUTHENTICITY: ........................................................................................................................ 13
4) PRACTICALITY: ........................................................................................................................ 13
5) FAIRNESS: ................................................................................................................................... 13
6) WASHBACK: ............................................................................................................................... 13
TYPES OF TESTS: .................................................................................................................................. 14
1) PROFICIENCY TESTS:.............................................................................................................. 14
CONTENT: ....................................................................................................................................... 14
2) ACHIEVEMENT TESTS: ........................................................................................................... 14
PURPOSES: ...................................................................................................................................... 14
TWO KINDS: .................................................................................................................................... 14
ADVANTAGES: ............................................................................................................................... 14
DISADVANTAGES:......................................................................................................................... 15
A. FINAL ACHIEVEMENT TESTS: .......................................................................................... 15
B. PROGRESS ACHIEVEMENT TESTS: ................................................................................. 15
3) DIAGNOSTIC TESTS: ................................................................................................................ 15
PURPOSES: ...................................................................................................................................... 15
ADVANTAGES: ............................................................................................................................... 15
DISADVANTAGES:......................................................................................................................... 15
4) PLACEMENT TESTS: ................................................................................................................ 15
DESIGNING A VALID TEST: ............................................................................................................... 16
1) DEFINE THE PURPOSE: ........................................................................................................... 16
2) ESTABLISH TEST SPECIFICATIONS: .................................................................................. 16
 Page 5 of 19

3) ALIGN WITH LEARNING OBJECTIVES: ............................................................................. 16

4) DEVELOP TEST ITEMS: ........................................................................................................... 16
5) CONSIDER ITEM DIFFICULTY: ............................................................................................. 16
6) PILOT TEST THE ITEMS: ........................................................................................................ 16
7) ESTABLISH SCORING CRITERIA: ........................................................................................ 16
8) TRAIN TEST RATERS: .............................................................................................................. 16
9) CONSIDER TEST ADMINISTRATION:.................................................................................. 16
10) ANALYZE TEST RESULTS: ................................................................................................. 17
11) REVISE AND IMPROVE: ...................................................................................................... 17
12) REGULARLY REVIEW AND UPDATE: ............................................................................. 17
DESIGNING A RELIABLE TEST: ........................................................................................................ 17
1) CLEAR TEST SPECIFICATIONS: ........................................................................................... 17
2) STANDARDIZE ADMINISTRATION PROCEDURES: ........................................................ 17
3) TRAIN TEST ADMINISTRATORS: ......................................................................................... 17
4) PILOT TEST THE TEST: ........................................................................................................... 17
5) ITEM ANALYSIS: ....................................................................................................................... 18
6) SCORING CONSISTENCY: ....................................................................................................... 18
7) INTER-RATER RELIABILITY: ................................................................................................ 18
8) TEST LENGTH AND TIME LIMITS: ...................................................................................... 18
9) RANDOMIZE ITEM ORDER: ................................................................................................... 18
10) ANALYZE TEST RESULTS: ................................................................................................. 18
11) REVISE AND IMPROVE: ...................................................................................................... 18
12) REGULARLY REVIEW AND UPDATE: ............................................................................. 18
 Page 6 of 19

Subject: Syllabus Designing & Testing

Course Code: ENG465

SYLLABUS:
 A syllabus is an expression of opinion on the nature of language and learning.
 It acts as a guide for both teacher and learner by providing some goals to be attained.
 Summary of the content to which learners will be exposed” (Yalden, 1987).

DIFFERENCES BETWEEN SYLLABUS & CURRICULUM:

Syllabus Curriculum
 A subject syllabus is a unit of the  Curriculum is a combination of some
curriculum, Syllabus covers the portion factors which helps in the planning of
of what topics should be thought in an educational program.
particular subject.
 Syllabus is limited to particular subject  Curriculum is wider term as compared
of a particular class. to syllabus. Curriculum covers all the
activities and arrangements made by
the institution throughout the academic
year to facilitate the learner and
instructors.

WHAT IS SYLLABUS DESIGN?

SYLLABUS DESIGN:
Syllabus design is the process of creating a plan or outline for a course of study. It involves
identifying the objectives, Context, activities and assessments that will be used to guide and
evaluate student learning. Syllabus design is a critical aspect of teaching because it sets the
foundation for what will be taught and how it will be taught.

Effective syllabus design considers the needs and goals of the student, the requirements of the
subject or discipline, and strategies that will be used to facilitate learning.
A well-design syllabus provides students with a clear understanding of what will be covered in the
course, how they will be evaluated, and what is expected of them.

PRINCIPLES OF SYLLABUS DESIGNING:

1) A LEARNING FOCUSED SYLLABUS:
Content focused Syllabus Learning focused Syllabus
 What the Course will do? What the learner will do?
 What we (The class, including the
instructor) will do?
 How your Syllabus provides learning through your course?
 How much the resources that the student have?
 Page 7 of 19

 How to do evaluation of the students?

 What may be the confusing for your students?
 What we need to clarify?

2) ORGANIZE YOUR SYLLABUS AROUND BIG QUESTIONS AND THEMES:

“Wiggins & Mc Tighe” Define:
“Questions are those that push us to then heart of things”.
“Questions are those which serve as door-way through which learners explore the key concept
perhaps as yet unseen”.
3) INCLUSIVE AND MOTIVATING LANGUAGE:
Research has shown that students perceives their instructors to be warmer, more approachable and
caring when the syllabus is characterized by friendliness, enthusiasm, and anticipation of student
success.
4) SUPPORTIVE COURSE POLICIES:
Write your course in ways that will help students understand the rationale behind expectations,
norms and values.
 How supportive and motivating are your course policies?
 How do your course policies clarify important expectations and values?
 How do the course policies empower your students as learners and facilitate personal
coping skill?

5) ACCESSIBLE DESIGN:
The syllabus which are easy to read, have article, course schedule and table formation.

 Is your syllabus easy to read and navigate?

 Do you use images and visual representations of information?
 Is your syllabus accessible?

NEEDS ANALYSIS/ NEED ASSESSMENT:

NEEDS:
The term “need” is sometimes used to refer to wants, desires, demands, expectations, lacks and
requirements.

Needs in syllabus design are often described in terms of a linguistic deficiency, that is, the
difference between what a learner presently do in a language and what he or she should be able to
do.
NEEDS ANALYSIS:
Needs Analysis is directed mainly at the goals and content of a course. It examines what the learner
know already and what they need to know. Needs analysis makes sure that the course will contain
relevant and useful things to learn.
 Page 8 of 19

Good need analysis involves asking the right questions and finding the answer in the most effective
way.

Needs Analysis is required for designing a syllabus. A syllabus must according to the needs,
requirements, and expectations of the learner.
THE PURPOSE OF A NEEDS ANALYSIS:
Need Analysis may be used for a number of different purposes for example:

 To find out what language skills a learner needs in order to perform a particular role such
as Teacher, Sales Manager, Tour Guide or a Business man.
 To determine which students from a group are most in need of training in particular
language skills.
 To collect information about particular problems that learners are experiencing.
 To determine current levels of language proficiency of a learner.
THE USERS OF NEED ANALYSIS:
A Needs Analysis may be conducted by a variety of different users:

 Curriculum officers in the ministry of education. Who may wish to use the information to
evaluate the adequacy of existing syllabus, curriculum, and materials?
 teachers who will teach from the new curriculum
 learners, who will be taught from the curriculum
 writers, who are preparing new textbooks
 testing personnel, who are involved in developing end-of-school assessments •
 staff of tertiary institutions, who are interested in knowing what the expected level will be
of students exiting the schools and what problems they face
THE TARGET POPULATION:
The target population in a needs analysis refers to the people about whom information will be
collected.

 Teachers
 Students
 Academics
PROCEDURES FOR CONDUCTING NEEDS ANALYSIS:
A variety of procedures can be used in conducting needs analysis and that kind of information
obtained is often dependent on the type of procedure selected.
 Samples of student writing
 Test data on student performance
 Reports by teachers on typical problems students face
 Opinions of experts
 Page 9 of 19

 Information from students via interviews and questionnaires

 Analysis of textbooks teaching academic writing
 Survey or related literature
TOOLS/PROCEDURES FOR COLLECTING INFORMATION:
1) QUESTIONNAIRES:
Questionnaires are one of the most common instruments used. They are relatively easy to prepare,
they can be used with large numbers of subjects, and they obtain information that is relatively easy
to tabulate and analyze.

2) SELF-RATINGS:
These consist of scales that students or others use to rate their knowledge or abilities. (Self-ratings
might also be included as part of a questionnaire.)

3) INTERVIEWS:
Interviews allow for a more in-depth exploration of issues than is possible with a questionnaire,
though they take longer to administer and are only feasible for smaller groups. A structured
interview in which a set series of questions is used allows more consistency across responses to be
obtained. Interviews can be conducted face-to-face or over the telephone.

4) MEETINGS:
A meeting allows a large amount of information to be collected in a fairly short time. For example,
a meeting of teachers on the topic “students’ problems with listening comprehension” might
generate a wide range of ideas.

5) OBSERVATIONS:
Observations of learners’ behavior in a target situation are another way of assessing their
needs. However, people often do not perform well when they are being observed, so this has to be
taken into account. In addition, observation is a specialized skill. Knowing how to observe, what
to look for and how to make use of the information obtained generally requires specialized training.

KINDS OF ELT SYLLABUS:

There are two major types of Syllabus:

1) Product Oriented Syllabus

2) Process Oriented Syllabus

1) PRODUCT ORIENTED SYLLABUS:

Product Oriented Syllabus focuses on what the learner will know as a result at the end of the
instruction session. There are further three types of Product Oriented Syllabus:

i Structural or Grammar (formal) Syllabus

ii A Notional/Functional Syllabus
iii Situational or Topical Syllabus
 Page 10 of 19

i STRUCTURAL OR GRAMMAR (FORMAL) SYLLABUS:

The content of language teaching is a collection of the forms and structures usually grammatical
of the language being taught.

 It is based on the structure of language.

 Examples: Nouns, Verbs, Adjectives, Statements, Questions, Subordinate Clauses,
Present, Past, Future tense and so on.
STEPS TO DESIGN GRAMMAR/STRUCTURAL SYLLABUS:
 The teacher chooses the structure that the students have to learn according to the level and
the goals proposed in the course.
 The teacher chooses a set of vocabulary to be learned together with forms and structures.
 The teacher decides the main words according to the topics to be learned, for example:
Simple past tense, adverbs of time (Yesterday, last night, etc.), the use of the auxiliary
verbs: was, were, and so on.
 The teacher design exercises to put into practice the structure, vocabulary, and sentence
pattern (Complete, translate, rewrite etc.)

In this sense, students learn from simpler to more complex structures and they may learn the
structure more easily: however, students get worried about grammar in communicative activities
because they feel afraid to make mistakes.
ii A NOTIONAL-FUNCTIONAL SYLLABUS:
The Content of the language teaching is a collection of the functions that are performed when
language is used, or of the notions that a language is used to express.

 It provides best teaching method of rea l world language.

 A function is some kind of communicative act: it is the use of language to achieve a
purpose usually involving interaction at least between two people.
STEPS TO DESIGN A NOTIONAL-FUNCTIONAL SYLLABUS:
 The teacher makes a list of communication functions of the language that students will
learn (Expressing agreement and disagreement, greeting people, apologizing etc.)
 The teacher writes a list of the semantic notions (Meanings) based on the culture and the
context of the speakers of the language (Like and dislike, formal and informal greeting,
values etc.)
 The teacher applies the functions and the notions together into learning tasks for instance,
introducing yourself, expressing likes and describing family members.

An important aspect of the notional-functional syllabus is that students learn how to use the target
language to express their own ideas, notions, and points of view. This syllabus promotes language
learners using the target language.
iii SITUATIONAL OR TOPICAL SYLLABUS:
The content of language teaching is a collection of real or imaginary situations in which language
occurs or is used. A situation usually involves several participations who are engaged in some
 Page 11 of 19

activity in a specific meeting. In this syllabus the content are organized according to situations in
which students learn.

 The language occurring in the situation involves a number of functions, combined into a
plausible segment of discourse.
 The primary purpose of a situational language teaching is to teach the language that occurs
in specific situations. For Example: seeing the dentist complaining to the landlord, buy a
book, meeting a new students and so on.
STEPS TO DESIGN A SITUATIONAL SYLLABUS:
 The teacher makes a list of communication situations that will take place (The weather,
food and drinks, family life, free time activities and so on.)
 The teacher classifies the topics, forms and structures and fit them with communication
situations (One day on the beach, at the restaurant.)
 The teaching units below are language materials that have been developed based on
situational syllabus:
 At the Library
 At the Office
 At the Park
 At the Restaurant
 At the Party

This situational teaching has the goal of teaching specific language content that occurs in
situations.
2) PROCESS-ORIENTED SYLLABUS:
Process Oriented Syllabus focuses on the pedagogical process leading to the language outcomes.
There are further three types of Process-Oriented Syllabus:

i A Skill-Based Syllabus
ii The Task-Based Syllabus
iii Content-Based Syllabus

i A SKILL-BASED SYLLABUS:
This syllabus is based on the development of language skills (Listening, Speaking, Reading and
Writing) using the target language. Example of Skills in using the target language may include
reading for the main ideas, writing good paragraphs and listening for the main idea.
 The content of language teaching is a collection of specific abilities that may play a part in
using language.
 The primary purpose of skill based instruction is to learn specific language skills.

STEPS TO DESIGN A SKILL BASED SYLLABUS:

 The teacher makes a list of language skills that students need to acquire.
 The teacher makes a list of topics, grammatical forms, structures and vocabulary, and
sequences according to language skills.
 Page 12 of 19

 Listening the specific information.

 Reading and answering a questionnaire.
 Writing and replying to invitations.
 Talking about past events.
This is a syllabus where the students can develop their communicative competence using different
resources.

ii A TASK BASED SYLLABUS:

The content of language teaching includes a series of purposeful tasks that language learners need
to perform: task are defined as activities that are needed when using the target language.
 In this syllabus, learners carry out tasks such as solving a problems, or planning an activity.
 This syllabus promotes language practice.
 Tasks that can be used for language learning are generally tasks that the learners actually
have to perform in real life.
Example include: Applying for a job, talking with a social worker etc.

STEPS TO DESIGN A TASK BASED SYLLABUS:

 The teacher makes a list of abilities or tasks that students need to develop.
 The teacher writes a list of topics, grammatical forms, and vocabulary and sequences them.
 The teacher organize the topics, forms and structures and fits them with the tasks.

iii A CONTENT BASED SYLLABUS:

The primary purpose of instruction is to teach some content or information using the language that
the students are also learning.
In other words the learners use the foreign language to study other subjects such as science,
Mathematics, Biology etc. And this way, they learn not only the subject, but they improve their
language use at the same time.

STEPS TO DESIGN A CONTENT BASED SYLLABUS:

 The teacher chooses the topics from the content (subject), for example in Biology:
Ecosystem, cell, human body etc.
 The teacher makes a list of topics, grammatical forms and vocabulary in adjusts them to
the topics.
Subject: Biology.
Topic: Cell.
Vocabulary: Parts of the cell.
Structure: Simple present and present continuous tense.
 Page 13 of 19

PRINCIPLES OF LANGUAGE TESTING:

The principles of language testing are guidelines that dictate the design, administration, and
evaluation of language tests. These principles ensure that language tests are valid, reliable, fair,
and practical. Here are the key principles in detail:

1) VALIDITY:
Validity is an important feature in designing an effective test; it refers to the extent to which a test
measures what it intends to measure. "Test what you've taught" is a saying that illustrates what
validity means. Language tests must measure what they are intended to measure. Validity refers
to the extent to which a test accurately assesses the specific language skills or abilities it aims to
evaluate. To establish validity, test developers must align test content with the test's intended
purpose and ensure that the tasks and questions reflect the target language skills.

2) RELIABILITY:
Reliability is the degree to which an assessment tool produces stable and consistent results. Or the
degree of consistency of score of a test, when a test shows similar results reputedly.
Language tests should give consistent and dependable results. They should produce stable and
reproducible scores over time and across different test administrations.

3) AUTHENTICITY:
Language tests should resemble real-life language use and tasks as closely as possible. They should
reflect the language and communication situations that people encounter in everyday life.
Language Tests should reflect real-world tasks or situations that learners may encounter outside
the classroom. Authentic tasks provide learners with the opportunity to apply their knowledge and
skills in meaningful contexts, rather than just regurgitating memorized information.

4) PRACTICALITY:
Language tests should be practical and feasible to administer, score, and interpret within the
constraints of time, resources, and class size. Language Test developers consider factors such as
test length, administration time, availability of resources, and cost-effectiveness to ensure that the
test is practical for both test takers and test administrators.

5) FAIRNESS:
Language tests should be fair and unbiased to all test takers. Fairness refers to the absence of any
bias or discrimination in the test design, content, or administration that could disadvantage certain
groups of test takers. Test developers strive to eliminate any cultural, gender, or socio-economic
biases and ensure that the test provides equal opportunities for all test takers to demonstrate their
language skills.

6) WASHBACK:
Language tests should have positive educational impact. Washback refers to the influence that a
test has on teaching and learning practices. Test developers aim to design tests that promote
 Page 14 of 19

effective language learning and teaching by aligning test content with the language curriculum and
providing feedback that supports test takers' language development.
By adhering to these principles, language tests can provide valid and reliable measures of language
proficiency and effectively support language learning and teaching efforts.

TYPES OF TESTS:
In syllabus designing and testing, there are various types of tests that can be used to assess learners'
language proficiency and progress. Here are some common types of tests:
1) Proficiency tests
2) Achievement tests
3) Diagnostic tests
4) Placement tests

1) PROFICIENCY TESTS:
"Proficiency tests measure people's ability in a language, regardless of any training they may have
had in that language." Hughes, A. (2003)
This test measures a learner's overall language proficiency in a specific language. It assesses all
language skills (reading, writing, listening, speaking) and is often used for certification or
admission purposes.
CONTENT:
Base on a specification of what candidates have to be able to do in the language in order to be
considered proficient (having sufficient command of the language for a purpose)
E.g. test for a United Nations translator, test for a course of study in a British university, test of
arts, test of sciences.

2) ACHIEVEMENT TESTS:
PURPOSES:
This test evaluates learners' knowledge and skills acquired during a specific course or program. It
assesses their understanding of the content and their ability to apply it in different contexts.
Measure how successful individual students, groups of students, or the course themselves have
been in achieving objectives
TWO KINDS:
A. Final achievement tests
B. Progress achievement tests
ADVANTAGES:
Only contain what the learner has actually encountered a fair test
 Page 15 of 19

DISADVANTAGES:
 A badly-designed syllabus / badly-chosen book
 Misleading results of a test
 Unreal achievement of the course objectives
A. FINAL ACHIEVEMENT TESTS:
 Used at the end of a course.
 Written by ministries of education, official examining boards, or members of teaching
institutions.
 The test content can be based on a syllabus studied or a book taken during the course.
 Syllabus-content approach
B. PROGRESS ACHIEVEMENT TESTS:
 Measure the progress that students are making.
 Based on short-term objectives.

3) DIAGNOSTIC TESTS:
PURPOSES:
This test is used to identify specific strengths and weaknesses in a learner's language skills. It helps
teachers understand the areas that need further attention and tailor instruction accordingly.
 Identify learners' strengths and Weaknesses.
 Ascertain what learning still needs to take place
ADVANTAGES:
E.g. Analysis of a learner's performance in writing and speaking in terms of grammatical accuracy
or linguistic appropriacy.
DISADVANTAGES:
E.g. Difficulty in identifying whether a learner masters the present perfect/past tense distinction.

4) PLACEMENT TESTS:
This test is used to determine the appropriate level or course for a learner. It assesses the learner's
current language skills to ensure they are placed in the right class or level.
 Used to assign students to classes at different levels.
 No one placement test will work for every institution.
 The most successful one are those constructed for particular situations.
The choice of test type depends on the specific goals, context, and learners' needs. Different tests
serve different purposes, and a combination of these tests may be used to provide a comprehensive
assessment of learners' language abilities.
 Page 16 of 19

DESIGNING A VALID TEST:

Designing a valid test involves careful consideration of several key factors. Here is a detailed guide
on how to design a valid test:

1) DEFINE THE PURPOSE:

Clearly identify the purpose of the test. Determine what specific language skills or abilities you
want to assess and the intended use of the test results (e.g., placement, diagnosis, evaluation).

2) ESTABLISH TEST SPECIFICATIONS:

Create a detailed outline of the test, including the format, content, and structure. Specify the
number and types of tasks, the time limits, and the weighting of different sections or items.

3) ALIGN WITH LEARNING OBJECTIVES:

Ensure that the test aligns with the learning objectives or outcomes of the language course or
program. The test should reflect what learners are expected to know and be able to do based on
the curriculum.

4) DEVELOP TEST ITEMS:

Create a variety of test items that accurately measure the intended language skills. Use different
item formats such as multiple-choice, fill-in-the-blank, short answer, or essay questions. Ensure
that the items are clear, unambiguous, and represent the language skills being assessed.

5) CONSIDER ITEM DIFFICULTY:

Design test items that cover a range of difficulty levels. Include some easier and more challenging
items to differentiate between learners' proficiency levels and accurately assess their abilities.

6) PILOT TEST THE ITEMS:

Administer the test items to a small group of learners as a pilot test. Analyze the results to
determine the difficulty level, clarity, and effectiveness of the items. Revise or eliminate any
problematic items based on the pilot test feedback.

7) ESTABLISH SCORING CRITERIA:

Develop clear and specific scoring criteria or rubrics for each test item or task. Ensure that the
criteria align with the learning objectives and provide guidance for consistent and objective
scoring.

8) TRAIN TEST RATERS:

If the test requires human raters, provide training to ensure that they understand the scoring criteria
and can apply them consistently. Conduct regular calibration sessions to maintain inter-rater
reliability.

9) CONSIDER TEST ADMINISTRATION:

 Page 17 of 19

Design the test administration process to ensure fairness and minimize potential sources of bias.
Provide clear instructions to test takers and standardize the test administration procedures to ensure
consistent conditions for all participants.

10) ANALYZE TEST RESULTS:

After administering the test, analyze the results to evaluate the test's validity. Examine test scores,
item statistics, and patterns of performance to ensure that the test accurately measures the intended
language skills.

11) REVISE AND IMPROVE:

Based on the analysis of the test results, make necessary revisions to improve the test's validity.
Consider feedback from test takers, test administrators, and other stakeholders to refine the test
design and items for future administrations.

12) REGULARLY REVIEW AND UPDATE:

Continuously review and update the test to ensure its relevance and validity over time. Incorporate
feedback from teachers, learners, and other experts to enhance the test's effectiveness and
alignment with current language standards and practices.
By following these steps, you can design a valid test that accurately measures the intended
language skills and provides reliable and meaningful results.

DESIGNING A RELIABLE TEST:

Designing a reliable test involves ensuring consistency and dependability in the scores obtained
from the test. Here is a detailed guide on how to design a reliable test:

1) CLEAR TEST SPECIFICATIONS:

Clearly define the format, content, and structure of the test. Provide detailed instructions for test
administration, including time limits, scoring criteria, and any specific guidelines for test takers.

2) STANDARDIZE ADMINISTRATION PROCEDURES:

Ensure that the test is administered consistently to all test takers. Use the same instructions,
materials, and time limits for all participants. Minimize any potential sources of bias or variability
in test administration.

3) TRAIN TEST ADMINISTRATORS:

If multiple administrators are involved, provide thorough training to ensure they understand the
test procedures and scoring criteria. Conduct calibration sessions to ensure consistent application
of scoring guidelines.

4) PILOT TEST THE TEST:

 Page 18 of 19

Administer the test to a small group of test takers as a pilot test. Analyze the results to identify any
issues with item difficulty, clarity, or scoring. Revise or eliminate any problematic items based on
the pilot test feedback.

5) ITEM ANALYSIS:
Conduct item analysis to identify the difficulty level and discrimination of each test item. Remove
or modify items that are too easy or too difficult, as they may lead to unreliable scores. Aim for a
balance of item difficulty levels.

6) SCORING CONSISTENCY:
Develop clear and specific scoring criteria or rubrics for each test item or task. Provide
comprehensive guidelines to ensure consistent and objective scoring across different test
administrators or raters.

7) INTER-RATER RELIABILITY:
If multiple raters are involved, establish procedures to ensure inter-rater reliability. Conduct
regular calibration sessions to maintain consistency in scoring among different raters. Provide
feedback and clarification as needed.

8) TEST LENGTH AND TIME LIMITS:

Consider the length of the test and the time limits for each section or item. Ensure that the test
provides sufficient time for test takers to complete the tasks without feeling rushed. Avoid overly
long or short time limits that may affect performance.

9) RANDOMIZE ITEM ORDER:

If applicable, randomize the order of test items to minimize any potential order effects. This helps
ensure that the order of items does not influence test takers' scores.

10) ANALYZE TEST RESULTS:

After administering the test, analyze the results to evaluate the test's reliability. Calculate measures
such as internal consistency (e.g., Cronbach's alpha) or inter-rater reliability (e.g., Cohen's kappa)
to assess the consistency and agreement of scores.

11) REVISE AND IMPROVE:

Based on the analysis of the test results, make necessary revisions to improve the test's reliability.
Consider feedback from test takers, test administrators, and other stakeholders to refine the test
design and items for future administrations.

12) REGULARLY REVIEW AND UPDATE:

Continuously review and update the test to ensure its reliability over time. Incorporate feedback
from teachers, learners, and other experts to enhance the test's consistency and dependability.
 Page 19 of 19

By following these steps, you can design a reliable test that produces consistent and dependable
scores, providing a solid basis for evaluating learners' language proficiency or progress.