PAPER

TESTING LANGUAGE SKILLS IN WRITING AND TESTING LANGUAGE

COMPONENT IN GRAMMAR AND VOCABULARY
Lecturer : Sri Suci Suryawati, [Link]

Arranged by Group 6 :
Ade Maulana Yusuf (2211040150)
Aliful Azizah (2211040157)
Fema Serly Anjani (22110402402211040240)
Ipon Nopiansah (2211040053)
Najwa Aurel Nathania (2211040093)
Siti Febriani Putri (2211040133)

ENGLISH EDUCATION STUDY PROGRAM

TARBIYAH AND TEACHER TRAINING FACULTY
RADEN INTAN STATE ISLAMIC UNIVERSITY
2024

1
 FOREWORD

Alhamdulillah, praise and thanks be to Allah Ta'ala. for His abundance of grace
and grace so that the paper entitled, "Testing Language Skills in Writing and Testing
Language Component in Grammar and Vocabulary" can be completed properly. We hope
that this paper can increase knowledge and experience for readers about what violations or
errors commonly occur in everyday language. Likewise, for the abundance of health and
opportunities that Allah SWT has given us so that we can compile this paper through several
sources, namely through literature review and through internet media.
On this occasion, we would like to thank all those who have encouraged us and
motivation in making this paper assignment. To our parents who have contributed a lot for us,
my supervisor, Sri Suci Suryawati, [Link]. We hope that the information and material contained
in this paper can be useful for readers. There is nothing perfect in the world, but Allah SWT.
God is the Most Perfect, therefore we ask for constructive criticism and suggestions for the
improvement ofmy next paper.
If there are errors in writing, or there is a discrepancy in the material we raise in this
paper, we apologize. The drafting welcomes the widest possible criticism and suggestions
from readers in order to make better paper work on the next occasion.

Bandar Lampung, 27 October 2024

Authors

ii
 LIST OF CONTENTS

FOREWORD ...................................................................................................................... ii
LIST OF CONTENTS ....................................................................................................... iii
CHAPTER 1........................................................................................................................ 1
INTRODUCTION .............................................................................................................. 1
A. Background of The Paper ........................................................................................ 1
B. Problem Formulation ............................................................................................... 1
C. Purpose of the Paper ................................................................................................ 1
CHAPTER II....................................................................................................................... 2
DISCUSSION ...................................................................................................................... 2
A. Definition, Method, and Challenges of Testing: Writing ........................................ 3
1.1. Definition of Testing Language Skill in Writing ............................................... 3
1.2. Method of Testing Language Skill in Writing ................................................... 4
1.3. Challenges of Testing Language Skill in Writing .............................................. 9
B. Definition,Method, and Chllenges of Testing: Grammar .....................................10
2.1. Definition of Testing Language Component in Grammar ..................................10
2.2. Method of Testing Language Component in Grammar ......................................11
2.3. Challenges of Testing Language Component in Grammar .................................12
C. Definition, Method, and Challenges of Testing: Vocabulary .................................13
3.1. Definition of Testing Language Component in Vocabulary ...............................13
3.2. Method of Testing Language Component in Vocabulary...................................14
3.3. Challanges of Testing Language Component in Vocabulary .............................16
CHAPTER III ....................................................................................................................19
CLOSING ..........................................................................................................................19
A. Conclusion ...............................................................................................................19
REFERENCES ..................................................................................................................20

iii
 CHAPTER I

A. Background of the paper

Being able to communicate effectively in a language is essential in today's
increasingly international society. As people move through a variety of settings, including
social, professional, and academic ones, the capacity to express ideas precisely and
concisely becomes crucial. Determining a learner's language competency largely depends
on the evaluation of their language proficiency, especially in writing, grammar, and
vocabulary.
Testing Language Skills in Writing is a multifaceted skill that encompasses not
only the formulation of ideas but also the ability to structure them coherently. Effective
writing requires a mastery of various elements, including organization, clarity, and style.
Assessing writing skills allows educators to gauge a student's ability to convey meaning
effectively, engage an audience, and adapt language to different contexts. This aspect of
language testing is crucial as it reflects a student's overall proficiency and readiness to
communicate in real-world situations.
Testing Language Component in Grammar serves as the backbone of any
language, providing the rules and structures that govern how words combine to convey
meaning. Testing grammar knowledge is essential for understanding a learner's ability to
construct sentences accurately and effectively. Proficient grammar usage not only aids in
clarity but also enhances the credibility of the writer. By examining grammar as a
language component, educators can identify specific areas where learners may struggle,
thereby facilitating targeted instruction and improvement.
Testing Language Component in Vocabulary is integral to language mastery, as it
encompasses the range of words an individual knows and can use appropriately. A robust
vocabulary allows for nuanced expression and comprehension, enabling learners to
engage with a variety of texts and contexts. Testing vocabulary skills helps assess a
learner's ability to understand and utilize words effectively, which is crucial for both
written and spoken communication. Through vocabulary assessments, educators can
provide students with the tools they need to enhance their expressive capabilities.
The assessment of writing, grammar, and vocabulary is essential for a
comprehensive evaluation of language skills. Understanding these components not only
aids in identifying areas for improvement but also equips learners with the necessary
skills to thrive in diverse communicative contexts. This study aims to explore the
interconnections among these components and their impact on overall language
proficiency, providing insights that can enhance language education strategies.

1
B. Problem formulation
1. What is testing language skill in writing. and vocabulary?
2. What is testing language component in grammar?
3. What is testing language component in vocabulary?

C. Purpose of the paper

1. Knowing about definition, types, method and challenge testing language skill in
writing.
2. Knowing about definition, types, method and challenge testing language component
in grammar.
3. Knowing about definition, types, method and challenge testing language component
in vocabulary.

2
 CHAPTER II
DISCUSSION

A. Definition, Method and Challenges of Testing Language Skill in Writing.

1.1. Definition of Testing Language Skill in Writing
Writing is a process to deliver someone’s feelings, arguments and ideas that is felt
by the writer into the paper by constructing the words. It can be used as media to
communicate with others through written form. Writing plays important role to help
people communicate with others in this modern era. It can be seen in human daily life
activities when people need to communicate with others in written form, people usually
use an application of short message like Whatsapp and Line to share their feelings or their
ideas. Writing is not only about constructing the words into the sentence, linking the
sentence into the paragraph, but also requires the grammatical and lexical knowledge. As
one of the four language skills, writing is very crucial to be learned by students in the
school. The aims of this skill is to allows the students convey their ideas, feelings, and
opinions on paper in the written form through well structure.
Many experts have argued about the definition of writing. Wingersky (as cited in
Hidayati, 2018, p. 23) states, “writing is a process of communicating with others in which
the writers send his ideas and thoughts in written form to the readers”. In this case, the
writers should produce a sequence of sentences and clear statement to make the readers
understand the meaning what the writer wants to say. In line with Wingersky, Mandal (as
cited in Molla, 2016,p. 11) states that through writing process the students get
opportunity to share ideas and convey their feelings. It means that writing is a tool that
commonly used by a writer to give information to the readers. Furthermore, according to
Richard and Schmidt (2010, p. 640—641) writing is a process to write the ideas through
complex processes from planning, drafting, reviewing, and revising and also teach the
students how to use those complex processes. It described the students in writing process
will show many things such as the way of thinking, process from planning to revising the
word into sentences form with well structure. It aims to make the readers easier to
understand what the writers mean. Thus, both of them can make a communication. From
the explanation above, it can be assumed that writing is a process delivering an idea,
imagination and feeling which are developed by using sentences which describe the
meaning of writer wants to convey through complex process1.
Testing is a universal practice in the world and it has been modified due to the
different changes in Education. Testing helps teachers to verify people’s abilities,
strengths, weaknesses in a certain area and it can be carried out considering the level of
the tested person by means of an instrument where results will be interpreted according to
an established score (MacNamara, 2000). Bachman and Palmer (1996) state that testing is
a process with a variety of considerations which have to be taken into account in order to
develop an appropriate test. Also they argue that this process has to be considered not

1
Arthur Hughes, Testing for Language Teachers, (Cambridge: Cambridge University Press:2003), p. 234

3
 only in the development of international and national tests, but also for classroom tests
because it is where commonly language learning and teaching happens. For that reason,
testing influences teaching since it involves to follow a procedure when designing
different types of tests which have to be directly related to the objective of the course
syllabus, qualities, structure, techniques to be used, scoring processes, and interpretation
of the results. Hedge (2000) claims that writing is the result of employing strategies to
manage the composing process of a text. Such process involves a number of activities;
for instance: setting goals, generating ideas, organizing information, selecting appropriate
language, making a draft, reading and reviewing, then revising and editing. For that
reason, writing often seems to be the hardest of the skills, even for native speakers of a
language, since it implies not only a graphic representation of speech, but the
development and presentation of thoughts in a structured way2.
Testing Writing Skills is the process of evaluating a person's writing ability, which
includes various aspects such as grammar, spelling, sentence structure, coherence, and the
ability to convey ideas clearly and orderly. This evaluation can be done through various
forms, such as essay tests, summaries, or functional text creation, and aims to measure
the extent to which test participants are able to write effectively according to the given
context. ( Hughes, Arthur. Testing for Language Teachers. Cambridge: Cambridge
University Press, 2003.) According Brown (2004) : Testing writing skills is the process of
measuring participants' ability to produce written texts by paying attention to aspects of
comprehensibility, cohesion, grammar, and appropriateness to specific communication
goals. (Brown, H. Douglas. Language Assessment: Principles and Classroom Practices.
Pearson Education, 2004) So it can be concluded that Writing Skills Testing is a process
that aims to evaluate a person's ability to write. This process includes various aspects,
such as grammar, spelling, sentence structure, coherence, and the ability to convey ideas
clearly and orderly. This testing can be done in various forms, such as essay exams,
summaries, or functional text creation. The main goal is to measure the extent to which
the test taker is able to write effectively according to the given context. Thus, writing
skills testing not only measures the technical aspects of writing, but also the ability to
communicate appropriately and in accordance with certain goals 3.
1.2. Method of Testing Language Skill in Writing
1. Multiple choice
Teachers use multiple choice items when they want to test writing ability in order
recognize sentences that are grammatically correct and it is useful for finding out the
difficulties that the students have with certain areas of grammar.
However, according to Weir (1993), multiple-choice items present a problem because
only one option has to be selected as the best answer between various options that
function as distracters.
There are some features to construct multiple-choice items and they have to be
based on:

2
J.C. Richards, Second Language Writing. 2n Ed, (Cambridge: Cambridge University Press, 2005), p.222
3
Brown. H. Douglas, Language Assessment: Principles and Classroom Practices,(Pearson Education:2004), p.232

4
 1. “They should have only one correct answer.
2. Only one feature at a time should be tested. For example, two grammatical
functions could not be tested at the same time, if tenses will be taken into
account only that point has to be considered and no more.
3. Each option should be grammatically correct. For example,
He __________ to the movies every day.
a) goes b) went c) go d) going
4. All multiple-choice items should be at a level appropriate to the proficiency
level of the testers.
5. Items should be as brief and clear as possible.
6. Items are arranged in rough order of increasing difficulty. In other words, it has
to be started with easy statements and finish with complicated ones” (LELI, 2002.
p. 24).
This technique is one of the most common used because it is easy to mark as
Harmer (2005) mentions. Multiple choice exercises are easy to score and require little
time from teachers to do it. Unfortunately, this type of activity does not represent a
writing task as a whole and as Weir (1993) sustains, this activity, such as true-false
task, is distrust because the answers could be guessed or get the right answer
eliminating the wrong ones. Therefore, multiple-choice improve only the training in
test taking techniques rather than any enhance in language ability.
2. Error-recognition items
In error recognition items, teachers can use their students’ errors that they normally
make in their writings. Teachers can select some sentences, then four words or
phrases and underlines them and from those sentences, the students will choose the
correct one and this one can be considered as a kind of multiple choice item. For
example:
1. Select the underlined word or phrase which is incorrect or unacceptable.
I do hope you wouldn’t mind waiting for such a long time.
AB C D
As well Heaton (1990) describes another option where students are told there is a
grammar mistake in each sentence and correct it over the word it occurs; so this
type of item is more useful for testing errors because of the omission of articles.
See the example below:
1. There is a mistake in grammar in each of the following sentences. Write the
letter of that part of the sentence in which it occurs.
Sun / is shining / brightly today, / isn’t it?
AB C D

3. Re-arrangement
For the re-arrangement technique, teachers provide students unscrambled sentences
and ask the students to write each sentence in the correct order, with this type of item
the teacher can test the order of adjectives, the position of adverbs, inversion,

5
connectors, pronouns and other areas of grammar.
1. We live in a_____________.
old / big / wood made / house / black / scary
2. Not only _____________.
/the examination/ very difficult/ unfair/ was/ but/ it/ was/ also/
This last arrangement can be used for sentences and as well as for words and
phrases, usually this kind of task is used for testing connectives and reference
devices (Ramírez and García, 2010).
4. Changing Words
Changing words is different from the others mentioned before, because the
teacher only asks the students to write verbs in the correct tense or in the correct
voice. Two examples are given next in order to understand better the technique.
1. Researchers (1) to convince that a drug they (2) to test can improve the
memory and that it (3) to be the forerunner of other drugs which eventually (4)
to improve mental ability.
1_____ 2_____ 3______ 4______
2. Students who were given the drop for a fortnight did considerably (1. well) in
test than others. The test included the (2. memorize) of list of words as well as
of (3. inform) from two messages transmitted at the same time.
1_____ 2_____ 3______ 4______
With this exercise students are asked to provide the verb tense which is far from
testing writing because this exercise tests grammar (Ramírez and García, 2010).
5. Blank-filling or Gap filling
Kitao and Kitao (1996) assume that gap filling is one of the most controlled
techniques inwriting. Test takers are presented with a passage with blanks, and they
have to fill them with the correct missed [Link] activity is a combination
between reading and writing skills, and “sometimes it is
a problem because it makes it difficult to decide what the scores really mean” ( p. 3).
Weir (1993) adds that as this task only involves understanding vocabulary and
structure of the cohesion devices, writing is reduced because answers are not
provided. Also he stresses that gap filling is sometimes considered a suitable format
for testing, a “productive writing ability” in a very guided sense” (p. 139).
In the following item the students have to solve an exercise like the following:
A: What you like to order? 1____
B: I have the fried chicken. 2____
C: You like rice or potatoes? 3____
D: Potatoes please. 4____
E: What kind of potatoes would you? 5____
F: Mashed, baked or French fries? 6____
G: I like French fries. 7____
6. Copying

6
 Weir (1993) cites that copying technique is repeated according to the level of the
students. It is the first task that produces writing because test taker has to be sure to
write every letter contained in the sentence. For that reason, it is an appropriate
technique for children. But when it is used, formal writing has to be employed
because several consequences are going to be face according to the illegibility terms.
Copy the following:
Fawzia likes figs and grapes.
__________________
She doesn’t like orange juice.
__________________
She’s going to ride to the market.
__________________
7. Controlled writing

Ramírez and García (2010) state that “controlled writing refers to have control
over what students write and subsequently, teacher can ensure that certain grammatical
patterns and language functions are tested” (p. 18). Some of the forms that controlled
writing can take a transformation; this type of item requires that the students re-write
sentences according to a certain pattern. A similar way of using transformation is by
giving the students a word in brackets instead of the beginning of the new sentence.
A negative aspect of using this type of item is the lack of context it provides as
shown in the example below.
In Australia, 87% of married couples have children (most)
___________________.
This exercise does not really test writing because of the using the word provided
that limits again the task (Ramírez and García, 2010).
8. Broken sentences
The teacher can test the ability of writing sentences from a series of words and
phrases by using broken sentences and the students have to make as many changes as
possible in order to form good sentences by adding articles, prepositions, punctuation
marks, and verbs in the correct tense. An important aspect to take into account when
using this type of items is that the teacher should put the broken sentences in the form of
a paragraph, a dialogue or a letter. For example:
1. Take/ drugs and stimulants / keep awake / while revise examination/ often be very
harmful. / It be far better / lead / balance life a/ and get enough sleep/ every night/
There be/ limit/ degree and span/ concentration/ which you be capable / exert/ Brain /
need rest/ as much body. / Indeed, / it be quality/ than quantity work / that be
important. (LELI, 2002. p. 29).
Candidates only have to order the words. This exercise does not really test students’
ability to write complete paragraphs.
9. Sentence and paragraph completion
A realistic task of controlled writing is sentence and paragraph completion
because writing is integrated with reading comprehension, so by reading, students
can complete a sentence or a dialogue.

7
 Example:
Most of my students in my class where rather lazy and did not enjoy the curse. Some
even stay away from school quiet often. Pauline, however,
________________________
________________________
_________ etc.
This technique is more challenging and it is a mixture of both reading and writing
skills (Kitao and Kitao, 1996)4.

Types of Testing Language Skill in Writing

1. Gap Filling
One of the most controlled way of testing writing is gap filling. Testees are
presented with a passage with blanks, and they fill in the blanks. This is a mixture
of both reading and writing skills, which is sometimes a problem, because it
makes it difficult to decide what the scores really mean. However, with lower
level students, it might be the only reasonable test of productive ability.
2. Form Completion
Another controlled way of testing writing is to have the testLcts fill c,at a
form, for example, an application. The advantage of such a task is that it is at least
somewhat communicative, but the disadvantage is that it does not require any
connected discourse or any use of language greater than lexical knowledge and a
small amount of grammar.
3. Making Corrections
In some situations, testees are presented with a short piece of writing
which has delferate grammar, punctuation and spelling errors, and they are asked
to correct the errors. While this task does related to one thing that people do when
they writeeditingand it is objectively corrected, but it does not represent the
writing task as a whole.
4. Letter Writing
Letter writing is a common task for writing tests. The stimulus for the
letter may be a situation that is explained in the instructions, a letter to which the
testees are instructed to respond, infonnation given in chart or graph form that is
to be summarized in the testees' letter, pictures or drawings that give information
about a situation the testees are expected to write a letter about, etc. In all of these
possibilities, the tester must keep in mind that the situation must be as clear as
possible for the testee, unless there is an intention to test reading and writing
together. If the testee does not understand, for example, a letter that he/she is
expected to respond to, it will be impossible to get a sample of writing to
evaluate.
5. Essay Writing
4
Bacha, N. N. (2015). Testing writing in the EFL classroom.

8
 Essay writing is probably one of the more common writing tasks, but it
should be used carefully. If the future situation of the students will not include
writing essays, the tester should carefully consider whether it is the best test of the
students' writing ability5.

Platforms for testing language skills in writing

There are several platforms available for testing language skills in writing,
each offering unique features and capabilities. Here are some notable options:
1. ALTA Language Services
ALTA provides a comprehensive writing skills test available in over 80
languages. The test is designed to assess a candidate's ability to write in a
target language through various prompts that reflect real-world business
scenarios. Results are typically available within two business days, and the
tests can be administered electronically or in hard copy. ALTA's evaluators are
native speakers with relevant educational backgrounds, ensuring accurate
scoring based on a 12-level scale that evaluates organization, expression,
grammar, and style .
2. TestGorilla
While primarily known for its broad range of pre-employment
assessments, TestGorilla also includes language tests that can evaluate writing
skills among other competencies. It offers over 300 tests, including language
proficiency assessments in multiple languages. The platform is user-friendly
and allows for the creation of customized assessments tailored to specific job
roles .
3. SmallTalk2Me
This AI-powered platform focuses on assessing both speaking and writing
skills. It allows candidates to complete assessments remotely, providing
instant results that include a detailed language proficiency profile aligned with
the CEFR scale. The platform utilizes advanced speech recognition and
natural language processing technologies to evaluate various aspects of
language use, including grammar and vocabulary6.

1.3. Challanges of Testing Language Skill in Writing

Testing each skill is uniquely difficult, but testing writing presents two
particular problems. Testing writing presents two major problems. The first is making
decisions about the matter of control, objectivity of the evaluation, and naturalness in
the writing test. If you decide to test writing in a controlled way and in a way that can
be graded objectively, you must do so in a way that does not necessarily reflect how
the writing is used by the students in the real world. If, on the other hand, you test

5
Terry, R. M. (1989). Teaching and evaluating writing as a communicative skill. Foreign Language Annals, 22(1),
43-52.
6
Topacio, K. N. M. (2018). Exploring the use of online educational platform in teaching writing among ESL
students. Journal of Language and Linguistic Studies, 14(1), 86-101.

9
 writing in a way that would reflect how the students use writing in the real world, it is
difficult to have control over the writing and to evaluate the student's work
objectively.
The second major problem with testing writing is, if the test is done in a way
that it cannot be graded objectively, it is necessary to tlevelop a scale that allows it to
be graded as objectively as possible. Hoy / this is done is one of the great difficulties
of testing writing7.

B. Definition , Method and Challenges of Testing Language Component in Grammar

2.1. Definition of Testing Language Component in Grammar
Grammar is a key component of language testing because it's believed that a basic
understanding of grammar is necessary to communicate meaning. Grammar is tested
directly or indirectly in all tests of a learner's language ability. Some common types of
grammar tests include: Transformation tests: Students create new sentences that have the
same meaning as the original sentence. Sentence combining exercises: Students combine
sentences. Error correction items: Students select the correct response to an utterance.
Grammar assessments evaluate candidates on specific skills like: correct use of tenses,
word types (like adjectives or adverbs), punctuation, passive vs. active voice, and idioms.
Language testing can help identify students' strengths and weaknesses, which can help
identify areas for remedial work. It can also help evaluate the effectiveness of the
program, course books, materials, and methods8.
1. Charles Hockett Grammar is a set of rules that govern the structure or patterns of a
language, including how words are arranged to form sentences. According to
Hockett, grammar includes phonology, morphology, and syntax within a language.
2. Noam Chomsky Chomsky defines grammar as a set of rules underlying the human
capacity for language, enabling people to understand and produce new sentences
they have never heard before. He introduced the concept of generative grammar,
where grammar not only regulates the rules of language but also the creative
ability of speakers.
3. Franz Boas According to Boas, grammar is the distinctive characteristic of each
language. Every language has different grammatical structures, and these cannot
be imposed on the rules of other languages. Grammar helps in understanding and
deciphering the meaning embedded within a language.
4. Henry Sweet Grammar is defined as the study of word forms (morphology) and
the arrangement of words in sentences (syntax). Sweet emphasizes that grammar
serves to regulate how words are combined to form correct and comprehensible
sentences.

7
Fareed, M., Ashraf, A., & Bilal, M. (2016). ESL learners’ writing skills: Problems, factors and suggestions. Journal
of education and social sciences, 4(2), 81-92.
8
Kitao, S. K., & Kitao, K. (1996). Testing Grammar.

10
 5. Sidney Greenbaum and Randolph Quirk They state that grammar is the
description of a language's structure, encompassing rules about how to combine
words into meaningful and norm-compliant sentences9.

2.2. Method of Testing Language Component in Grammar

Testing language components, particularly grammar, involves assessing the
understanding and application of grammatical rules in a language. Here’s an overview
of key concepts and approaches for testing grammar in language learning:
1. Types of Grammar Tests- Form-focused Tests : Assess specific grammatical
structures, such as verb tenses, prepositions, and sentence structures. - Meaning-
focused Tests: Evaluate the ability to convey meaning using appropriate grammar in
context. This can include writing tasks and oral exams. - Integrated Tests: Combine
grammar with other language skills (listening, reading, writing, and speaking) to see
how grammar functions in real communication.
2. Test Formats - Multiple Choice Questions (MCQs): Students select the correct
grammatical form from a set of options. Useful for assessing knowledge of specific
rules. - Fill-in-the-Blank: Tests require students to complete sentences with the
appropriate grammatical form. This assesses both recall and application. - Error
Correction: Present sentences with grammatical mistakes and ask students to identify
and correct them. This tests both recognition and understanding. - Sentence
Transformation: Students rewrite sentences using different grammatical structures
(e.g., changing from active to passive voice). - Writing Tasks: Assess grammar in
longer written responses, where students must apply various grammatical rules in
context10.
3. Key Areas to Assess - Tenses: Past, present, and future tenses and their correct
usage. - Subject-Verb Agreement: Ensuring subjects agree with verbs in number and
person. - Modifiers: Correct placement and use of adjectives and adverbs. - Sentence
Structure: Understanding of simple, compound, and complex sentences. -
Punctuation: Correct use of commas, periods, question marks, etc. - Prepositions:
Usage of prepositions in various contexts.
4. Assessment Criteria - Accuracy: Correctness of grammar used. - Complexity:
Use of varied and sophisticated structures. - Clarity: How clearly ideas are expressed
using grammar. - Fluency: The ability to use grammar fluidly in spoken or written
language.
5. Feedback and Remediation - Provide constructive feedback highlighting both
strengths and areas for improvement. - Use error analysis to identify common
mistakes and address them in future lessons. - Incorporate targeted practice activities
that focus on troublesome areas for students.

9
Swain, M., & Canale, M. (1982). The role of grammar in a communicative approach to second language teaching
and testing.
10
Arnaud, P. J. (1989). Vocabulary and grammar: A multitrait-multimethod investigation. AILA Review, 6, 56-65.

11
 6. Tools for Grammar Testing - Diagnostic Tests: Identify students' grammatical
strengths and weaknesses at the beginning of a course. - Progress Test: Regularly
assess students' grammar knowledge throughout the course. - Standardized Tests
Utilize established tests like TOEFL or IELTS for benchmarking students' grammar
skills against international standards.
7. Technology and Grammar Testing - Online Quizzes Platforms like Quizlet,
Kahoot, or Google Forms for interactive grammar testing. - Grammar Check Tools:
Use software like Grammarly or Microsoft Word’s grammar check to provide instant
feedback during writing tasks11.

2.3. Challenges of Testing Language Component in Grammar

Testing language component grammar presents several challenges, particularly in
ensuring that the grammar models align with natural language use. Some key
challenges include:
1. Ambiguity in Language: - Natural languages often have ambiguous structures.
For example, a sentence like "I saw the man with the telescope" can be interpreted in
multiple ways (Did the speaker use the telescope to see the man, or did the man have
the telescope?). - Testing grammatical correctness in such cases is difficult as it
requires the model to understand the context.
2. Variety of Grammatical Rules: - Each language has its own grammar rules, and
these rules can vary widely. Some languages are more flexible with word order (like
Russian), while others, like English, follow stricter structures. - Testing across
different languages requires creating distinct test cases for each language's specific
rules.
3. Handling Exceptions: - Many languages contain irregular grammar patterns or
exceptions to the rules. For instance, irregular verbs in English (e.g., "go" → "went"
instead of "goed"). - Testing must account for these irregularities and ensure that the
system can recognize both regular and irregular forms.
4. Idiomatic Expressions: - Idioms or colloquial phrases often break standard
grammatical rules. For example, "It's raining cats and dogs" doesn’t make literal
grammatical sense but is correct in its idiomatic form. - Testing systems often
struggle to differentiate between idiomatic expressions and literal grammatical errors.
5. Code-Switching and Multilingual Usage: - Many speakers switch between
languages within a sentence, known as code-switching (e.g., "I’ll meet you at the café
después de la reunión"). - Testing a system's ability to handle multilingual usage
without marking such sentences as grammatically incorrect is a significant challenge.
6. Context Sensitivity: - Some grammatical structures change depending on
context. For instance, subject-verb agreement can depend on more complex sentence
structures (e.g., "The number of students is growing" vs. "A number of students are

11
Harris, Z. (1954). "Distributional Structure". Word, 10(2-3), 146-162.

12
 growing"). - It’s important for tests to consider the overall sentence context, not just
isolated components.
7. Diversity of Dialects and Registers: - Dialects and regional variations can affect
grammar (e.g., British vs. American English). Additionally, informal speech may not
adhere strictly to grammatical rules but can still be considered "correct" in
conversational contexts. - Testing for formal grammar vs. casual spoken language
requires fine-tuned distinctions between registers.
8. Error Identification vs. Suggestion: - Some grammar-checking systems not only
detect errors but also suggest corrections. Ensuring that the suggestions are
contextually appropriate adds an extra layer of complexity to testing. - Testing must
evaluate not only whether errors are correctly identified but also whether the
suggested fixes maintain the original meaning 12.

C. Definition Method and Challenges of Testing Language Component in Vocabulary

3.1. Definition Testing Language Component in Vocabulary
Definition of Language Testing Component - Vocabulary: Vocabulary in language
testing refers to the collection of words or phrases that are used in communication and
assessed for language proficiency. It is essential for second language learners, as
vocabulary knowledge directly influences their ability to comprehend and
communicate effectively. Vocabulary tests often evaluate the range and accuracy of
word usage, which can contribute significantly to a learner's overall communicative
competence13. Definition of language testing components in the vocabulary aspect
according to several experts:
1. Nation (2001): According to Nation, vocabulary in the context of language
testing is a collection of words that a person knows and uses to communicate
effectively. Vocabulary mastery is very important because it is the basis of other
language skills, such as reading comprehension and speaking ability.
2. Read (2000): read states that vocabulary testing does not just assess the number
of words a student knows, but also includes the student's ability to use these
words appropriately in context. this involves understanding meaning, usage in
sentences, and appropriate connotation.
3. Schmitt (2008): Schmitt emphasized the importance of vocabulary mastery for
language learners, stating that vocabulary testing needs to evaluate not only the
ability to identify the meaning of words, but also the level of fluency and
accuracy in the use of that vocabulary. he adds that vocabulary testing can
include tests of word recognition, suitability of meaning, and use in complex
contexts.
4. Uchihara & Clenton (2018): Uchihara and Clenton stated that vocabulary
mastery is an important component in second language speaking ability. they

12
Rea-Dickins, P. (2001). Fossilisation or evolution: the case of grammar testing. Experimenting with uncertainty:
essays in honour of Alan Davies, 11, 22.
13
Read, J. Assessing Vocabulary. Cambridge University Press (2001)

13
 argue that the larger the vocabulary size a learner has, the more likely they are to
succeed in communication. Vocabulary tests usually evaluate the size of the
vocabulary and the accuracy of its use in context14.

3.2. Method of Testing Language Component in Vocabulary

Methods used in testing vocabulary components in language testing:
1. Multiple Choice Tests (Multiple-Choice Tests) This method is one of the most
common ways of measuring vocabulary comprehension. Multiple choice tests
usually present a word and a number of answer choices indicating synonyms,
definitions, or the context in which the word is used. The aim is to assess
students' ability to recognize the correct meaning of a word or phrase. This
method is considered efficient for testing broad vocabulary quickly. However,
the downside is that students may be able to guess the answer, so it does not
always accurately reflect vocabulary skills.
2. Cloze Test In this method, some words in the text are omitted and students
have to fill in the blanks with the appropriate words. cloze tests can measure
vocabulary by testing context understanding, namely how well students can
predict missing words based on sentence structure or overall context. This
method helps assess students' vocabulary in real use because it focuses on
students' ability to recognize appropriate words in their contextual
environment.
3. Synonym-Antonym Test Synonym-antonym tests assess students'
understanding of the meaning of words by asking them to identify synonyms
(words with the same or nearly the same meaning) or antonyms (words with
the opposite meaning). This test helps test whether students really understand
the nuances of the meaning of a word and can differentiate it from other words.
For example, students might be given the word “big” and have to choose a
synonym like “big” or an antonym like “small.”
4. Matching Exercises In this exercise, students are presented with two columns
containing words and definitions, synonyms, antonyms, or word context, and
they are asked to match words with their definitions or synonyms. This method
helps test vocabulary in a more flexible way and involves a wider
understanding of meaning and use.
5. Word Formation Tests in this method, students are given the basic form of a
word (such as act) and asked to make other word forms from it (for example,
actor, action, active). This test is designed to assess students' understanding of
word families and their morphological abilities, which are an important part of
vocabulary comprehension. This is important to assess students' ability to
understand changes in word forms according to context.

14
Schmitt, N. Instructed Second Language Vocabulary Learning. Language Teaching Research, (2008), 329-363.

14
6. Word Pronunciation Test This method tests students' ability to recognize and
pronounce words correctly. Students may be asked to pronounce certain words
correctly or choose words based on their correct pronunciation. Vocabulary
pronunciation can be an important indicator for vocabulary comprehension,
especially in speaking and listening contexts.
7. Visual Recognition Test (Picture Vocabulary Test) This test is often used to test
vocabulary in children or beginner language learners. students are shown
pictures of objects or actions and asked to choose or name the appropriate
words. This test is effective for assessing basic vocabulary and is especially
useful for beginners who are just learning a language because it connects words
with visual representations.
8. Word Association test (Word Association Test) In this method, students are
given a word and asked to name other words that are closely related. For
example, given the word "house," students might name words like "door,"
"window," or "living room." Word association tests are useful for assessing
how deeply students understand the relationships between words and whether
they can establish semantic connections between different words.
9. Rapid Response Test (Rapid Naming Test) This test assesses students' ability to
recognize and name words quickly. Students are given a list of words that they
must name within a certain time. This test can show the extent to which
students' vocabulary is stored in their long-term memory and their ability to
access and use it quickly in urgent communication situations.
10. Vocabulary Depth Tests In contrast to vocabulary tests which only measure the
number of words known (vocabulary breadth), vocabulary depth tests focus on
how well students understand each word. for example, these tests might
evaluate whether students know the different meanings of the same word,
common collocations (words that often appear together), or the connotations
and nuances of the word. This provides a deeper picture of one's vocabulary
mastery.
11. Translation Tests In this test, students are asked to translate words or phrases
from the target language to the native language or vice versa. This test
measures a student's direct understanding of word meanings and his ability to
connect words in both languages. Although this method is effective, it has
limitations because it may not always reflect contextual understanding in the
target language.
12. Lexical Decision Task Students are asked to decide whether a series of letters is
a real word or not in the target language. This method is used in language
research to assess word recognition and vocabulary mastery quickly. This test

15
 measures whether students can recognize common words and differentiate
them from non-words, which contributes to language fluency15.

Platform of Testing Language Component in Vocabulary

There are several platforms available for testing vocabulary skills in language
learning. These platforms offer various methods and tools to assess vocabulary
knowledge effectively. Here are some notable options:

1. Vaia
Vaia is an educational technology platform that provides a range of
vocabulary testing techniques. It includes multiple-choice tests, fill-in-the-blank
exercises, and matching tests to evaluate word knowledge. The platform
emphasizes the importance of understanding different vocabulary testing methods
to assess language proficiency and track progress over time. It also offers
interactive flashcards and practice tests to enhance vocabulary acquisition.
2. [Link]
This platform allows teachers to measure their students' vocabulary size
using Paul Nation’s Vocabulary Size Test. It provides a simple tool for creating
custom test sessions, enabling educators to assess vocabulary knowledge in a
group or individual setting. The results can be viewed online or downloaded for
further analysis, making it a useful resource for both teachers and researchers.
3. [Link]
Test Your Vocabulary is an online tool that helps users gauge their
vocabulary size. It offers a straightforward interface where users can check their
knowledge of word definitions. This platform is particularly useful for learners
who want to understand their vocabulary level and identify areas for
improvement16.

3.3. Challenges of Testing Language Component in Vocabulary

Challenges faced in implementing language testing on the vocabulary component:
1. Variation and Complexity of Vocabulary Language has a variety of words with
different meanings, connotations and nuances depending on the context. one of
the biggest challenges is choosing representative words to test. Certain words may
have more than one meaning, depending on the sentence or context in which they
are used. for example, the word “run” can have different meanings in “to run a
race” or “to run a business.” Vocabulary tests often struggle to cover all this
variety, and selecting the right words becomes a complex challenge.
2. Differences in Student Ability Levels In language classes, students usually have
different levels of vocabulary ability, from beginner to advanced. Designing
appropriate vocabulary tests for each ability level is a major challenge. a test that

15
Saito,H., & Inoi,S. Junior and Senior High School EFL Teachers' Use of Formative Assessment: A Mixed-
Methods Study. Language Assessment Quarterly, ( 2017). 213-233.
16
Stockwell, G. (2010). Using mobile phones for vocabulary activities: Examining the effect of platform.

16
 is too easy will leave more advanced students unmotivated, while a test that is too
difficult can leave novice students frustrated. Therefore, teachers need to create
tests that can accommodate these variations in ability or use several versions of
the test according to student levels.
3. Influence of Home Language (L1 Interference) Students' native language often
influences how they understand and remember vocabulary in a second language.
This influence of the language of origin can cause errors in understanding or
applying vocabulary. for example, students may translate words directly from the
source language to the target language, which could result in usage or
comprehension errors. This effect is a challenge because students need more time
and practice to understand the semantic differences between the two languages.
4. Time limitations in testing Limited time is often an obstacle in carrying out
vocabulary tests. Students may only have a few minutes to answer each question,
making it difficult for examiners to get a complete picture of a student's
vocabulary mastery. because vocabulary includes not only basic understanding
but also ability to use it in appropriate contexts, limited time often makes
assessments less comprehensive. As a result, test results may not fully reflect
students' vocabulary abilities in depth.
5. Difficulty in Measuring the Depth and Breadth of VocabularyAnother challenge in
vocabulary testing is determining the best way to measure not only how many
words students know (vocabulary breadth), but also how deep their understanding
of those words is (vocabulary depth). Vocabulary depth includes students' ability
to understand various word meanings, connotations, collocations, and usage in
certain contexts. Tests that only assess the breadth of vocabulary without
considering its depth can provide inaccurate results in assessing language
6. limitations
mastery. of the Vocabulary Testing Method Vocabulary testing methods such as
multiple choice or cloze tests are generally effective, but have limitations in
evaluating vocabulary use in real situations. MCQs, for example, may only assess
the ability to recognize the meaning of a word in a limited context, but not the
student's ability to use the word in communication. Cloze tests may also not
reflect students' actual abilities because students can guess the correct word based
on sentence structure without really understanding its meaning. Thus, choosing a
method that can evaluate comprehensively is a difficult challenge.
7. Cultural differences and Social Context Vocabulary often has meaning or usage
that is specific to a particular cultural context. For example, words that have
special connotations in a particular culture may not have the same meaning in
another culture. in vocabulary testing, these cultural differences can be a
challenge because the vocabulary being tested may be easier or more difficult to
understand depending on the student's cultural background. These challenges can
also lead to bias in testing, where students from certain cultures may have
difficulty understanding or answering questions correctly.

17
 8. Effect of Tests on Learning (Washback Effect) Vocabulary tests can have a
powerful impact on the way students learn. if students know that their vocabulary
test only assesses memorization of definitions, they may focus more on
memorizing words than understanding their full meaning and use. This can cause
a washback effect, where the test does not provide the right motivation for
students to study vocabulary in more depth. teachers need to ensure that
vocabulary tests not only measure memorization, but also students' ability to
apply vocabulary in real contexts.
9. Development of Valid and Reliable Tests Creating valid and reliable vocabulary
tests is a big challenge. Test validity means that the test actually measures what it
is supposed to measure, while reliability means that the test provides consistent
results over time. developing valid and reliable vocabulary tests is difficult
because words can have different meanings in different contexts. teachers or
examiners need to ensure that vocabulary test questions are relevant to the
learning objectives and can be relied upon to measure students' abilities
accurately.
10. In-depth Evaluation and Analysis of Results Assessing vocabulary test results is
often a complicated process, especially if the test measures various aspects such
as word meaning, synonyms, usage in sentences, and connotation. In-depth
analysis of results is necessary to understand a student's strengths and weaknesses
thoroughly. however, this requires greater time and resources, so it is often not
possible in everyday classroom settings. As a result, many vocabulary test results
are evaluated superficially, so they do not provide a complete picture of students'
abilities17.

17
Uchihara, T & Clenton, Investigation the Role of Vocabulary Size in Second Language Speaking Ability.
Language Teaching Research, (2018).540-556.

18
 CHAPTER III

CLOSING

A. Conclusion
In the realm of language assessment, testing skills in writing alongside grammar
and vocabulary components is essential for a comprehensive understanding of a learner's
proficiency. Effective writing assessments evaluate not only the ability to convey ideas
clearly but also the correct use of grammar and a rich vocabulary. Various platforms, such
as ALTA Language Services and TestGorilla, provide structured methodologies to gauge
these skills, offering tailored tests that reflect real-world applications.
Moreover, vocabulary testing tools like Vaia and [Link] help
learners identify gaps in their word knowledge and track their progress over time. By
integrating writing, grammar, and vocabulary assessments, educators and learners can
foster a more holistic approach to language acquisition. This multifaceted evaluation not
only enhances individual learning outcomes but also prepares learners for effective
communication in diverse contexts. Ultimately, a robust assessment strategy is crucial for
developing language proficiency and ensuring that learners can express themselves
accurately and fluently

19
 REFERENCES

Marzuki, A. G., Farkhan, M., & Deni, R. (2020). Self-Assessment in Exploring EFL
Students' Speaking Skill. Journal, 27(2), 208–214.
Saito, H., & Inoi, S. (2017). Junior and Senior High School EFL Teachers' Use of
Formative Assessment: A Mixed-Methods Study. Language Assessment Quarterly,
14(3), 213–233.
Nation, I. S. P. (2001). learning Vocabulary in Another Language. Cambridge
University Press.
Read, J. (2000). Assessing Vocabulary. Cambridge University Press.
Schmitt, N. (2008). Review Article: Instructed Second Language Vocabulary
Learning. Language Teaching Research, 12(3), 329-363.
Uchihara, T., & Clenton, J. (2018). Investigating the Role of Vocabulary Size in
Second Language Speaking Ability. Language Teaching Research, 24(4), 540–556.
Kitao, S. and Kitao, K. (1996) Testing Writing. ERIC Document.
LELI. (2002). Diseño y Evaluación de Exámenes en Inglés. UAEH.
Ramírez, B. and García, A. (2010). Testing Students’ Writing: an exploratory study of
current teachers’ practice.
Weir, C. J. (1993). Understanding and Developing Language Tests. Great Britain.
Prentice Hall International.
Heaton, J. B. (1990). Classroom Testing. Longman Keys to Language Teaching.
Hong Kong: Longman.
Harmer J. (2005). The Practice of English Language Teaching. England: Pearson.
Saito,H., & Inoi,S. Junior and Senior High School EFL Teachers' Use of Formative
Assessment: A Mixed-Methods Study. Language Assessment Quarterly, ( 2017). 213-
233.
Stockwell, G. (2010). Using mobile phones for vocabulary activities: Examining the
effect of platform.
Bacha, N. N. (2015). Testing writing in the EFL classroom.

Rea-Dickins, P. (2001). Fossilisation or evolution: the case of grammar testing.

Experimenting with uncertainty: essays in honour of Alan Davies, 11, 22.

20