Multilingual Copy Task for Typing Skills
Multilingual Copy Task for Typing Skills
SOFTWARE METAPAPER
Keyboarding is an essential mode of text production. In the context of typing courses, instruments
have been developed to gauge typing skills but to our knowledge there is no computerized typing test
measuring both motor skills and the influence of different levels of lexicality on typing fluency. That
is why, we developed a strictly controlled copy task guiding participants through seven modules in
which different prompts are presented, each dealing with complementary levels of lexicality. Fine-grained
keystroke logging allows for a range of analyses with Inputlog [16].
The copy task can be used in writing process studies: research shows that typing fluency has an impact
in the quality of text production [1, 24]. In previous writing research studies copy tasks have been used
to study the relation between writing fluency and text composition (Wallot and Grabowski, 2013). The
Inputlog copy task allows researchers to investigate different levels of lexicality in more detail. At the
moment the copy task has been developed in ten different languages. The software is open-access and
allows researchers to adapt the tasks to their specific needs.
Keywords: copy tasks; typing skills; motor coordination; keyboarding; writing studies; interkey intervals;
bigram frequency; tapping task; typing fluency
Funding statement: We thank the department of Management, Faculty of Business and Economics at the
University of Antwerp (Belgium) for their financial contribution to this project. We also received support
of ELN (European Literacy Network – COST Action IS1401).
webtool via: [Link] hands (viz. ‘d’ and ‘k’, resp. a Left-Right and Right-Left hand
[Link]. The source code is downloadable via GitHub combination). Participants are asked to type the ‘d’-’k’ key
(see below). combination for 15 seconds [22]. A time circle at the top
At this moment the copy task has been developed for ten right corner is used as a time indicator. The time starts
languages (Dutch, English, French, German, Norwegian, after the first key press, allowing the participants to read
Polish, Portuguese, Spanish, Turkish, and Welsh) and the instructions at their own pace.
three keyboard layouts (Azerty, Qwerty, and Qwertz). The Finger-tapping tasks are commonly used to study the
software has been pretested worldwide in a number of human motor system. They have the advantage of being
experimental studies in ongoing writing and translation simple enough to use in the study of both normal control
research. More than 3000 copy task logs with participants subjects as well as those with neuropathologies affecting
aged between 14 and 82 years have been collected and the motor system [32].
analyzed. A typical copy task consists of seven typing
assignments (Table 1). Sentence copy task
The next task is a sentence copy task. It intends to measure
Tapping task the typing skills related to copying a series of – short and
The first task, the tapping task, intends to measure the high frequent – words presented in a simple sentence. For
fastest motor speed by pressing two keys with alternating example, in the English copy task: “the cat was sleeping
under the apple tree”. Participants are asked to repetitively
Table 1: Overview of the seven components of the copy type this sentence for 30 seconds (without capital letters
task. nor punctuation marks).
The prompted sentence consists of seven to nine high
Components frequent short words (one or two syllables). In developing
Tapping task press the ‘d’ and ‘k’ key alternatively
the task for the different languages, we tried to implement
during 15 s these construction characteristics as consistently
as possible to allow for interlanguage comparison
Sentence copy a sentence during 30 s (Mean(M): 7.9 words; Standard Deviation (SD): 0.8 – M:
Word combination 1 copy a combination of three words 32.3 characters – SD: 2.8).
seven times
Word combination 2 copy a combination of three words Three-word combination
seven times The main part of the copy task consists of four components
in which a three-word combination has to be copy-typed
Word combination 3 copy a combination of three words
seven times: the first three-word combinations target
seven times
the repetitive production of mainly high frequent
Word combination 4 copy a combination of three words bigrams; the fourth contains low frequent bigrams.
seven times Table 2 gives an actual example of the presented word
Consonant groups copy four blocks of six consonants combinations (in the English version), together with
once their characteristics.
Table 2: Examples of the word combination prompts in the English_UK (QWERTY) copy task including the controlled
characteristics.
To create the word combinations with high frequent board adjacent bigrams and none (or maximum one)
bigrams, we used the following criteria: repetitive keys (Figure 1).
1. Words: Three words are presented per entry, i.e. a For the component with low frequent bigrams (Word
combination of a numeral + an adjective + a noun; combination 4) we used the same criteria, but instead
2. Characters: Total prompt length is between 19 and 24 of selecting high frequency bigrams in the words,
characters in total – [3/4] + [10/12] + [8/10] charac- low frequency bigrams were presented, e.g. three to
ters (average number of characters per word combina- four bigrams occurring in the 50% lowest frequency
tion for all the language tasks: M: 22.3 (SD: 1.6); percentiles of our corpus. The total length of the prompt
3. Word frequency: Only high frequency words are across all languages was slightly shorter than in the high
included (30% highest segment; log lemma frequency frequency components: average number of characters per
of the words or the stem words in case of compound word combination: M 19.0 (SD: 1.3).
words; based on CELEX/Subtlex [3, 14];
4. Bigram frequency: Between 18 to 20 high frequency Consonant groups
bigrams are implemented selected from the 30 % The final component is designed to measure the typing
most frequent percentile in CELEX/Subtlex [3, 14] or skills in a non-lexical context [9]. Participants are asked
another comparable corpus-based bigram frequency to copy four blocks of six consonants once. The blocks
list for languages for which these databases were not are identical for all languages: tjxggl pgkfkq dtdrtt
available. No low frequent bigrams are included in npwdvf.
these three word combinations;
5. Hand combination and key adjacency: A mix of hand Procedure
combinations is addressed with an average of three The copy task is presented to the participant as one fixed
to five bigrams for each hand combination (Left-Left; flow in which he or she is taken from one component to
Left-Right; Right-Left; Right-Right); five to seven key- the next (Figure 2).
Figure 1: Keyboard scheme (e.g. QWERTY) used to define the four hand combinations: Blue = Left hand – Red = Right
hand; midzone is characterized as undefined.
In a first step the participant selects the language for Next, the flow brings the user to a brief closing
the copy task. The next screen prompts him/her to briefly questionnaire in which the following subjects are
provide some session information: name/participant addressed: handedness, hardware and browser used for the
code, age and gender; session name (optional) and test, dominant language, reading or writing difficulties,
keyboard used (Azerty, Qwerty or Qwertz, visual help and familiarity with this task. For the handedness test
provided). We also included a privacy notice to obtain we chose the reduced Edinburgh handedness test [18,
explicit consent, in line with the privacy policy of the 30]. Veale proved his assessment to be reliable with only
General Data Protection Regulation (GDPR) of the four questions. Finally, the data are stored on a dedicated
European Union. server. The participants have the option to download their
The copy task then starts with a brief introduction to log files locally.
instruct and inform the user about the task. For instance:
“In this session we ask you to type letters, words and Copy task creator
sentences that are shown on the screen. Try to do this A default copy task – based on the principles described
as fast and error free as possible.” When pressing ‘start’ above – is made available in ten languages. However, if a
the components are shown one by one, always preceded researcher wants to translate/transpose the default copy task
by a brief – and specific – instruction. So as to allow the into another language or wants to construct an additional
participants to read the task instructions at their own copy task, he/she can use the so called ‘copy task creator’,
pace, we explicitly inform them that their time only starts made available as an integrated tool in Inputlog but also
after they have typed the first character. available as an isolated, stand-alone tool (see Github). The
The prompt needing to be copied is always presented copy task creator consists of several building blocks that can
separately and printed in dark red (Figure 3). When be combined into a custom-made task flow. The following
switching from the time-based components to the components are defined in the interface (see Figure 4):
repetition-based components (word combinations
that need to be retyped), a separate example screen is 1. Tasks: A task component assists the user in defining a
presented to further clarify this instruction. specific copy task component. It asks for a brief task
instruction, a user prompt and either a time limit or report addresses the following bigram characteristics
a predefined repetition number. (cf. supra):
2. Examples: The example block builds a part of the copy
task requiring no input, only an illustration of what 1. Correctness: Because the participants are challenged
the user is supposed to do in the next task. to find a trade-off between speed and accuracy, cor-
3. Text blocks: A text block component providing feed- rectness scores are reported, both at the overall and
back or feed forward information clarifying the task the component level. These scores indicate the num-
flow so as to guarantee a fluid transition between the ber of correctly typed bigrams as opposed to the num-
different instructions. ber of typing mistakes during copying.
4. Practice: The final option offers the possibility to add 2. Synthesis: Results for the Interkey Intervals (IKI) overall
a ‘practice’ component. It looks like a normal task, and at the component and trial level, including time
however, typing activities are not included in the log filtered results to take into account learning effects;
file. This part gives the participant the possibility to 3. Frequency: Results for IKI’s for high and low frequent
get acquainted with the web interface of the copy task. bigrams;
4. Adjacency: Results for the IKI’s for bigrams that are
After having defined and constructed the flow, the copy formed by combining adjacent and non-adjacent keys
task file can be uploaded and is ready to start. The opening on the keyboard;
and closing questions are default. 5. Repetition: Results for the IKI’s that are composed by
pressing the same key or not;
Copy task analysis 6. Hand combination: Results for the IKI’s with respect
The copy task analysis as provided in Inputlog consists of a to the hand combination used to type the bigram
carefully designed set of perspectives to explore the log file. (location on the keyboard).
The aim is to characterize a participant’s motoric keyboard
interaction based on the different copy task components. For each level within the copy task analysis, several
The output is presented such that it is possible to use the descriptive measures are reported (see Figure 5 for
data in further analyses (e.g., as a co-variate in variance an excerpt). For instance: ‘Count (targeted)’ reports
analyses, or in regression and multilevel analyses). Two the number of characters typed that correspond to a
types of output are generated: an aggregated analysis character that was prompted in one of the respective
(synthesis) and an event-based data file (extended raw copy task components; ‘Mean IKI’ is the arithmetic mean
data) including an automated characterization of all the (in milliseconds) of the targeted bigrams within the
targeted bigrams together with a precise intra bigram scope of the respective analyses. Characters per minute
time-stamp. Both are XML-files. The analysis of the copy (CPM): calculation of (theoretical number of) characters
task log files can be performed in batch in the standard per minute based on the mean IKI, specifically 60 000
Inputlog version 8.X. Automated merging provides a (ms)/mean IKI (ms).
csv file at group level for large data collections enabling For a more detailed description (and an example of a full
further statistical analyses (e.g., in SPSS or R). A visual sample analysis output) we refer to the Github repository
representation of the task flow, together with a more mentioned below.
detailed description, is included in the documentation
folder on Github. Implementation and architecture
The analysis report (styled XML) is preceded by a brief The copy task creator and the web execution environment
summary of the session information, together with the have both been open sourced. Both components are
answers to the initial and final questionnaire. Next, the simple applications of low architectural complexity
Figure 5: Excerpt from the analysis output at the component level (styled XML).
Art. 30, page 6 of 8 Van Waes et al: A Multilingual Copy Task
written as a C# application and javascript/html single the final questionnaire are included as part of the XML-
page web application respectively (see Github). output file.
The task creator consists of a single C# WinForm that The copy task creator is written in C# (2015) and can
allows the user to build a custom copy task by adding their be used as a standalone program. The output generates
own sequence of specific tasks. Their task configuration is an XML file with a specific set of tags that are recognized
then exported to an XML file that contains the copy task by the copy task JavaScript. A language tag in the header
definition. activates the language specific resources for the web
The web application is a JavaScript single page app interface and the navigation instructions.
(web/[Link]) that reads this copy task definition file
and dynamically creates the different screens as defined Dependencies
in definition. Depending on the specified language of the The web application contains all the javascript libraries
copy task a different language resource file will be loaded it depends on in the web/scripts/folder. The copy task
to provide localized instructions. The fallback language creator written in C# is built on top of the .NET Framework
for a missing resource translation is English. During the version 4.6.1.
execution of the test all the relevant keyboard activities of
the user are tracked by hooking into the keypress events List of contributors
of the input areas. Each incoming event is timed and We thank Sebastian Fierens and Tom Pauwaert for their
stored in an event list until the very end when the user help in programming the copy task.
submits their task. At that point the event list is exported
to the IDFX xml format which can be processed by the Software location
respective copy task analysis in Inputlog. This hook and The compiled ready-to-use software is hosted on the
the corresponding event serialization code can be found Inputlog website and is downloadable from there: http://
in the scripts/[Link] file on the Github repository. [Link] (Inputlog version 8). This website
hosts the main application as well as additional materials
Quality control (manual; presentations; articles; videos). The software
The logging accuracy of the copy task is tested and is free to use after completing a simple registration
compared to the Inputlog logging accuracy [20]. The time procedure.
log accuracy has the same maxdiff of 8 ms [8], which is in The source code for the copy task itself and the copy
line with other keystroke logging programs, like Scriptlog task creator is hosted in the GitHub repository, mentioned
or CyWrite. below.
In a test-retest experiment the copy task reliability has
been measured. Fifty participants completed the task twice Archive and Code repository: GitHub
(with a time lag of 4 months in between). The results show Name: Inputlog-Copy-Task
that the test results are highly consistent: Pearson r = .932 URL: [Link]
(p < .001 – overall Median interkey intervals: Mt1 = 116 -Task
ms; SD = 17; Mt1 = 115 ms; SD = 19). Additional analysis License: MIT License
with GLM repeated measures Anova at the component Publisher: Luuk van Waes & Mariëlle Leijten
level showed a strong main effect of the components, Contact: [Link]@[Link] or marielle.
(F (4,192) = 227.353; p < .001; ηp2 = .826). Post-hoc leijten@[Link]
Bonferroni also shows a significant effect at the individual Persistent identifier: DOI: [Link]
component level, indicating that the different (main) zenodo.2908966
components address different (lexical) characteristics of Project homepage: [Link]
motor related typing skills. Version published: 1.0.0
Date published: 30/05/2018
Availability
Operating system Language
The copy task is web based and is tested on most common The web-based copy task is currently available in ten
browsers (Chrome, Internet Explorer, Firefox, Safari and languages. The task, the instructions and the interface
Opera – OSX/Windows). The copy task creator is only are rendered in the selected language by the program
available for Windows (version 8 and higher). (JavaScript). A language resource database with
translations of the navigation, instruction and error
Programming language messages has been developed for that purpose.
The copy task is developed in JavaScript (with JQuery
2.1.0) and is web based. The logfile is stored as an XML-file Reuse potential
conforming to the IDFX-structure [25]. The file is event The copy task creator makes it easy to develop a
based and contains all key strokes with a time stamp (key standardized copy task in other languages, and to adapt
down time for every key press) and an identification of the the existing tasks to specific needs. It is also possible to
active component and of any trials within that component. edit the JavaScript used. The modular concept allows the
In addition, the session identification and the answers to development of new components creating other copy task
Van Waes et al: A Multilingual Copy Task Art. 30, page 7 of 8
functions such as audio-based or graphically prompted typo? Building a process-based model of typographic
copying. The task instructions could be enhanced with error revisions. Journal of Writing Analytics, 3.
video guidelines. 7. Berninger, V W, Vaughan, K B, Abbott, R D,
Abbott, S P, Rogan, L W, Brooks, A, Reed, E and
Support Graham, S 1997 Treatment of Handwriting Problems
At the moment we are building a Forum that is related in Beginning Writers: Transfer from Handwriting
to the Inputlog website ([Link]). This will to Composition. Journal of Educational Psychology,
accommodate easy interactions with the community. 89: 652–66. DOI: [Link]
To add a new language that is currently not supported 0663.89.4.652
in the default copy task, do not hesitate to contact the 8. Evgeny Chukharev-Hudilainen, E 2018 Empowering
authors (see contact information). automated writing evaluation with keystroke
logging. In: Sullivan, K and Lindgren, E (eds.),
Acknowledgements Observing writing: Insights from keystroke logging
We thank the following colleagues for their help in and handwriting. Leiden: Brill. DOI: [Link]
developing the different language versions: English: org/10.1163/9789004392526_007
Lise Fontaine (Cardiff University, UK) and Mark Torrance 9. Grabowski, J, Weinzierl, C and Schmitt, M 2010
(Nottingham University, UK); French: Thierry Olive Second and fourth graders’ copying ability: from
(CNRS@University of Poitiers, France); German: Esther graphical to linguistic processing. Journal of Research
Breuer (University of Cologne, Germany); Norwegian: Anne in Reading, 33: 39–53. DOI: [Link]
Sætersdal Myklestad & Vibeke Ronneberg (Western Norway j.1467-9817.2009.01431.x
University of Applied Sciences & University of Stravanger, 10. Graham, S, Harris, K R and Fink, B 2000 Is handwriting
Norway); Polish: Olga Witczak (Adam Mickiewicz University, causally related to learning to write? Treatment of
Poland); Portuguese: Teresa Limpo (University of Porto, handwriting problems in beginning writers. Journal
Portugal); Spanish: Anna Sala (University of Barcelona, of Educational Psychology, 92: 620–633. DOI: https://
Spain); Swedish: Asa Wengelin (University of Gothenburgh, [Link]/10.1037//0022-0663.92.4.620
Sweden) & Victoria Johansson (University of Lund, Sweden); 11. Graham, S and Weintraub, N 1996 A review of
Turkish: Gulay Tiryakioglu (University of Lyon 2, France); handwriting research: Progress and prospects from
Welsh: Lise Fontaine (Cardiff University, UK). 1980 to 1994. Educational Psychology Review, 8: 7–87.
DOI: [Link]
Competing Interests 12. Hayes, J R 1996 A new framework for understanding
The authors have no competing interests to declare. cognition and affect in writing. In: Levy, C M &
Ransdell, S E (eds.), The science of writing: Theories,
References methods, individual differences, and applications, 1–27.
1. Alvès, R A, Castro, S L, de Sousa, L and Strömqvist, S Mahwah, New Jersey: Lawrence Erlbaum Associates.
2007 Influence of typing skill on pause-execution cycles 13. Hayes, J R 2012 Modeling and remodeling writing.
in written composition. In: Torrance, M, Galbraith, D Written Communication, 29: 369–388. DOI: https://
and Van Waes, L (eds.), Recents developments in writing- [Link]/10.1177/0741088312451260
process research, 55–65. Dordrecht-Boston-London: 14. Keuleers, E, Brysbaert, M and New, B 2010
Kluwer Academic Press. SUBTLEX-NL: A new frequency measure for Dutch
2. Araújo, L C, Sucupira, L H, Jr, Lizarraga, M G, Ling, words based on film subtitles. Behavior Research
L L and Yabu-Uti, J B T 2005 User authentication Methods, 42: 643–650. DOI: [Link]
through typing biometrics features. IEEE Transactions BRM.42.3.643
on Signal Processing, 53: 851–855. DOI: [Link] 15. Lambert, E, Alamargot, D and Fayol, M 2012 Why
org/10.1109/TSP.2004.839903 use a copy task to study spelling in handwriting? In:
3. Baayen, R H, Piepenbrock, R and Van Rijn, H 1993 Fayol, M, Alamargot, D and Berninger, V W (eds.),
The CELEX lexical data base [CD-ROM], Philadelphia, Translation of thought to written text while composing:
Linguistic Data Consortium. University of Pennsylvania. Advancing theory, knowledge, research methods,
4. Banerjee, S P and Woodard, D L 2012 tools, and applications, 339–356. New York/London:
Biometric authentication and identification using Psychology press, Taylor & Francis Group.
keystroke dynamics: A survey. Journal of Pattern 16 Leijten, M and Van Waes, L 2013 Keystroke
Recognition Research, 7: 116–139. DOI: [Link] logging in writing research: Using Inputlog to
org/10.13176/11.427 analyze and visualize writing processes. Written
5. Berninger, V W, Abbott, R D, Augsburger, A and Communication, 30: 358–392. DOI: [Link]
Garcia, N 2009 Comparison of pen and keyboard org/10.1177/0741088313491692
transcription modes in children with and without 17. Medimorec, S and Risko, E F 2016 Effects of disfluency
learning disabilities. Learning Disability Quarterly, 32: in writing. British Journal of Psychology, 107: 625–650.
123–141. DOI: [Link] DOI: [Link]
6. Conijn, R, Van Zaanen, M, Leijten, M and Van 18. Oldfield, R C 1971 The assessment and analysis
Waes, L. 2019 (accepted for publication). How to of handedness: the Edinburgh inventory.
Art. 30, page 8 of 8 Van Waes et al: A Multilingual Copy Task
Neuropsychologia, 9: 97–113. DOI: [Link] Writing Fluency Applied to L1 and L2. Computers &
org/10.1016/0028-3932(71)90067-4 Composition, 38: 79–95. DOI: [Link]
19. Olive, T and Kellogg, R T 2002 Concurrent activation compcom.2015.09.012
of high- and low-level production processes in written 27. Van Waes, L, Leijten, M, Lindgren, E and Wengelin,
composition. Memory and Cognition, 30: 594–600. Å 2015 Keystroke logging in writing research:
DOI: [Link] Analyzing online writing processes. In: MacArthur, C A,
20. Pinet, S, Zielinski, C, Mathôt, S, Dufau, S, Alario, Graham, S and Fitzgerald, J (eds.), Handbook of Writing
F-X and Longcamp, M 2017 Measuring sequences Research, 410–426. second edition. New York: Guilford
of keystrokes with jsPsych: Reliability of response Press.
times and interkeystroke intervals. Behavior 28. Van Waes, L, Leijten, M, Mariën, P and Engelborghs,
research methods, 49: 1163–1176. DOI: [Link] S 2017 Typing competencies in Alzheimer’s disease:
org/10.3758/s13428-016-0776-3 An exploration of copy tasks. Computers in Human
21. Rodrigues, R N, Yared, G F, Costa, C R d N, Yabu-Uti, Behavior, 73: 311–319. DOI: [Link]
J B, Violaro, F and Ling, L L 2005 Biometric access chb.2017.03.050
control through numerical keyboards based on 29. Van Weerdenburg, M, Tesselhof, M and Van der
keystroke dynamics. Advances in biometrics, 640–646. Meijden, H 2019 Touch-typing for better spelling and
Springer. DOI: [Link] narrative-writing skills on the computer. 35: 143–152.
22. Salthouse, T A 1984 Effects of age and skill in typing. DOI: [Link]
Journal of Experimental Psychology, 113: 345–371. 30. Veale, J F 2014 Edinburgh Handedness
DOI: [Link] Inventory – Short Form: A revised version based on
23. Sullivan, K and Lindgren, E 2019 Observing writing: confirmatory factor analysis. Laterality: Asymmetries of
Insights from keystroke logging and handwriting, Body, Brain and Cognition, 19: 164–177. DOI: https://
Amsterdam, Brill. [Link]/10.1080/1357650X.2013.783045
24. Van der Meijden, H and Tesselhof, M 2015 Met blind 31. Weigelt-Marom, H and Weintraub, N 2018
typen beter spellen en stellen op de computer [Better Keyboarding versus handwriting speed of higher
spelling and composition skills after mastering touch education students with and without learning
typing]. Levende Talen, 16: 3–15. disabilities. Comput. Educ, 117: 132–140. DOI: https://
25. Van Horenbeeck, E, Pauwaert, T, Van Waes, L and [Link]/10.1016/[Link].2017.10.008
Leijten, M 2015 A generic XML-structure for logging 32. Witt, S T, Laird, A R and Meyerand, M E 2008
human computer interaction (Version: 1.3). Antwerp: Functional neuroimaging correlates of finger-tapping
University of Antwerp. task variations: an ALE meta-analysis. Neuroimage,
26. Van Waes, L and Leijten, M 2015 Fluency in 42: 343–356. DOI: [Link]
Writing: A Multidimensional Perspective on neuroimage.2008.04.025
How to cite this article: Van Waes, L, Leijten, M, Pauwaert, T and Van Horenbeeck, E 2019 A Multilingual Copy Task:
Measuring Typing and Motor Skills in Writing with Inputlog. Journal of Open Research Software, 7: 30. DOI: [Link]
org/10.5334/jors.234
Copyright: © 2019 The Author(s). This is an open-access article distributed under the terms of the Creative Commons
Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium,
provided the original author and source are credited. See [Link]