0% found this document useful (0 votes)
10 views5 pages

Guidelines for CALICO Journal Reviews

Uploaded by

zeeyevrn
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
10 views5 pages

Guidelines for CALICO Journal Reviews

Uploaded by

zeeyevrn
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Dear Reviewer,

Thank you for your interest in writing a Learning Technology Review for the CALICO Journal
(CJ). If you have been invited to review a particular resource, you will find information below to
guide you in writing your review, which you will notice is divided into a General Description
(1/3 of the review) and Evaluation (2/3 of the review). We encourage you to read published
reviews in the journal’s open-access archives before submission
([Link] Note that contextualizing your review within a broader
discussion of language learning is key, meaning that references should be included and are
particularly useful in the Evaluation section.

Your review should be no more than 3,000 words (including all text, references, entire review,
bio statement) and with 3-4 figures. For figures, please include them on separate pages at the end
of your review, but refer to them in the text of your review (e.g., Figure 1). For each figure, be
sure to introduce it in the text; either before or after the figure, discuss what you would like
readers to notice in the image. For the figure caption, use descriptive language that focuses
readers’ attention on key features. You can also include text boxes and arrows in the figures to
guide readers’ attention. For screen captures and all images, capture the highest resolution and
quality image as possible. Provide all figures again as separate files; for formats, consult the
general Guidelines for Submission document.

Please do not include an abstract in your review. The keywords need to pertain to the learning
technology resource or tool.

If you have any questions, please contact the Learning Technology Review Editor, Catherine
Caws (ccaws@[Link]).
Learning Technology Review Outline

Name of product: Nearpod

Name of reviewer and affiliation: Zeynep EVREN

PRODUCT AT A GLANCE
(Note: Please fill out the table below in point form summary and only cover applicable points.)

Product Type interactive educational platform

Language(s)

Level (beginning, intermediate, advanced; child, adolescent,


adult)
Activities (e.g., games; database building; multiple choice, fill-in
exercises; interactivity; pronunciation, dialog repetition;
listening comprehension; transcription; vocabulary
learning or reading)
Media Format (e.g., online accessibility, app, download, DVD/CD)
Operating System(s) Operating systems, browsers, mobile devices
Hardware Requirements (CPU)
(x speed)
(e.g., sound card, microphone)
(e.g., x colors; screen resolution)
Supplementary Software or (e.g., QuickTime, ver. x; WWW browser, ver. x, Plugins;
Hardware gesture-based or touch screen devices)
Documentation (e.g., User's Guide, Teacher's Guide)
Price (Single user, Multiple copies, Site license, Distribution
Rights)

General description (one third of review)


In this section, please describe in paragraph form:
 Summary of features
 Background information
 Advertising claims, previous reviews
 Documentation: On-line help, printed manuals
Evaluation (two thirds of review)
Technological features
In this section, please discuss in paragraph form:
 Simplicity of installation or access (e.g., adequacy of instructions, trouble free, easy to
uninstall)
 Speed of program, tool, or resource operation (e.g., where are the delays: at startup,
loading videos, web page loading?)
 Reliability of operation (crashes & stalls)
 Platform compatibility (PC/Mac; OS/Browser versions; mobile devices)
 Screen management (esthetics, navigational transparency)
 User interface (ease of use, operational consistency, online help)
 Exploitation of computer potential (effective use of technology such as speech
recognition, speech synthesis, intelligent response handling, student record keeping,
adaptability based on user profiles, www connectivity, sound, graphics, video, etc.).

Pedagogical or authoring features


This is essentially a matter of determining and evaluating what students, teachers, or materials
developers do when they use the program/resource/tool, and how well it is designed. Judgments
here must always be made relative to activity type. You may be personally opposed, for example,
to the use of structuralist grammar exercises, but, in evaluating these, you cannot criticize them
for not being collaborative in nature. You have to judge such exercises relative to how well done
they are as a structuralist activity. (The appropriateness of activities is a separate issue, dealt with
under Teacher Fit). Broadly speaking, activities that are provided in the software/tool or could be
created by authoring tools can be classified into these major types:

1. Instructional (e.g., tutorials, videos, drills, text reconstruction, speaking)


2. Facilitative (e.g., dictionary, database, verb conjugator, spell/grammar checker, authoring
system)
3. Collaborative (e.g., games, simulations, discussion forums, peer group writing)
4. Interactive (e.g., speech recognition, interactive video, interactive or wearable
technologies)

For authoring tools, the review in this section may need to discuss the resource from both the
materials developer/teacher’s point of view and the learner’s experience.

Obvious activity features to consider are


 Linguistic focus (e.g., discourse, syntax, lexis, morphology, spelling, pronunciation)
 Language skills (e.g., reading, listening, writing, speaking, translating, summarizing)
 Pragmatic focus (e.g., information gathering, authentic tasks)
 Cultural focus (e.g., literature, film, pop culture, daily life, cultural history)
 Supplementary/Complementary/Central relationship to the curriculum
Teacher/materials developer fit (approach)
An assessment of teacher fit primarily involves looking at the theoretical underpinnings of
student activities in the program, and judging how well they conform to accepted theories of
cognitive development, second language acquisition, classroom methodology, and current
learning technology expectations. A materials-developer fit examines how well a tool allows a
developer to create materials that align with their pedagogical vision. The review also discusses
technological skills teachers likely need to optimally use the resource, the time likely required
for materials creation, or the amount of creativity they can apply. How flexible and adaptable is
the resource and to what extent can it be modified by the by the instructor?

Referring to relevant theories or findings from the literature adds depth and critical thinking to
this section. Including the linguistic accuracy (e.g., grammaticality, authenticity, typos, etc.) and
the appropriateness of sociocultural representations (e.g., stereotypes, gender bias) also
contribute to how well a program, tool, or resource meets teacher expectations.

Teacher fit is the most critical parameter of the evaluation, for it determines the pedagogical
soundness and appropriateness of the program or the material/activities that can be developed.
No matter how technically brilliant a program may be or how rich the activities it provides, if its
methodology is dubious, if it fails to adhere to its avowed instructional approach, or if it pays
insufficient attention to linguistic accuracy or sociocultural authenticity, then it will be of limited
usefulness.

Not surprisingly, the assessment of teacher fit is the most difficult parameter to determine.
Partly, this is because developers do not always explicitly state the theoretical/methodological
assumptions underlying their program/tool/resource, thereby obliging a reviewer to extract them
by implication. On the other side of the coin, producers are very much aware of what
methodological approaches are currently in favor (e.g., communicative, learner centered,
constructivist, experiential, post-method) and label their products accordingly, whatever the truth
of the matter may be.

Learner fit (design)


In considering learner fit, you are in essence defining the intended user of the program, tool, or
resource. In doing so, you are also determining the extent to which it is appropriate for, or can be
adapted to, the needs of particular kinds of students. Properties affecting learner fit include:
 Linguistic level (e.g., in grammar and vocabulary) and its adaptability and expandability
 Response handling (e.g., error correction, feedback, instructional guidance)
 Adaptation to individual learner differences and different contexts (e.g., age, interests,
learning goals, LSP, heritage language learning)
 Learning styles (e.g., field-dependent/ -independent learning, deductive/ inductive
reasoning) and strategies (e.g., monitoring, rehearsing, planning, repetition)
 Individual/Group work
 Learner control (e.g., sequencing, content, operating parameters)
If any usability testing has been conducted with the program/tool/resource, then discussing it
here would be appropriate.

Summary
Briefly summarize your review, focusing on the main take-away points.

References
References should adhere to the Publication Manual of the American Psychological Association,
6th ed. (2009).

Producer details
Developer/distributor
Address
Contact information: Phone, Email
URL

Reviewer information
Biodata (50 words) and email

Figures
Please include figures at the end of your review, but refer to them in the review (e.g., Figure 1).

Common questions

Powered by AI

The evaluation section improves understanding and potential use by providing a detailed analysis of the tool's technological and pedagogical features, exploring its alignment with learning objectives, and discussing practical applicability and limitations . By considering factors such as installation simplicity, reliability, pedagogical efficacy, and adaptability, the evaluation offers insights into how well the tool serves its educational purpose . This comprehensive analysis aids educators in determining if the tool integrates with their teaching strategy and meets learners' needs .

The pedagogical features influence effectiveness by aligning the tool's activities with accepted educational theories and practices, ensuring that the activities are appropriately designed for the intended language learning outcomes . These features determine how well a tool facilitates various learning activities, such as instructional tasks or collaborative exercises, and their alignment with pedagogical goals influences engagement levels and learning efficacy . Additionally, the cultural and linguistic focus of the activities further impacts the tool's relevance and effectiveness in different educational contexts .

Including figures in a review is important because they provide visual context and support for the descriptive and evaluative commentary, helping readers to better understand the key features and operational aspects of the tool . Figures should be referenced in the text, introduced either before or after they appear, and used to highlight important aspects of the tool . Descriptive captions and potential annotations like text boxes and arrows can focus attention on specific elements, enhancing comprehension and the evaluation process .

Reviewers may encounter challenges such as the lack of explicit statements from developers regarding the theoretical and methodological assumptions of the tool . As a result, reviewers must often infer these assumptions from the functionality and claimed benefits of the tool, which can lead to difficulties in accurately evaluating its theoretical soundness . Additionally, developers might label their products with popular educational approaches to enhance appeal, regardless of the tool's actual alignment with those approaches .

Learner fit plays a critical role by assessing how well a tool meets the specific needs and characteristics of its intended users, such as linguistic level, learning preferences, and individual learning goals . It examines the adaptability to learner differences and contexts, including handling errors and providing feedback, which are key to supporting diverse learning styles and strategies . A tool that aligns well with learner fit is more likely to foster effective individualized learning and achieve desired educational outcomes .

Including evaluation on sociocultural representations is significant because it ensures that the tool reflects accurate and diverse cultural perspectives, avoiding stereotypes and gender biases . This evaluation contributes to the tool's authenticity and relevance, reinforcing its credibility and appropriateness for learners from various backgrounds . Ensuring sociocultural representation is crucial for fostering a more inclusive learning environment and promoting intercultural understanding .

The key consideration for structuring a Learning Technology Review is to divide the review into a General Description, which should account for one third of the review, and Evaluation, which should make up two thirds of the review . It is essential that the reviewer contextualizes their review within a broader discussion of language learning and includes relevant references, especially in the Evaluation section .

A reviewer should assess teacher fit by examining how well the tool aligns with educational theories and methodologies endorsed by teachers, as well as its ease of integration into various pedagogical approaches . This assessment is crucial because it determines the tool's practical utility and adaptability within classroom settings, affecting how effectively teachers can deliver content and engage students . If a tool demonstrates sound pedagogical methodology and provides flexibility for teacher adaptation, it is more likely to be considered a valuable educational resource .

Contextualizing reviews adds value by situating the resource within broader educational and linguistic discussions, ensuring that the evaluation takes into account its theoretical and pedagogical implications . This approach encourages a deeper analysis that connects practical use with established educational theories and methodologies, making the review more relevant and useful for potential users who are seeking to understand the resource's applicability to current learning contexts .

Evaluating the technological features is crucial because it determines the ease of use, compatibility, and reliability of the tool or resource, which are vital for effective implementation and user satisfaction . Factors such as simplicity of installation, speed and reliability of operation, platform compatibility, and effective screen management contribute to understanding how well a resource leverages technology to enhance language learning .

You might also like