TestAS Engineering Module Overview
TestAS Engineering Module Overview
To ensure quality and fairness, the TestAS Engineering Module undergoes a comprehensive construction process that involves item development by subject matter experts, pilot testing with diverse international groups, statistical analysis for item difficulty and discrimination, calibration and validation using Item Response Theory (IRT), and final assembly with balanced content and cognitive levels .
The primary objective of the TestAS Engineering Module is to evaluate the cognitive and subject-specific abilities essential for success in engineering and technical degree programs. The design philosophy supports this objective by incorporating psychometric principles to ensure the test's fairness, reliability, and validity across diverse cultural and linguistic backgrounds .
The Formal and Technical Understanding subtest evaluates candidates' logical-technical comprehension by interpreting technical drawings, schematics, and abstract systems, all essential skills for engineering disciplines .
Psychometric principles ensure high reliability of the TestAS Engineering Module by guiding the item development and validation process, including using Cronbach’s α ≥ 0.85 per subtest. Such principles ensure consistency in measuring candidates' abilities across different test administrations .
The scoring system aids in comparative evaluation by standardizing scores with a mean of 100 and a standard deviation of 10, presented on a 70–130 scale. This allows scores to be used comparatively rather than as pass/fail outcomes, providing a clear metric for evaluating candidates' cognitive abilities relative to others .
Security and validity are ensured through item rotation, controlled digital administration environments, and maintaining an item bank. The module also supports computer-based testing since 2020 and is developing adaptive testing algorithms to enhance reliability and security .
Adaptive testing can enhance the TestAS by tailoring questions to the individual's ability level, potentially increasing test accuracy and validity. This approach can result in more efficient assessment by reducing the number of questions and test duration, leading to a better candidate experience and more precise evaluation of abilities .
The TestAS Engineering Module incorporates diversity through its item development process that ensures content neutrality and linguistic accessibility, making it culturally neutral. This is further supported by pilot testing with international students and using standardized scores to avoid cultural bias .
Statistical analysis plays a critical role by assessing item difficulty and discrimination in pilot testing. These analyses ensure that test items are appropriately challenging and can distinguish effectively between different levels of candidate ability, thus supporting the test’s reliability and validity .
The Engineering Module's structure aligns with its goal by including two subtests: Quantitative Problem Solving and Formal and Technical Understanding. These subtests cover mathematical reasoning, modeling, logical-technical comprehension, technical drawings, schematics, and abstract systems, all critical for evaluating an applicant's potential success in engineering disciplines .