Module: Research Concepts – Reliability, Validity,
Sampling, and Variables
Introduction
Research is a systematic process of collecting, analyzing, and interpreting information to increase
our understanding of a phenomenon. In the social sciences, education, health, and other fields, it is
important to ensure that findings are trustworthy, accurate, and relevant. To achieve this,
researchers must understand fundamental concepts such as reliability, validity, sampling,
measurement, and variables. These concepts not only guide how data is collected and analyzed
but also determine the quality and credibility of a study.
This module will explore these concepts in detail, provide examples, and show how they apply in
real-world research scenarios.
I. Reliability
Reliability refers to the consistency or stability of a measurement tool over time. A reliable
instrument produces the same results under consistent conditions.
Importance of Reliability:
Reliable measurements are essential because inconsistent tools produce unpredictable data, which
reduces the credibility of the research findings. Imagine using a weighing scale that gives different
readings for the same object each time—such a scale is unreliable, and its results cannot be
trusted.
Types of Reliability:
1. Test–Retest Reliability – Measures stability over time by administering the same test to the
same respondents at two different points in time.
2. Inter-Rater Reliability – Assesses the degree to which different observers or raters give
consistent scores or judgments.
3. Parallel-Forms Reliability – Compares two equivalent forms of a test to determine consistency.
4. Internal Consistency – Measures how well the items in a single test or questionnaire assess the
same construct.
Example: If a survey on workplace stress produces similar results when given to the same group of
employees after two weeks, it demonstrates good reliability.
II. Validity
While reliability is about consistency, validity is about accuracy. Validity assesses whether an
instrument measures what it is intended to measure.
Importance of Validity:
Even if a test is reliable, it may not be valid. For example, a test that consistently measures a
person's height will always give the same reading (reliable) but will not be valid if you are trying to
measure their intelligence.
Types of Validity:
1. Content Validity – The extent to which a measurement represents all aspects of a given
construct. This often involves expert judgment.
2. Construct Validity – The degree to which an instrument measures the theoretical concept or
construct it claims to measure.
3. Criterion-Related Validity – Evaluates how well one measure predicts an outcome based on
another measure. This includes concurrent and predictive validity.
Example: A depression inventory should contain items that cover emotional, cognitive, and
behavioral symptoms—not just one aspect—if it claims to measure overall depression.
III. Sampling and Measurement
A. Sampling
Sampling is the process of selecting a subset of individuals from a larger population to participate in
a study. It allows researchers to draw conclusions about the whole population without studying
everyone.
Why Sampling is Necessary:
- Studying the entire population can be expensive and time-consuming.
- Sampling makes research feasible while still producing generalizable results if done correctly.
Types of Sampling:
1. Probability Sampling – Every individual has a known chance of selection.
- Simple Random Sampling – Each person has an equal chance.
- Stratified Sampling – Population divided into subgroups, then randomly sampled.
- Cluster Sampling – Population divided into clusters, and whole clusters are randomly chosen.
2. Non-Probability Sampling – Selection is based on convenience or judgment.
- Convenience Sampling – Selecting those easiest to reach.
- Purposive Sampling – Choosing participants who fit specific criteria.
- Snowball Sampling – Existing participants recruit others.
Example: A study on teachers' work-life balance might use stratified sampling to ensure
representation from both elementary and secondary levels.
B. Measurement
Measurement involves assigning numbers, labels, or categories to variables based on specific
rules.
Levels of Measurement (Stevens, 1946):
1. Nominal – Names or categories without order (e.g., gender, blood type).
2. Ordinal – Categories with rank but unequal intervals (e.g., satisfaction rating: satisfied, neutral,
dissatisfied).
3. Interval – Ordered categories with equal intervals, but no true zero (e.g., temperature in Celsius).
4. Ratio – Equal intervals with an absolute zero (e.g., weight, income).
IV. Variables / Types of Variables
Variables are characteristics or factors that can change or vary in research.
Types of Variables:
1. Independent Variable (IV) – The factor manipulated or categorized to observe its effect.
2. Dependent Variable (DV) – The outcome being measured.
3. Control Variables – Factors held constant to prevent them from influencing the DV.
4. Extraneous Variables – Uncontrolled factors that may affect the DV.
Example: In a study examining the effect of exercise (IV) on weight loss (DV), diet could be a
control variable, while stress levels could be an extraneous variable.
V. Summary Table
Concept Definition Example
Reliability Consistency of results Same survey yields same scores over time
Validity Accuracy of measurement Math test measures math skills, not reading
Sampling Selecting part of the population Choosing 100 students from 1,000
Measurement Assigning numbers/labels to variables Rating satisfaction from 1 to 5
Independent Variable Factor changed by researcher Study time
Dependent Variable Outcome measured Test score
VI. References
1. Babbie, E. R. (2021). The Practice of Social Research (15th ed.). Cengage Learning.
2. Creswell, J. W., & Creswell, J. D. (2018). Research Design: Qualitative, Quantitative, and Mixed
Methods Approaches (5th ed.). SAGE Publications.
3. Neuman, W. L. (2014). Social Research Methods: Qualitative and Quantitative Approaches (7th
ed.). Pearson.
4. Trochim, W. M., & Donnelly, J. P. (2020). Research Methods: The Essential Knowledge Base
(3rd ed.). Cengage Learning.
5. Stevens, S. S. (1946). “On the theory of scales of measurement.” Science, 103(2684), 677–680.
[Link]