Chapter 10
Pre- and True Experimental Research Methods
Determining Cause - Effect Relationships
Vaccine
Negative
Patients
Determining Cause - Effect Relationships
Placebo
Positive
Control Group
Vaccine
Negative
Experimental Group
Random selection and Random assignment
Pre-experimental designs are characterized by
✓ No random selection of participants from a population
Pre-Experimental Designs
✓ No random assignment of subjects/individuals
✓ No control group
One-shot case study design
Pre-experimental designs are characterized by
✓ No random selection of participants from a population
Pre-Experimental Designs
✓ No random assignment of subjects/individuals
✓ No control group
One-group pretest – posttest design
True experimental designs are characterized by
✓ Random selection of participants from a population
TRUE Experimental Designs
✓ Random assignment of subjects/individuals
✓ Control group
Pretest posttest control group design
True experimental designs are characterized by
✓ Random selection of participants from a population
TRUE Experimental Designs
✓ Random assignment of subjects/individuals
✓ Control group
Pretest posttest control group design (>1 treatment/experimental group)
True experimental designs are characterized by
✓ Random selection of participants from a population
TRUE Experimental Designs
✓ Random assignment of subjects/individuals
✓ Control group
Posttest-only control group design
True experimental designs are characterized by
✓ Random selection of participants from a population
TRUE Experimental Designs
✓ Random assignment of subjects/individuals
✓ Control group
Solomon four group design
Internal Validity and External Validity
• Internal validity is synonymous with control.
• External validity is synonymous with generalizability.
• History (extended period of time & other
events’ influences)
• Maturation (natural changes over time)
Threats to • Selection (no random selection)
Internal • Testing (effects of pretest)
Validity • Instrumentation (inaccuracy of scoring
procedures)
• Regression (extreme scores move toward the
mean)
• Mortality (drop-outs)
• Multiple treatment interference (combined
Threats to effects)
• Reactive arrangements (Hawthorne effect,
External participants’ knowledge of the experiment)
Validity • Experimenter effects (effects caused by the
researcher’s involvement in the research)
• Pretest sensitization (the effects of pretest)
Increasing Internal &
External Validity
To maximize the internal validity:
• Randomly select participants from a
population
• Randomly assign them to groups
• Use a control group.
To increase external validity:
• Reduce the researcher’s involvement in
the experiment as much as possible
• …
• Internal Validity: Control
• External Validity: Generalizability
• Too much control → difficult to replicate the
conditions in other settings → less
generalizability
• Randomization
Controlling
• Matching
Extraneous
Variables • Use homogeneous groups (members
of population are very much like)
• Analysis of Covariance (ANCOVA)