EVIDENCE BASED PRACTICE
MODULE 3
EVALUATING THE EVIDENCE
Introduction
Evaluating the evidence is the process of critically examining research studies to determine
whether the findings are valid, reliable, clinically relevant, and applicable to patient care.
In Evidence-Based Physiotherapy (EBP), not all published studies are of equal quality. A
physiotherapist must assess the quality of research before applying it in clinical practice.
Evidence evaluation helps answer questions such as:
Is the study scientifically sound?
Can the results be trusted?
Are the findings applicable to my patient?
Will the intervention improve patient outcomes?
Definition
Evaluating the evidence is the systematic process of critically appraising research studies to
determine their validity, reliability, importance, and applicability before integrating them
into clinical decision-making.
Objectives of Evaluating Evidence
After evaluating evidence, a physiotherapist should be able to:
Determine whether research findings are trustworthy.
Identify strengths and weaknesses of a study.
Detect bias and methodological flaws.
Decide whether results can be applied to patients.
Integrate evidence with clinical expertise and patient preferences.
Importance of Evaluating Evidence in Physiotherapy
Evidence evaluation helps physiotherapists:
Choose effective treatment techniques.
Avoid ineffective or harmful interventions.
Improve patient safety.
Promote evidence-based clinical practice.
Optimize rehabilitation outcomes.
Enhance professional credibility.
Steps in Evaluating the Evidence
Step 1: Identify the Research Question
Determine what the researchers intended to investigate.
Ask:
What is the clinical question?
Is it clearly stated?
Is the objective specific?
Physiotherapy Example
Research Question:
"Does eccentric exercise reduce pain in patients with Achilles tendinopathy?"
This question clearly identifies:
Population → Achilles tendinopathy patients
Intervention → Eccentric exercises
Outcome → Pain reduction
Step 2: Evaluate Study Design
Different research questions require different study designs.
Clinical Question Best Study Design
Treatment effectiveness Randomized Controlled Trial (RCT)
Diagnosis Diagnostic Accuracy Study
Prognosis Cohort Study
Risk Factors Case-Control Study
Patient experiences Qualitative Study
Overall evidence Systematic Review & Meta-analysis
Physiotherapy Example
Question:
"Does dry needling reduce neck pain?"
Best evidence:
Randomized Controlled Trial.
Step 3: Assess Validity
Validity refers to whether the study truly measures what it claims to measure.
Two major types:
Internal Validity
Measures whether the observed effect is actually due to the intervention.
Threats include:
Selection bias
Measurement bias
Performance bias
Attrition bias
Example
Two groups receive different rehabilitation programs after ACL reconstruction.
If one group receives additional strength training outside the study, results become biased.
External Validity
Indicates whether findings can be generalized to other patients.
Example
Study participants:
Elite football players aged 18–22 years
Can results be applied to:
Elderly osteoarthritis patients?
Probably not.
Step 4: Assess Reliability
Reliability refers to consistency of measurements.
A reliable assessment gives similar results when repeated.
Examples of reliable physiotherapy tools:
Hand-held dynamometer
Digital goniometer
Isokinetic dynamometer
Force plate
Biodex Balance System
Example
If knee flexion ROM is measured today and tomorrow under identical conditions, similar
results should be obtained.
Step 5: Evaluate Sample Size
Large samples generally provide more reliable results.
Small samples may:
Overestimate treatment effects
Produce unstable conclusions
Physiotherapy Example
Study A:
10 patients after stroke
Study B:
250 patients after stroke
Study B provides stronger evidence.
Step 6: Assess Randomization
Randomization ensures every participant has an equal chance of entering either group.
Benefits:
Reduces selection bias
Produces comparable groups
Improves validity
Example
ACL patients randomly assigned to:
Group A:
Conventional rehabilitation
Group B:
Neuromuscular rehabilitation
Step 7: Allocation Concealment
Researchers enrolling participants should not know future group assignments.
Purpose:
Prevents selection bias.
Step 8: Blinding
Blinding minimizes bias.
Types:
Single blind
Patient unaware of treatment.
Double blind
Patient and assessor unaware.
Triple blind
Patient, assessor, and statistician unaware.
Physiotherapy Example
Comparing therapeutic ultrasound with placebo ultrasound.
Patients should not know whether the machine is active.
Outcome assessor should also remain blinded.
Step 9: Assess Outcome Measures
Outcome measures should be:
Valid
Reliable
Responsive
Clinically meaningful
Common Physiotherapy Outcome Measures
Condition Outcome Measure
Low back Oswestry Disability Index (ODI)
pain
Knee OA WOMAC
Stroke Berg Balance Scale
Balance Timed Up and Go Test
ACL IKDC Score
Shoulder SPADI
General health SF-36
Pain Visual Analogue Scale (VAS), Numeric Pain Rating Scale (NPRS)
Step 10: Evaluate Statistical Analysis
Check whether appropriate statistical tests were used.
Common tests
Data Type Statistical Test
Two independent groups Independent t-test
Same subjects before-after Paired t-test
Three or more groups ANOVA
Association Chi-square
Correlation Pearson/Spearman correlation
Prediction Regression analysis
Step 11: Statistical Significance
Most studies use
p < 0.05
Meaning:
Less than 5% probability that findings occurred by chance.
Example
Pain reduction after exercise
p = 0.003
Statistically significant.
Step 12: Clinical Significance
A statistically significant result may not be clinically meaningful.
Example
Pain score reduced:
From 8/10 to 7.8/10
Although p < 0.05,
Patients may not actually feel better.
Clinical significance asks:
"Does the patient experience meaningful improvement?"
Step 13: Effect Size
Effect size measures how large the treatment effect is.
Interpretation (Cohen's d):
Small = 0.2
Moderate = 0.5
Large = 0.8
Physiotherapy Example
Strength gains after resistance training
Effect size = 0.92
Large clinical benefit.
Step 14: Confidence Interval (CI)
Confidence interval estimates the precision of results.
Example
Pain reduction:
Mean difference = 3.2
95% CI = 2.4–4.0
Narrow CI = more precise.
Step 15: Risk of Bias
Common sources of bias:
Type of Bias Description
Selection bias Unequal participant selection
Performance bias Differences in treatment received
Detection bias Outcome assessment influenced
Attrition bias Participant dropouts
Reporting bias Selective publication of positive results
Step 16: Applicability (Clinical Relevance)
Before applying evidence ask:
Are my patients similar?
Is equipment available?
Is treatment affordable?
Is it acceptable to patients?
Do benefits outweigh risks?
Physiotherapy Example
Study recommends robotic gait training.
Your clinic has no robotic device.
Evidence may not be practically applicable.
Critical Appraisal Checklist
A physiotherapist should ask:
1. Was the research question clearly defined?
2. Was the study design appropriate?
3. Was randomization performed?
4. Was allocation concealed?
5. Was blinding used?
6. Was sample size adequate?
7. Were outcome measures valid?
8. Were statistical analyses appropriate?
9. Are results clinically important?
10. Can findings be applied to my patient?
Physiotherapy Case Example
Clinical Problem
A physiotherapist wants to know whether Blood Flow Restriction Training (BFRT)
improves quadriceps strength after ACL reconstruction.
Research Findings
120 participants
Randomized Controlled Trial
Blinded assessor
Valid outcome measures
Follow-up: 12 weeks
p < 0.001
Effect size = 0.89
Low risk of bias
Evaluation
Strong study design
Adequate sample size
Reliable measurements
Significant results
Large treatment effect
Applicable to sports physiotherapy
Conclusion: The evidence supports incorporating BFRT into rehabilitation after ACL
reconstruction, provided there are no contraindications and the clinician is trained in its use.
Advantages of Evaluating Evidence
Improves quality of patient care.
Supports informed clinical decision-making.
Reduces ineffective treatments.
Enhances patient safety.
Promotes lifelong learning.
Improves rehabilitation outcomes.
Encourages cost-effective healthcare.
Limitations
Requires knowledge of research methodology and statistics.
High-quality evidence may not be available for every condition.
Time-consuming to appraise studies.
Results may not always be generalizable to all patient populations.
Access to full-text research articles may be limited.
LEVELS OF EVIDENCE IN RESEARCH USING QUANTITATIVE METHODS
Introduction
In Evidence-Based Physiotherapy (EBP), clinical decisions should be based on the best
available scientific evidence. However, not all research studies provide the same level of
confidence. Some study designs produce stronger and more reliable evidence than others. The
Levels of Evidence are a hierarchical system used to rank research according to the strength,
quality, and risk of bias of the evidence they provide.
Higher levels of evidence generally offer greater confidence in the results because they use
rigorous study designs that minimize bias and random error.
Definition
Levels of Evidence refer to a hierarchical ranking of research study designs based on their
methodological quality, validity, reliability, and ability to answer clinical questions. This
hierarchy helps healthcare professionals identify the most trustworthy evidence for clinical
decision-making.
Objectives of Levels of Evidence
The levels of evidence help physiotherapists to:
Identify the strongest available evidence.
Differentiate high-quality from low-quality research.
Make evidence-based treatment decisions.
Reduce bias in clinical practice.
Improve patient outcomes.
Support the development of clinical guidelines.
Importance in Physiotherapy
Understanding levels of evidence enables physiotherapists to:
Select effective rehabilitation protocols.
Avoid ineffective or harmful interventions.
Critically appraise research literature.
Develop evidence-based treatment plans.
Improve patient safety and quality of care.
Contribute to research and guideline development.
Hierarchy of Quantitative Evidence
The evidence hierarchy is commonly represented as a pyramid, with the strongest evidence
at the top and the weakest at the bottom.
Level Type of Evidence Strength
Level I Systematic Reviews and Meta-analyses of Randomized Controlled Highest
Trials (RCTs)
Level II Randomized Controlled Trials (RCTs) Very
High
Level III Controlled Clinical Trials (Non-randomized) High
Level IV Cohort Studies and Case-Control Studies Moderate
Level V Cross-Sectional Studies Low
Level VI Case Series and Case Reports Very Low
Level Expert Opinion, Clinical Experience Lowest
VII
Evidence Pyramid
Level I
Systematic Reviews & Meta-analysis
▲
Randomized Trials
▲
Controlled Clinical Trials
▲
Cohort & Case-Control Studies
▲
Cross-Sectional Studies
▲
Case Series / Case Reports
▲
Expert Opinion / Clinical Experience
As we move upward:
Study quality increases.
Risk of bias decreases.
Confidence in results improves.
Level I – Systematic Review and Meta-analysis
Definition
A Systematic Review is a structured review of all available high-quality studies on a specific
clinical question using predefined methods.
A Meta-analysis statistically combines the results of multiple studies to provide an overall
estimate of treatment effect.
Characteristics
Comprehensive literature search.
Clearly defined inclusion and exclusion criteria.
Critical appraisal of included studies.
Combines results from multiple RCTs.
Provides the highest level of quantitative evidence.
Advantages
Highest scientific reliability.
Large combined sample size.
Reduces random error.
Produces strong clinical recommendations.
Limitations
Depends on the quality of included studies.
Publication bias may influence results.
Time-consuming to conduct.
Physiotherapy Example
A systematic review analyzes 25 RCTs evaluating Blood Flow Restriction Training
(BFRT) after ACL reconstruction.
Conclusion: BFRT significantly improves quadriceps strength and functional recovery
compared with conventional rehabilitation.
This provides the strongest evidence supporting BFRT in sports physiotherapy.
Level II – Randomized Controlled Trial (RCT)
Definition
An RCT is an experimental study in which participants are randomly assigned to intervention
or control groups to compare treatment outcomes.
Characteristics
Random allocation.
Control group.
Prospective design.
Blinding whenever possible.
Direct comparison of interventions.
Advantages
Minimizes selection bias.
Strong cause-and-effect evidence.
High internal validity.
Limitations
Expensive.
Time-consuming.
Ethical limitations for some interventions.
Blinding may be difficult in physiotherapy.
Physiotherapy Example
Research Question: Does eccentric exercise reduce pain in Achilles tendinopathy?
Participants:
Group A: Eccentric exercise.
Group B: Conventional stretching.
After 12 weeks:
Group A shows greater pain reduction and improved function.
Conclusion: Eccentric exercise is more effective than stretching.
Level III – Controlled Clinical Trial (Non-randomized)
Definition
Participants receive different interventions, but group allocation is not random.
Characteristics
Intervention study.
Control group present.
No randomization.
Higher risk of selection bias.
Advantages
Easier to conduct than RCTs.
Useful when randomization is not feasible.
Limitations
Greater risk of bias.
Less reliable than RCTs.
Physiotherapy Example
Hospital A provides aquatic therapy for knee osteoarthritis, while Hospital B provides land-
based exercise. Outcomes are compared without random assignment.
Level IV – Cohort Study
Definition
A cohort study follows groups of participants over time to observe outcomes based on
different exposures or interventions.
Characteristics
Observational study.
Prospective or retrospective.
No intervention by researchers.
Measures incidence and prognosis.
Advantages
Useful for prognosis.
Can study multiple outcomes.
Suitable when RCTs are impractical.
Limitations
Confounding variables.
Long follow-up periods.
Cannot definitively establish causation.
Physiotherapy Example
Athletes who complete neuromuscular training are followed for one competitive season and
compared with athletes who do not. The incidence of ACL injuries is recorded.
Level IV – Case-Control Study
Definition
Compares participants with a condition (cases) to those without the condition (controls) to
identify previous exposures or risk factors.
Characteristics
Retrospective.
Begins with the outcome.
Looks backward to identify risk factors.
Advantages
Suitable for rare conditions.
Quick and cost-effective.
Limitations
Recall bias.
Selection bias.
Cannot calculate disease incidence directly.
Physiotherapy Example
Researchers compare athletes with chronic ankle instability to healthy athletes to determine
whether previous ankle sprains increase the risk of long-term instability.
Level V – Cross-Sectional Study
Definition
A cross-sectional study measures exposure and outcome at a single point in time
Characteristics
Snapshot of a population.
Measures prevalence.
No follow-up.
Advantages
Fast.
Inexpensive.
Useful for surveys.
Limitations
Cannot establish cause-and-effect.
Cannot determine the sequence of events.
Physiotherapy Example
A survey of office workers measures the prevalence of neck pain and poor sitting posture
during one month.
Level VI – Case Series and Case Reports
Definition
A case report describes one patient, while a case series describes several patients with similar
conditions.
Characteristics
Descriptive.
No control group.
Often reports unusual cases or innovative treatments.
Advantages
Identifies new clinical observations.
Generates ideas for future research.
Limitations
Cannot establish effectiveness.
Limited generalizability.
Physiotherapy Example
A physiotherapist reports successful rehabilitation of three elite football players with patellar
tendinopathy using a novel isometric exercise protocol.
Level VII – Expert Opinion
Definition
Recommendations based on the experience of clinicians or expert panels rather than
systematic research.
Characteristics
Clinical experience.
Consensus statements.
Narrative reviews.
Opinion articles.
Advantages
Helpful when research evidence is lacking.
Provides practical guidance.
Limitations
Highest risk of bias.
May reflect personal beliefs rather than scientific evidence.
Physiotherapy Example
An experienced sports physiotherapist recommends cryotherapy immediately after acute
ankle sprain based on years of clinical practice, despite limited high-quality research.
Comparison of Levels of Evidence
Level Study Design Randomization Control Strength of
Group Evidence
I Systematic Yes (included Yes Highest
Review/Meta-analysis studies)
II Randomized Controlled Yes Yes Very High
Trial
III Controlled Clinical Trial No Yes High
IV Cohort Study No Observational Moderate
IV Case-Control Study No Observational Moderate
V Cross-Sectional Study No No Low
VI Case Series/Case Report No No Very Low
VII Expert Opinion No No Lowest
Applying Levels of Evidence in Physiotherapy
Example 1: Knee Osteoarthritis
Clinical Question: Does exercise reduce pain?
Level I: Meta-analysis confirms exercise therapy improves pain and function.
Level II: RCT compares strengthening exercises with education alone.
Level III: Non-randomized comparison of aquatic versus land-based exercise.
Level IV: Cohort study follows patients participating in exercise programs.
Level VII: Expert recommends specific exercises based on experience.
The physiotherapist should prioritize Level I evidence while considering patient needs and
available resources.
Example 2: ACL Rehabilitation
Clinical Question: Does Blood Flow Restriction Training improve quadriceps strength after
ACL reconstruction?
Level I: Systematic review shows significant improvements.
Level II: RCT demonstrates greater strength gains with BFRT.
Level III: Controlled trial supports similar findings without randomization.
Level IV: Cohort study reports better return-to-sport outcomes.
Level VI: Case series describes successful rehabilitation in elite athletes.
The strongest recommendation would come from Level I and II evidence.
Limitations of the Evidence Hierarchy
High-level evidence is not available for every clinical question.
RCTs may be impractical or unethical in some situations.
Poorly conducted RCTs may provide weaker evidence than well-conducted
observational studies.
Patient preferences and clinical expertise must always be integrated with research
evidence.
LEVELS OF EVIDENCE CLASSIFICATION SYSTEM
Introduction
In Evidence-Based Practice (EBP), healthcare professionals need a systematic way to judge
the quality and strength of research before applying it to patient care. The Levels of Evidence
Classification System is a standardized framework that ranks research studies according to
their methodological quality, validity, reliability, and risk of bias.
The classification system helps physiotherapists, clinicians, educators, and researchers
determine how much confidence can be placed in research findings. It forms the basis for
developing clinical practice guidelines, treatment recommendations, and healthcare
policies.
Definition
The Levels of Evidence Classification System is a hierarchical framework used to
categorize research studies based on the strength of scientific evidence they provide for
answering clinical questions. It ranks evidence from the highest quality (systematic reviews
and randomized controlled trials) to the lowest quality (expert opinion).
Objectives of the Levels of Evidence Classification System
The classification system aims to:
Identify the highest-quality evidence available.
Assist clinicians in making evidence-based decisions.
Reduce the influence of bias in clinical practice.
Standardize the evaluation of research studies.
Support the development of clinical practice guidelines.
Improve patient care and treatment outcomes.
Facilitate research appraisal and interpretation.
Need for a Classification System
Without a standardized classification system:
Clinicians may rely on poor-quality studies.
Conflicting research findings become difficult to interpret.
Treatment decisions may be inconsistent.
Clinical guidelines may not be evidence-based.
A classification system provides a common language for evaluating research quality and
ensures that stronger evidence is given greater importance.
Characteristics of a Good Classification System
An effective evidence classification system should:
Be simple and easy to understand.
Clearly differentiate between levels of evidence.
Consider study design and methodological quality.
Be applicable to different types of clinical questions.
Be reproducible and transparent.
Support evidence-based clinical decision-making.
Common Levels of Evidence Classification Systems
Several organizations have developed evidence classification systems. The most commonly
used include:
1. Oxford Centre for Evidence-Based Medicine (OCEBM)
2. Joanna Briggs Institute (JBI)
3. GRADE (Grading of Recommendations Assessment, Development and Evaluation)
4. National Health and Medical Research Council (NHMRC)
5. American Physical Therapy Association (APTA) Evidence Framework
Although the terminology varies slightly, all systems rank evidence from stronger to weaker
based on study design and quality.
Oxford Centre for Evidence-Based Medicine (OCEBM) Classification
The OCEBM is one of the most widely used systems in medicine and physiotherapy.
Level Type of Evidence Examples
Level 1 Systematic Reviews, Meta-analyses, High- Best evidence for treatment
quality Randomized Controlled Trials effectiveness
Level 2 Individual Randomized Controlled Trials or Clinical intervention studies
Prospective Cohort Studies
Level 3 Non-randomized Controlled Studies, Case- Observational comparative studies
Control Studies
Level 4 Case Series and Poor-quality Cohort Studies Descriptive clinical research
Level 5 Expert Opinion, Narrative Reviews, Lowest level of evidence
Laboratory Research
Description of Each Level
Level 1 – Highest Level of Evidence
Definition
Evidence obtained from:
Systematic reviews
Meta-analyses
High-quality randomized controlled trials
Characteristics
Comprehensive literature review.
Low risk of bias.
Large sample sizes.
Consistent findings across studies.
Physiotherapy Example
A meta-analysis of 30 randomized controlled trials concludes that exercise therapy
significantly improves pain and physical function in patients with knee osteoarthritis,
providing strong support for exercise as a first-line intervention.
Strengths
Highest reliability.
Strong clinical recommendations.
Excellent external validity.
Limitations
Dependent on the quality of included studies.
Publication bias may influence conclusions.
Level 2 – High-Quality Individual Studies
Definition
Evidence from:
Randomized Controlled Trials (RCTs)
Prospective cohort studies
Characteristics
Random allocation (RCTs).
Controlled interventions.
Prospective follow-up.
Reduced bias.
Physiotherapy Example
An RCT compares Blood Flow Restriction Training (BFRT) with conventional
strengthening after ACL reconstruction. Patients receiving BFRT show greater improvements
in quadriceps strength and functional outcomes.
Strengths
High internal validity.
Strong evidence for treatment effectiveness.
Limitations
Expensive and time-consuming.
Blinding may be difficult in rehabilitation studies.
Level 3 – Moderate Evidence
Definition
Evidence from:
Non-randomized controlled trials.
Case-control studies.
Characteristics
No randomization.
Greater risk of bias.
Useful when RCTs are impractical.
Physiotherapy Example
Researchers compare outcomes of patients receiving aquatic therapy in one rehabilitation
center with those receiving land-based exercise in another center, without random
assignment.
Strengths
Practical in real-world settings.
Useful for studying risk factors.
Limitations
Higher susceptibility to confounding factors.
Lower internal validity than RCTs.
Level 4 – Limited Evidence
Definition
Evidence from:
Case series.
Poor-quality cohort studies.
Characteristics
Descriptive.
No control group.
Limited ability to establish cause and effect.
Physiotherapy Example
A physiotherapist reports rehabilitation outcomes of six elite football players treated with a
new proprioceptive training program after ankle sprains.
Strengths
Generates new clinical ideas.
Useful for rare conditions.
Limitations
Small sample size.
Cannot establish treatment effectiveness.
Level 5 – Lowest Level of Evidence
Definition
Evidence based on:
Expert opinion.
Clinical experience.
Narrative reviews.
Laboratory research without clinical validation.
Characteristics
No systematic methodology.
High risk of bias.
Often used when research evidence is unavailable.
Physiotherapy Example
An experienced sports physiotherapist recommends a specific warm-up routine for injury
prevention based primarily on years of clinical practice rather than high-quality research.
Strengths
Provides guidance in areas lacking research.
Draws on extensive clinical expertise.
Limitations
Subjective.
Least reliable for determining treatment effectiveness.
GRADE Classification System
The GRADE system is widely used to assess the certainty of evidence and the strength of
recommendations in clinical guidelines.
Quality of Interpretation
Evidence
High Further research is very unlikely to change confidence in the estimate
of effect.
Moderate Further research may have an important impact on confidence in the
estimate.
Low Further research is likely to change the estimate of effect.
Very Low The true effect is likely to be substantially different from the
estimated effect.
Physiotherapy Example
When developing guidelines for managing chronic low back pain:
Multiple high-quality RCTs supporting exercise therapy would be graded as High
certainty.
Limited observational studies on a newer intervention might receive a Low certainty
rating.
Joanna Briggs Institute (JBI) Levels of Evidence
The JBI system classifies evidence according to the type of clinical question, such as:
Effectiveness of interventions.
Diagnostic accuracy.
Prognosis.
Etiology and risk.
Economic evaluation.
Meaningfulness (qualitative research).
This allows researchers to select the most appropriate study design for different healthcare
questions.
Choosing the Appropriate Level of Evidence
Clinical Question Preferred Study Design Evidence Level
Treatment effectiveness Systematic Review / RCT Level 1–2
Diagnosis Diagnostic Accuracy High
Study
Prognosis Cohort Study Moderate
Risk factors Case-Control Study Moderate
Prevalence Cross-Sectional Study Lower
Rare clinical conditions Case Series Low
Application in Physiotherapy
Example 1: Knee Osteoarthritis
Clinical Question: Does strengthening exercise reduce pain?
Level 1: Meta-analysis demonstrates consistent pain reduction and functional
improvement.
Level 2: Individual RCTs confirm the effectiveness of strengthening programs.
Level 3: Non-randomized comparative studies provide additional supportive
evidence.
Level 5: Expert opinion recommends specific exercise progressions when evidence is
limited.
A physiotherapist should prioritize Level 1 and Level 2 evidence while considering the
patient's preferences and clinical circumstances.
Example 2: Stroke Rehabilitation
Clinical Question: Does task-oriented training improve upper limb function?
High-quality systematic reviews and RCTs support task-oriented training as an
effective rehabilitation strategy.
Case series may provide preliminary evidence for novel technologies, such as robotic-
assisted therapy, until stronger studies become available.
Advantages of the Levels of Evidence Classification System
Promotes evidence-based clinical practice.
Improves patient safety.
Standardizes research appraisal.
Reduces bias in decision-making.
Supports guideline development.
Encourages the use of high-quality research.
Helps allocate healthcare resources effectively.
Improves consistency in clinical care.
Limitations of the Classification System
High-level evidence may not exist for every clinical problem.
Study design alone does not guarantee high quality; poorly conducted RCTs may
provide weaker evidence than well-conducted observational studies.
Some important clinical questions cannot be answered ethically through randomized
trials.
The classification system should be used alongside critical appraisal, clinical
expertise, and patient preferences.
OUTCOME MEASUREMENT
Introduction
Outcome Measurement is a fundamental component of Evidence-Based Physiotherapy
(EBP). It involves the systematic assessment of a patient's health status before, during, and
after an intervention to determine whether treatment has achieved its intended goals.
Outcome measurement enables physiotherapists to objectively evaluate the effectiveness of
rehabilitation, monitor patient progress, modify treatment plans when necessary, and
demonstrate the value of physiotherapy services. Reliable outcome measures also provide
evidence for clinical research, quality improvement, and healthcare decision-making.
Definition
Outcome Measurement is the process of using standardized, valid, and reliable assessment
tools to evaluate changes in a patient's health status, function, participation, and quality of life
following healthcare interventions.
Objectives of Outcome Measurement
Outcome measurement aims to:
Evaluate treatment effectiveness.
Monitor patient progress over time.
Assist in clinical decision-making.
Compare different treatment approaches.
Support evidence-based practice.
Improve communication among healthcare professionals.
Enhance patient satisfaction.
Contribute to clinical research and audits.
Importance of Outcome Measurement in Physiotherapy
Outcome measurement helps physiotherapists to:
Assess baseline patient status.
Set realistic rehabilitation goals.
Measure improvement objectively.
Identify patients who are not progressing.
Modify treatment plans appropriately.
Demonstrate treatment effectiveness.
Improve accountability and quality of care.
Support insurance and reimbursement claims.
Characteristics of a Good Outcome Measure
An ideal outcome measure should be:
1. Valid
Measures what it is intended to measure.
Example:
The Visual Analogue Scale (VAS) accurately measures pain intensity.
2. Reliable
Produces consistent results under similar conditions.
Example:
A goniometer should provide similar knee flexion measurements when used repeatedly by
trained clinicians.
3. Responsive
Able to detect clinically important changes over time.
Example:
The Oswestry Disability Index (ODI) detects improvement in patients with low back pain
after rehabilitation.
4. Practical
Easy to administer, inexpensive, and time-efficient.
Example:
The Timed Up and Go (TUG) test takes less than 5 minutes.
5. Interpretable
Scores should be easy to understand and clinically meaningful.
Types of Outcome Measures
Outcome measures are broadly classified into:
1. Patient-Reported Outcome Measures (PROMs)
Patients report their own symptoms, function, and quality of life.
Examples:
Visual Analogue Scale (VAS)
Numeric Pain Rating Scale (NPRS)
Oswestry Disability Index (ODI)
WOMAC
SPADI
DASH
IKDC
SF-36
Advantages
Reflect patient's perspective.
Easy to administer.
Assess pain and disability.
Limitations
Subjective.
Influenced by emotions and expectations.
Physiotherapy Example
A patient with chronic low back pain reports:
Before treatment:
VAS = 8/10
After 6 weeks:
VAS = 3/10
Pain has significantly improved.
2. Performance-Based Outcome Measures
Measure the patient's ability to perform functional tasks.
Examples
Timed Up and Go Test (TUG)
Six-Minute Walk Test (6MWT)
Ten-Meter Walk Test
Sit-to-Stand Test
Berg Balance Scale
Functional Reach Test
Advantages
Objective.
Reflect real-life function.
Limitations
Require space and equipment.
Influenced by patient motivation.
Physiotherapy Example
Stroke rehabilitation
Before therapy:
TUG = 28 seconds
After rehabilitation:
TUG = 14 seconds
Mobility has significantly improved.
3. Impairment-Based Outcome Measures
Assess physical impairments.
Examples
Range of Motion (ROM)
Manual Muscle Testing (MMT)
Hand-held Dynamometry
Grip Strength
Muscle Length Tests
Joint Stability Tests
Physiotherapy Example
ACL Rehabilitation
Quadriceps strength
Week 1:
MMT = Grade 3
Week 8:
MMT = Grade 5
Significant strength improvement.
4. Physiological Outcome Measures
Measure physiological functions.
Examples
Heart Rate
Blood Pressure
VO₂ Max
Peak Expiratory Flow Rate
Oxygen Saturation
Pulmonary Function Tests
Physiotherapy Example
Cardiac rehabilitation
Resting heart rate
Before program: 92 bpm
After 8 weeks:n74 bpm
Cardiovascular fitness improved.
Domains of Outcome Measurement
1. Pain
Common Outcome Measures
Visual Analogue Scale (VAS)
Numeric Pain Rating Scale (NPRS)
McGill Pain Questionnaire
Physiotherapy Example
Tennis elbow rehabilitation
Pain decreases from: VAS = 7 to VAS = 2
2. Range of Motion (ROM)
Measured using:
Universal Goniometer
Digital Goniometer
Inclinometer
Physiotherapy Example
Frozen Shoulder
Initial shoulder abduction 70°
After physiotherapy 160°
3. Muscle Strength
Assessment Tools
Manual Muscle Testing
Hand-held Dynamometer
Isokinetic Dynamometer
Physiotherapy Example
After rotator cuff repair
Shoulder abduction strength
Grade 2 → Grade 5
4. Functional Mobility
Outcome Measures
Timed Up and Go Test
Six-Minute Walk Test
Five Times Sit-to-Stand Test
Physiotherapy Example
Total Knee Replacement
Walking distance
Before rehabilitation 120 m
After rehabilitation 420 m
5. Balance
Outcome Measures
Berg Balance Scale
Functional Reach Test
Y Balance Test
Star Excursion Balance Test
Physiotherapy Example
Older adult
Berg Balance Scale
38/56
52/56
Fall risk reduced.
6. Quality of Life
Outcome Measures
SF-36
EQ-5D
WHOQOL
Physiotherapy Example
Cancer survivor rehabilitation
Improved physical functioning and emotional well-being following exercise therapy.
Common Physiotherapy Outcome Measures
Clinical Condition Outcome Measure
Low Back Pain Oswestry Disability Index (ODI)
Neck Pain Neck Disability Index (NDI)
Knee Osteoarthritis WOMAC
ACL Injury IKDC, Lysholm Knee Score
Shoulder Disorders SPADI, Constant Score
Stroke Fugl-Meyer Assessment, Barthel Index
Parkinson's Disease UPDRS
Balance Disorders Berg Balance Scale
Falls Risk Timed Up and Go (TUG)
General Health SF-36
International Classification of Functioning (ICF) Framework
The World Health Organization (WHO) recommends outcome measurement based on the
International Classification of Functioning, Disability and Health (ICF).
The ICF framework has three major domains:
1. Body Structure and Function
Measures impairments.
Examples
Pain
ROM
Muscle strength
Spasticity
Physiotherapy Example
Increase knee flexion from 80° to 130°.
2. Activity
Measures the ability to perform tasks.
Examples
Walking
Stair climbing
Dressing
Sit-to-Stand
Physiotherapy Example
Patient walks independently after stroke rehabilitation.
3. Participation
Measures involvement in daily life.
Examples
Work
Sports
School
Social activities
Physiotherapy Example
Football player returns to competitive sport after ACL reconstruction.
Selecting an Appropriate Outcome Measure
The physiotherapist should consider:
Patient's condition.
Age.
Clinical setting.
Purpose of assessment.
Validity and reliability.
Time available.
Equipment required.
Sensitivity to change.
Cultural and language suitability.
Outcome Measurement Process
Step 1
Assess baseline status.
Example
Pain VAS = 8
Step 2
Develop treatment goals.
Example
Reduce pain to VAS <3.
Step 3
Provide intervention.
Example
Exercise therapy
Manual therapy
Electrotherapy
Step 4
Reassess outcomes.
Example
VAS
ROM
Strength
Function
Step 5
Compare results.
Determine whether goals have been achieved.
Step 6
Modify treatment if necessary.
Clinical Example
Patient
55-year-old female
Knee Osteoarthritis
Baseline Assessment
Pain
VAS = 8
ROM
90°
WOMAC
68/96
Walking distance
120 m
Intervention
Quadriceps strengthening
Stretching
Balance training
Patient education
Aerobic exercise
Eight Weeks Later
Pain
VAS = 3
ROM
125°
WOMAC
32/96
Walking distance
420 m
Interpretation
Outcome measures indicate significant improvement in pain, mobility, function, and walking
capacity, demonstrating the effectiveness of the rehabilitation program.
Advantages of Outcome Measurement
Provides objective evidence of treatment effectiveness.
Improves patient-centered care.
Supports clinical decision-making.
Enhances communication among healthcare professionals.
Facilitates research and quality improvement.
Assists in developing clinical guidelines.
Increases accountability and professional credibility.
Encourages continuous monitoring of patient progress.
Limitations of Outcome Measurement
Some tools require specialized training.
Certain measures may be time-consuming.
Patient-reported measures can be influenced by motivation, mood, and expectations.
Cultural or language differences may affect responses.
No single outcome measure assesses all aspects of health; multiple measures are often
needed.
Outcome Measures in Sports Physiotherapy
Sports Injury Recommended Outcome Measures
ACL Reconstruction IKDC, Lysholm Knee Score, Single-Leg Hop Tests, Isokinetic
Strength Testing
Ankle Sprain FAAM, Cumberland Ankle Instability Tool (CAIT), Star Excursion
Balance Test
Shoulder Instability WOSI, SPADI, Constant-Murley Score
Achilles VISA-A Questionnaire
Tendinopathy
Patellar VISA-P Questionnaire
Tendinopathy
Hamstring Injury Active Knee Extension Test, Nordic Hamstring Strength Test,
Sprint Performance
BIOSTATISTICS
Introduction
Biostatistics is the branch of statistics that applies statistical principles and methods to
biological, medical, and health sciences. It plays a vital role in Evidence-Based
Physiotherapy (EBP) by helping clinicians design research, analyze data, interpret results,
and make informed clinical decisions.
Physiotherapists use biostatistics to determine whether a treatment is effective, compare
rehabilitation methods, assess patient outcomes, and critically appraise research. It transforms
raw clinical data into meaningful information that supports safe and effective patient care.
Definition
Biostatistics is the application of statistical methods to the collection, organization, analysis,
interpretation, and presentation of data related to biological, medical, and health sciences.
Objectives of Biostatistics
Biostatistics aims to:
Collect accurate health-related data.
Organize and summarize research findings.
Analyze clinical data scientifically.
Compare treatment effectiveness.
Test research hypotheses.
Draw valid conclusions from research.
Support evidence-based clinical practice.
Improve patient care and healthcare decision-making.
Importance of Biostatistics in Physiotherapy
Biostatistics helps physiotherapists to:
Evaluate treatment outcomes.
Compare rehabilitation techniques.
Measure changes in pain, strength, and function.
Interpret research findings.
Develop clinical guidelines.
Conduct high-quality research.
Improve patient safety and quality of care.
Support publication of scientific studies.
Applications of Biostatistics in Physiotherapy
Biostatistics is used in:
Clinical trials.
Sports injury research.
Neurological rehabilitation.
Cardiopulmonary rehabilitation.
Orthopaedic rehabilitation.
Community-based rehabilitation.
Outcome measurement.
Quality improvement programs.
Epidemiological studies.
Systematic reviews and meta-analyses.
Physiotherapy Example
A physiotherapist compares Blood Flow Restriction Training (BFRT) with conventional
strengthening after ACL reconstruction. Biostatistics helps determine whether the differences
in muscle strength are statistically significant.
Steps in Biostatistical Analysis
1. Define the research problem.
2. Formulate research objectives.
3. Develop hypotheses.
4. Collect data.
5. Organize data.
6. Analyze data using statistical tests.
7. Interpret results.
8. Draw conclusions.
9. Report findings.
Types of Data
1. Qualitative (Categorical) Data
Describes characteristics or categories.
Types
Nominal Data
Categories without any order.
Examples:
Gender
Blood group
Type of injury
Dominant hand
Physiotherapy Example
Comparing the number of male and female athletes with ACL injuries.
Ordinal Data
Categories with a natural order.
Examples:
Pain severity (Mild, Moderate, Severe)
Muscle strength grades (MMT 0–5)
Functional Independence Measure (FIM)
Physiotherapy Example
Grading spasticity using the Modified Ashworth Scale.
2. Quantitative (Numerical) Data
Data expressed as numbers.
A. Discrete Data
Whole numbers.
Examples:
Number of falls
Number of therapy sessions
Number of injuries
B. Continuous Data
Can take any value within a range.
Examples:
Height
Weight
Blood pressure
Range of motion
Walking speed
Physiotherapy Example
Measuring knee flexion from 90° to 130° using a goniometer
Levels of Measurement
Scale Characteristics Example
Nomina Categories only Gender, Injury type
l
Ordinal Ranked categories Pain severity, MMT grades
Interval Equal intervals, no true zero Temperature (°C)
Ratio Equal intervals with true zero Height, Weight, ROM, Time
Descriptive Statistics
Descriptive statistics summarize and present data in a meaningful way.
Measures of Central Tendency
Mean
Average value.
Formula
Mean = Sum of observations ÷ Number of observations
Example
Pain scores:
6, 5, 7, 8, 4
Mean = 6
Median
Middle value after arranging data in order.
Example:
2, 4, 5, 7, 9
Median = 5
Useful for skewed data.
Mode
Most frequently occurring value.
Example:
5, 5, 6, 7, 8
Mode = 5
Measures of Dispersion
These describe how spread out the data are.
Range
Difference between highest and lowest values.
Example:
Highest = 90°
Lowest = 40°
Range = 50°
Variance
Measures the average squared deviation from the mean.
Higher variance indicates greater variability.
Standard Deviation (SD)
The most common measure of variability.
Interpretation
Small SD → Data clustered closely around the mean.
Large SD → Data widely scattered.
Physiotherapy Example
Quadriceps strength
Group A
Mean = 45 kg
SD = 2 kg
Group B
Mean = 45 kg
SD = 10 kg
Group A has more consistent strength measurements.
Data Presentation
Tables
Useful for organizing numerical information.
Example:
Patient Pain Score (VAS)
1 8
2 6
3 5
Graphs
Bar Chart
Used for categorical data.
Example:
Number of patients with different shoulder injuries.
Histogram
Shows frequency distribution of continuous data.
Example:
Distribution of walking speed among stroke patients.
Pie Chart
Shows proportions or percentages.
Example:
Types of sports injuries in a clinic.
Line Graph
Shows changes over time.
Example:
Pain reduction over six weeks of rehabilitation.
Scatter Plot
Displays the relationship between two continuous variables.
Example:
Relationship between BMI and knee pain severity.
Probability
Probability is the likelihood that an event will occur.
Values range from:
0 = Impossible
1 = Certain
Physiotherapy Example
The probability of an athlete sustaining a hamstring injury during a season can be estimated
using injury surveillance data.
Sampling
Sampling is the process of selecting participants from a larger population.
Types of Sampling
Probability Sampling
Simple random sampling
Systematic sampling
Stratified sampling
Cluster sampling
Non-Probability Sampling
Convenience sampling
Purposive sampling
Quota sampling
Snowball sampling
Physiotherapy Example
Randomly selecting 100 patients with knee osteoarthritis from a hospital database for a
clinical trial.
Hypothesis
A hypothesis is a testable statement about a relationship or difference.
Null Hypothesis (H₀)
States that there is no difference or no association.
Example:
"There is no difference in pain reduction between exercise therapy and electrotherapy."
Alternative Hypothesis (H₁)
States that a difference or association exists.
Example:
"Exercise therapy reduces pain more than electrotherapy."
Errors in Hypothesis Testing
Type I Error (α)
Rejecting a true null hypothesis (False Positive).
Example:
Concluding that a new physiotherapy intervention is effective when it is not.
Type II Error (β)
Failing to reject a false null hypothesis (False Negative).
Example:
Concluding that exercise therapy has no benefit when it actually improves outcomes.
Significance Level (p-value)
The p-value indicates the probability that the observed results occurred by chance.
Interpretation
p < 0.05 → Statistically significant.
p ≥ 0.05 → Not statistically significant.
Physiotherapy Example
An RCT comparing two rehabilitation programs reports p = 0.01, indicating that the
difference in outcomes is unlikely to be due to chance.
Confidence Interval (CI)
A confidence interval estimates the range within which the true value is likely to lie.
Example
Mean pain reduction = 3.5 points
95% CI = 2.8 to 4.2
A narrow confidence interval indicates greater precision.
Inferential Statistics
Inferential statistics allow researchers to draw conclusions about a population based on
sample data.
Common uses include:
Comparing treatment groups.
Identifying relationships.
Making predictions.
Testing hypotheses.
Common Statistical Tests
Parametric Tests
Used when data are normally distributed.
Statistical Test Purpose Physiotherapy Example
Independent t- Compare two independent BFRT vs conventional exercise after
test groups ACL reconstruction
Paired t-test Compare the same group Pain before and after manual therapy
before and after treatment
One-way Compare three or more groups Compare aquatic therapy, cycling, and
ANOVA strengthening exercises
Pearson Assess relationship between Relationship between quadriceps
Correlation continuous variables strength and hop distance
Non-Parametric Tests
Used when data are not normally distributed or are ordinal.
Statistical Test Purpose Physiotherapy Example
Mann–Whitney U Compare two independent Compare pain scores between two
Test groups treatment groups
Wilcoxon Signed- Compare paired Compare pre- and post-treatment pain
Rank Test observations scores
Kruskal–Wallis Compare three or more Compare disability scores across
Test independent groups three rehabilitation methods
Spearman Assess relationship between Relationship between pain severity
Correlation ranked variables and disability score
Correlation
Correlation measures the strength and direction of the relationship between two variables.
Correlation Coefficient (r) Interpretation
+1 Perfect positive correlation
+0.75 Strong positive correlation
+0.50 Moderate positive correlation
0 No correlation
–0.50 Moderate negative correlation
–1 Perfect negative correlation
Physiotherapy Example
A positive correlation between quadriceps strength and single-leg hop distance after ACL
reconstruction indicates that stronger muscles are associated with better functional
performance.
Regression Analysis
Regression predicts the value of one variable based on another.
Physiotherapy Example
Predicting walking speed in stroke patients using lower-limb muscle strength and balance
scores.
Sensitivity and Specificity
These are used to evaluate diagnostic tests.
Sensitivity: Ability of a test to correctly identify patients with the condition (true
positives).
Specificity: Ability of a test to correctly identify patients without the condition (true
negatives).
Physiotherapy Example
Assessing the accuracy of the Lachman Test for diagnosing ACL injuries.
Role of Biostatistics in Evidence-Based Physiotherapy
Biostatistics enables physiotherapists to:
Critically appraise research.
Interpret clinical trial results.
Compare treatment effectiveness.
Develop evidence-based treatment plans.
Conduct systematic reviews and meta-analyses.
Improve patient outcomes through data-driven decision-making.
Advantages of Biostatistics
Supports scientific decision-making.
Improves research quality.
Enhances interpretation of clinical data.
Helps identify effective interventions.
Reduces bias.
Facilitates evidence-based practice.
Assists in healthcare planning and policy development.
Limitations of Biostatistics
Requires appropriate study design and data collection.
Incorrect statistical methods can produce misleading results.
Statistical significance does not always imply clinical significance.
Results depend on sample size and data quality.
Interpretation requires statistical knowledge.
Clinical Case Example
Research Question: Does Blood Flow Restriction Training (BFRT) improve quadriceps
strength after ACL reconstruction compared with conventional strengthening?
Study Design: Randomized Controlled Trial
Participants: 80 post-ACL reconstruction patients.
Outcome Measures:
Quadriceps strength (Hand-held Dynamometer)
IKDC score
Single-leg hop distance
Statistical Analysis:
Independent t-test for between-group comparisons.
Paired t-test for within-group changes.
Significance level: p < 0.05.
95% confidence intervals reported.
Results:
BFRT group demonstrated significantly greater strength gains (p = 0.003) and higher
IKDC scores than the conventional exercise group.
Conclusion:
Biostatistical analysis supports the effectiveness of BFRT as part of ACL rehabilitation.
THE CRITICAL REVIEW OF RESEARCH USING QUALITATIVE METHODS
Introduction
Evidence-Based Physiotherapy (EBP) integrates the best available research evidence,
clinical expertise, and patient values. While quantitative research answers questions such as
"Does a treatment work?", qualitative research explores "How do patients experience
illness, rehabilitation, and healthcare?"
A critical review (critical appraisal) of qualitative research is the systematic evaluation of a
study's trustworthiness, methodological rigor, credibility, relevance, and applicability to
clinical practice. It helps physiotherapists determine whether qualitative findings can improve
patient-centered care and rehabilitation outcomes.
Definition
A critical review of qualitative research is the systematic process of evaluating the quality,
credibility, trustworthiness, relevance, and applicability of qualitative studies before applying
their findings to clinical practice.
Objectives of Critical Review
The objectives are to:
Determine the quality of qualitative research.
Assess the credibility of study findings.
Identify strengths and limitations.
Evaluate methodological rigor.
Assess whether findings are transferable to clinical practice.
Improve evidence-based decision-making.
Promote patient-centered physiotherapy.
Importance in Physiotherapy
Critical appraisal of qualitative research helps physiotherapists:
Understand patients' experiences of pain and disability.
Identify barriers to rehabilitation.
Improve communication with patients.
Enhance patient satisfaction.
Develop individualized treatment plans.
Improve adherence to exercise programs.
Support holistic rehabilitation.
What is Qualitative Research?
Qualitative research focuses on understanding:
Experiences
Beliefs
Feelings
Perceptions
Behaviors
Social interactions
Rather than using numbers, it collects non-numerical data through interviews, focus groups,
observations, diaries, and document analysis.
Examples of Qualitative Research Questions
How do stroke survivors experience physiotherapy rehabilitation?
What challenges do athletes face during return-to-sport after ACL reconstruction?
How do patients perceive chronic low back pain?
What motivates older adults to continue home exercise programs?
Characteristics of Qualitative Research
Explores human experiences.
Uses open-ended questions.
Small sample sizes.
Flexible research design.
Data collected in natural settings.
Emphasizes participants' perspectives.
Produces rich, descriptive findings.
Common Qualitative Research Designs
Design Purpose Physiotherapy Example
Phenomenology Explores lived Experiences of patients recovering from
experiences stroke
Grounded Theory Develops theories How athletes regain confidence after ACL
injury
Ethnography Studies cultures and Rehabilitation practices within elite sports
behaviors teams
Case Study In-depth investigation of Rehabilitation journey of a patient with
a case spinal cord injury
Narrative Explores personal stories Life experiences of a patient with chronic
Research pain
Why Critically Review Qualitative Research?
Not all qualitative studies are equally trustworthy. Critical review helps determine:
Was the study well designed?
Were appropriate participants selected?
Was data collected rigorously?
Were findings supported by evidence?
Can the findings be applied to physiotherapy practice?
Components of Critical Review
1. Research Question
The research question should be:
Clearly stated.
Focused.
Relevant.
Appropriate for qualitative research.
Physiotherapy Example
Research Question:
"What are the experiences of football players returning to sport after ACL reconstruction?"
This question explores experiences rather than treatment effectiveness.
2. Research Design
The chosen qualitative design should match the research question.
Example
If the aim is to understand patients' lived experiences, phenomenology is appropriate.
Physiotherapy Example
To explore how stroke survivors adapt to daily activities after rehabilitation, a
phenomenological study is suitable.
3. Sampling
Qualitative studies usually use purposive sampling, selecting participants who have direct
experience of the phenomenon.
Types of Sampling
Purposive sampling
Snowball sampling
Convenience sampling
Theoretical sampling
Physiotherapy Example
Researchers recruit 15 athletes who have successfully returned to sport after ACL
reconstruction to explore their rehabilitation experiences.
4. Sample Size
Qualitative studies generally include fewer participants than quantitative studies.
Typical sample sizes:
Interviews: 10–30 participants.
Focus groups: 6–12 participants per group.
The emphasis is on data saturation, the point at which no new themes emerge.
Physiotherapy Example
Researchers interview patients with chronic low back pain until no new experiences or ideas
are identified.
5. Data Collection Methods
Common methods include:
Interviews
Structured
Semi-structured
Unstructured
Physiotherapy Example
Interviewing stroke patients about challenges encountered during gait rehabilitation.
Focus Groups
Small groups discuss common experiences.
Example
A group of athletes discusses barriers to completing rehabilitation exercises.
Observation
Researchers observe behaviors without interfering.
Example
Observing balance training sessions in older adults.
Document Analysis
Reviewing diaries, medical records, or rehabilitation journals.
6. Data Analysis
Qualitative data are analyzed by identifying patterns and themes.
Common methods include:
Thematic Analysis
Content Analysis
Framework Analysis
Grounded Theory Analysis
Physiotherapy Example
Researchers identify recurring themes among patients with chronic neck pain:
Fear of movement.
Difficulty returning to work.
Anxiety about pain recurrence.
Importance of therapist support.
7. Trustworthiness of Qualitative Research
Trustworthiness replaces the concepts of validity and reliability used in quantitative research.
It consists of four components:
A. Credibility
Equivalent to internal validity.
Questions:
Are the findings believable?
Were participants accurately represented?
Methods to improve credibility:
Member checking.
Prolonged engagement.
Triangulation.
Physiotherapy Example
Stroke patients review interview transcripts to confirm that their experiences have been
accurately interpreted
B. Transferability
Equivalent to external validity.
Questions:
Can findings be applied to similar settings?
Researchers should provide detailed descriptions of participants and settings.
Physiotherapy Example
Findings from patients undergoing knee replacement rehabilitation may be transferable to
similar orthopedic rehabilitation settings.
C. Dependability
Equivalent to reliability.
Questions:
Would similar findings be obtained if the study were repeated?
Researchers maintain an audit trail documenting all methodological decisions.
D. Confirmability
Equivalent to objectivity.
Questions:
Are findings based on participants' experiences rather than researcher bias?
Researchers should document personal assumptions and use participant quotations to support
interpretations.
Reflexivity
Researchers acknowledge how their own beliefs, experiences, and professional backgrounds
may influence the research process.
Physiotherapy Example
A sports physiotherapist studying ACL rehabilitation acknowledges that previous clinical
experience could influence interpretation of interview data and actively reflects on this during
analysis.
Triangulation
Triangulation improves study credibility by using multiple sources.
Types include:
Data triangulation.
Investigator triangulation.
Method triangulation.
Theory triangulation.
Physiotherapy Example
Researchers combine:
Patient interviews.
Physiotherapist interviews.
Clinical observations.
to obtain a comprehensive understanding of stroke rehabilitation experiences.
Ethical Considerations
Researchers should ensure:
Ethical approval.
Informed consent.
Confidentiality.
Voluntary participation.
Right to withdraw.
Protection of participant privacy.
Reporting of Results
Good qualitative studies include:
Major themes.
Supporting participant quotations.
Interpretation of findings.
Comparison with existing literature.
Clinical implications.
Physiotherapy Example
Theme: Fear of Reinjury
"Even after my knee became strong, I was afraid to sprint because I thought I would tear my
ACL again."
This quotation supports the theme and highlights the psychological aspects of rehabilitation.
CASP (Critical Appraisal Skills Programme) Checklist for Qualitative Research
The CASP Qualitative Checklist is commonly used to critically appraise qualitative studies.
It includes 10 questions:
1. Was there a clear statement of the research aims?
2. Was a qualitative methodology appropriate?
3. Was the research design suitable?
4. Was the recruitment strategy appropriate?
5. Were data collected appropriately?
6. Was the relationship between researcher and participants considered?
7. Were ethical issues addressed?
8. Was data analysis sufficiently rigorous?
9. Are the findings clearly presented?
10. How valuable is the research?
Physiotherapy Example of Critical Review
Research Topic
Experiences of Patients Following ACL Reconstruction During Return to Sport
Appraisal
Research Question
✔ Clearly defined
Design
✔ Phenomenological study appropriate.
Sampling
✔ Purposive sampling of 20 athletes.
Data Collection
✔ Semi-structured interviews.
Data Analysis
✔ Thematic analysis with independent coding by two researchers.
Credibility
✔ Member checking completed.
Transferability
✔ Participant characteristics clearly described.
Dependability
✔ Audit trail maintained.
Confirmability
✔ Researcher reflexivity reported.
Clinical Application
The study emphasizes that psychological readiness is an important component of return-to-
sport decision-making. Physiotherapists should therefore assess confidence, fear of reinjury,
and self-efficacy in addition to physical recovery.
Strengths of Qualitative Research
Provides rich and detailed information.
Explores patient perspectives.
Supports patient-centered care.
Identifies barriers to rehabilitation.
Improves communication.
Generates new hypotheses.
Complements quantitative research.
Limitations of Qualitative Research
Small sample sizes.
Findings are not always generalizable.
Potential researcher bias.
Time-consuming data collection and analysis.
Interpretation may vary among researchers.
Comparison of Quantitative and Qualitative Research
Feature Quantitative Research Qualitative Research
Purpose Measure effectiveness and Explore experiences and meanings
relationships
Data Numerical Textual, verbal, observational
Sample Size Large Small
Analysis Statistical tests Thematic/content analysis
Outcome Numbers and statistical Themes and participant perspectives
significance
Physiotherapy Does strengthening How do patients experience
Example reduce knee pain? rehabilitation after knee replacement?
Application in Evidence-Based Physiotherapy
Qualitative evidence helps physiotherapists to:
Understand patient expectations.
Improve therapeutic communication.
Address psychosocial barriers.
Enhance adherence to rehabilitation.
Develop individualized rehabilitation programs.
Deliver holistic, patient-centered care.
SYSTEMATICALLY REVIEWING THE EVIDENCE
Introduction
In Evidence-Based Physiotherapy (EBP), clinicians often encounter numerous research
studies on the same clinical question, with some studies reporting different or even
conflicting results. A Systematic Review is a scientific method of identifying, evaluating,
and synthesizing all relevant research on a specific question using a predefined and
transparent methodology. Unlike traditional narrative reviews, systematic reviews minimize
bias through a rigorous and reproducible process.
Systematic reviews are considered one of the highest levels of evidence because they
summarize the best available research, helping physiotherapists make informed clinical
decisions and develop evidence-based rehabilitation programs.
Definition
A Systematic Review is a structured, comprehensive, and transparent review of all relevant
research studies addressing a clearly defined clinical question using explicit methods to
identify, appraise, and synthesize the available evidence.
Objectives of a Systematic Review
A systematic review aims to:
Summarize all available evidence on a clinical question.
Minimize bias in literature review.
Assess the quality of included studies.
Provide reliable recommendations for clinical practice.
Identify gaps in current knowledge.
Support evidence-based decision-making.
Guide healthcare policy and clinical guidelines.
Importance of Systematic Reviews in Physiotherapy
Systematic reviews help physiotherapists to:
Select the most effective treatment interventions.
Compare different rehabilitation techniques.
Develop evidence-based treatment protocols.
Improve patient safety and clinical outcomes.
Reduce unnecessary or ineffective treatments.
Support teaching, research, and policy development.
Characteristics of a Good Systematic Review
A high-quality systematic review should:
Address a clearly defined clinical question.
Follow a predefined protocol.
Use a comprehensive literature search.
Apply explicit inclusion and exclusion criteria.
Critically appraise study quality.
Synthesize findings objectively.
Report methods transparently.
Update findings when new evidence becomes available.
Stages of a Systematic Review
A systematic review follows a series of well-defined stages.
Stage 1: Identify the Research Problem
The first step is to identify an important clinical problem requiring evidence.
Researchers determine:
What clinical issue needs investigation?
Why is the review necessary?
What uncertainty exists in current practice?
Physiotherapy Example
Many rehabilitation techniques are available after Anterior Cruciate Ligament (ACL)
reconstruction, but it is unclear whether Blood Flow Restriction Training (BFRT)
improves recovery more than conventional strengthening.
Clinical Problem:
"Is BFRT more effective than conventional strengthening after ACL reconstruction?"
Stage 2: Formulate the Review Question
A clear and focused research question is developed, usually using the PICO framework.
PICO Framework
Component Descriptio Example
n
P Population Patients after ACL reconstruction
I Intervention Blood Flow Restriction Training
C Comparison Conventional strengthening exercises
O Outcome Quadriceps strength, function, return to sport
Physiotherapy Example
Research Question:
"Does Blood Flow Restriction Training improve quadriceps strength compared with
conventional strengthening after ACL reconstruction?"
Stage 3: Develop a Review Protocol
A protocol is prepared before starting the review to ensure transparency and reduce bias.
The protocol includes:
Research question.
Objectives.
Eligibility criteria.
Search strategy.
Databases to be searched.
Outcome measures.
Methods of quality assessment.
Data extraction procedures.
Statistical analysis plan.
Protocols are commonly registered in PROSPERO before the review begins.
Physiotherapy Example
Researchers specify that only randomized controlled trials involving adults after ACL
reconstruction will be included.
Stage 4: Literature Search
A comprehensive search is conducted to identify all relevant studies.
Common databases include:
PubMed/MEDLINE
Cochrane Library
PEDro (Physiotherapy Evidence Database)
CINAHL
Scopus
Web of Science
Embase
Google Scholar
Researchers use keywords, Boolean operators (AND, OR, NOT), and Medical Subject
Headings (MeSH).
Example Search Strategy
ACL reconstruction AND
Blood Flow Restriction Training AND
Physiotherapy OR Rehabilitation
Physiotherapy Example
Researchers search PubMed, PEDro, and Cochrane Library to identify studies on BFRT
following ACL reconstruction.
Stage 5: Screening of Studies
The search may identify hundreds or thousands of studies.
Researchers remove:
Duplicate articles.
Irrelevant titles.
Studies unrelated to the research question.
Screening occurs in two stages:
A. Title and Abstract Screening
Irrelevant studies are excluded.
B. Full-Text Screening
Remaining studies are reviewed in detail to determine eligibility.
Physiotherapy Example
Initial search:
1,250 studies
After removing duplicates:
980 studies
↓
Title screening:
220 studies
Full-text review:
40 studies
Eligible studies:
15 Randomized Controlled Trials
Stage 6: Apply Inclusion and Exclusion Criteria
Researchers define clear criteria before selecting studies.
Inclusion Criteria
Examples:
Adults aged 18 years or older.
ACL reconstruction patients.
Randomized Controlled Trials.
English-language publications.
Studies measuring quadriceps strength.
Exclusion Criteria
Examples:
Animal studies.
Pediatric populations.
Case reports.
Conference abstracts.
Non-English articles.
Physiotherapy Example
A study evaluating BFRT in healthy athletes without ACL injury would be excluded.
Stage 7: Assess the Quality of Studies (Critical Appraisal)
Each included study is critically evaluated for methodological quality and risk of bias.
Common appraisal tools include:
PEDro Scale (Physiotherapy)
Cochrane Risk of Bias Tool
CASP Checklist
Newcastle–Ottawa Scale
Researchers assess:
Randomization.
Blinding.
Allocation concealment.
Follow-up.
Statistical analysis.
Outcome measures.
Physiotherapy Example
Each RCT on BFRT is assessed using the PEDro Scale.
Studies scoring 8–10 are considered high quality.
Stage 8: Data Extraction
Researchers systematically collect relevant information from each study.
Typical information includes:
Author.
Year of publication.
Country.
Study design.
Sample size.
Participant characteristics.
Intervention.
Comparison group.
Outcome measures.
Results.
Example Data Extraction Table
Author Sample Size Intervention Outcome
Smith et 60 BFRT Improved quadriceps strength
al.
Lee et al. 45 Conventional exercise Moderate improvement
Physiotherapy Example
Researchers record:
IKDC scores.
Quadriceps strength.
Return-to-sport rates.
Pain scores.
Functional outcomes.
Stage 9: Data Synthesis
After extracting data, findings from all included studies are combined.
There are two methods:
A. Narrative Synthesis
Results are summarized descriptively.
Used when studies differ considerably in:
Participants.
Interventions.
Outcomes.
Example
Five studies reported improved pain after exercise therapy, while three reported no significant
difference.
B. Quantitative Synthesis (Meta-analysis)
If studies are sufficiently similar, statistical methods combine results into one overall estimate
of treatment effect.
Physiotherapy Example
Ten RCTs comparing BFRT with conventional exercise are statistically combined to
determine overall effectiveness.
Stage 10: Interpret Results
Researchers interpret:
Strength of evidence.
Consistency of findings.
Clinical significance.
Statistical significance.
Limitations.
Applicability to practice.
Physiotherapy Example
Most studies report improved quadriceps strength with BFRT, but evidence for faster return
to sport is less consistent.
Stage 11: Draw Conclusions
Researchers summarize:
Main findings.
Clinical implications.
Recommendations for practice.
Recommendations for future research.
Physiotherapy Example
Conclusion:
Current evidence suggests that BFRT improves quadriceps strength after ACL reconstruction
and can be considered an effective adjunct to rehabilitation when appropriately supervised.
Stage 12: Report the Review
The review is written according to international reporting guidelines.
The preferred guideline is:
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)
PRISMA ensures complete and transparent reporting.
PRISMA Flow Diagram
The PRISMA flowchart shows the number of studies at each stage of the review.
Identification
│
▼
Database Search
│
▼
Remove Duplicates
│
▼
Title & Abstract Screening
│
▼
Full-Text Assessment
│
▼
Studies Included in Review
Flowchart of the Systematic Review Process
Clinical Problem
│
▼
Develop Research Question (PICO)
│
▼
Prepare Protocol
│
▼
Literature Search
│
▼
Screen Studies
│
▼
Apply Eligibility Criteria
│
▼
Critical Appraisal
│
▼
Data Extraction
│
▼
Data Synthesis
│
▼
Interpret Results
│
▼
Draw Conclusions
│
▼
Publish Review
Physiotherapy Example
Clinical Question
Does exercise therapy improve pain in patients with knee osteoarthritis?
Stage 1
Develop PICO question.
Stage 2
Search PubMed, PEDro, Cochrane Library.
Stage 3
Retrieve 1,500 studies.
Stage 4
Remove duplicates.
Stage 5
Screen titles and abstracts.
Stage 6
Assess 30 full-text articles.
Stage 7
Include 18 high-quality RCTs.
Stage 8
Assess quality using PEDro Scale.
Stage 9
Perform meta-analysis.
Stage 10
Conclude that strengthening exercises significantly reduce pain and improve function.
Advantages of Systematic Reviews
Highest level of evidence.
Comprehensive and transparent.
Reduces bias.
Summarizes multiple studies.
Supports evidence-based clinical practice.
Improves treatment recommendations.
Identifies research gaps.
Guides healthcare policy and clinical guidelines.
Limitations of Systematic Reviews
Time-consuming and resource-intensive.
Quality depends on the included studies.
Publication bias may influence findings.
Heterogeneity among studies may limit comparisons.
Rapidly evolving evidence may make reviews outdated.
Role in Evidence-Based Physiotherapy
Systematic reviews help physiotherapists:
Choose the most effective interventions.
Compare rehabilitation protocols.
Develop clinical practice guidelines.
Improve patient outcomes.
Support continuing professional development.
Promote consistent, evidence-based care.
META-ANALYSIS
Introduction
In Evidence-Based Physiotherapy (EBP), clinicians often find multiple research studies
investigating the same intervention. Individual studies may produce different or conflicting
results because of variations in sample size, methodology, or patient characteristics. Meta-
analysis is a statistical technique that combines the results of several independent studies
addressing the same research question to provide a single, more precise estimate of the
treatment effect.
Meta-analysis is usually conducted as part of a systematic review and is considered one of
the highest levels of evidence for clinical decision-making.
Definition
Meta-analysis is a statistical method that combines the quantitative results of multiple
independent studies addressing the same research question to calculate an overall estimate of
the intervention's effect.
Objectives of Meta-analysis
Meta-analysis aims to:
Combine findings from multiple studies.
Increase statistical power by enlarging the effective sample size.
Provide a more precise estimate of treatment effects.
Resolve inconsistencies among study findings.
Identify factors that influence treatment outcomes.
Support evidence-based clinical practice.
Inform clinical guidelines and healthcare policy.
Importance of Meta-analysis in Physiotherapy
Meta-analysis helps physiotherapists to:
Select the most effective rehabilitation interventions.
Compare different physiotherapy techniques.
Improve confidence in treatment recommendations.
Develop evidence-based clinical practice guidelines.
Reduce uncertainty in clinical decision-making.
Improve patient outcomes through stronger evidence.
Relationship Between Systematic Review and Meta-analysis
Although often used together, they are different.
Systematic Review Meta-analysis
Comprehensive review of all relevant studies Statistical combination of study results
May or may not include statistical analysis Always includes statistical analysis
Focuses on identifying and critically appraising Focuses on calculating an overall effect
studies size
Can include qualitative synthesis Provides quantitative synthesis
Important: Every meta-analysis is based on a systematic review, but not every systematic
review includes a meta-analysis. A meta-analysis can only be performed when the included
studies are sufficiently similar in terms of participants, interventions, and outcomes.
Characteristics of a Good Meta-analysis
A high-quality meta-analysis should:
Be based on a well-conducted systematic review.
Include a clearly defined research question.
Use explicit inclusion and exclusion criteria.
Include high-quality studies.
Assess the risk of bias.
Evaluate heterogeneity among studies.
Use appropriate statistical methods.
Report results transparently.
Steps in Conducting a Meta-analysis
Step 1: Formulate the Research Question
A focused clinical question is developed using the PICO framework.
Physiotherapy Example
Population: Patients with knee osteoarthritis
Intervention: Strengthening exercises
Comparison: Conventional care
Outcome: Pain reduction and improved function
Research Question:
"Do strengthening exercises reduce pain more effectively than conventional care in patients
with knee osteoarthritis?"
Step 2: Conduct a Systematic Literature Search
Researchers search databases such as:
PubMed/MEDLINE
Cochrane Library
PEDro
CINAHL
Scopus
Embase
All relevant studies are identified using predefined search strategies.
Step 3: Select Eligible Studies
Studies are screened according to predefined eligibility criteria.
Inclusion Criteria
Randomized Controlled Trials (RCTs).
Adult patients.
Similar interventions.
Common outcome measures.
Exclusion Criteria
Case reports.
Animal studies.
Conference abstracts.
Studies with insufficient data.
Physiotherapy Example
Only RCTs comparing Blood Flow Restriction Training (BFRT) with conventional
strengthening after ACL reconstruction are included.
Step 4: Assess Study Quality
Researchers critically appraise each study using tools such as:
PEDro Scale.
Cochrane Risk of Bias Tool.
CASP Checklist.
Studies with poor methodological quality may be excluded or analyzed separately.
Step 5: Extract Data
Important information collected includes:
Author.
Publication year.
Sample size.
Participant characteristics.
Intervention.
Comparison group.
Outcome measures.
Statistical results.
Example
Study Sample Size Intervention Outcome
Smith et al. 60 BFRT Quadriceps strength ↑
Lee et al. 48 Conventional exercise Moderate improvement
Kumar et al. 72 BFRT Functional score ↑
Step 6: Calculate Effect Size
The effect size measures the magnitude of the treatment effect across studies.
Common effect size measures include:
Mean Difference (MD)
Standardized Mean Difference (SMD)
Risk Ratio (RR)
Odds Ratio (OR)
Physiotherapy Example
Five studies evaluating exercise therapy for chronic low back pain report different pain
scales. Researchers use the Standardized Mean Difference (SMD) to combine results into
one overall estimate.
Step 7: Assess Heterogeneity
Heterogeneity refers to differences among the included studies.
Differences may arise from:
Patient characteristics.
Treatment protocols.
Outcome measures.
Study quality.
Statistical Tests
Chi-square (Q test)
I² statistic
Interpretation of I²
I² Value Interpretation
0–25% Low heterogeneity
26–50% Moderate heterogeneity
51–75% Substantial heterogeneity
>75% Considerable heterogeneity
Physiotherapy Example
Ten studies investigating exercise therapy for knee osteoarthritis show I² = 18%, indicating
low heterogeneity and allowing confident pooling of results.
Fixed-Effect Model
Definition
Assumes all included studies estimate the same true treatment effect.
Appropriate When
Studies are very similar.
Heterogeneity is low.
Advantages
Greater statistical precision.
Limitations
Not suitable when studies differ substantially.
Random-Effects Model
Definition
Assumes the true treatment effect varies between studies.
Appropriate When
Moderate or high heterogeneity exists.
Advantages
More realistic for clinical research.
Limitations
Wider confidence intervals.
Physiotherapy Example
Studies evaluating balance training after stroke differ in patient severity and treatment
duration. A random-effects model is chosen to account for these variations.
Step 8: Perform Statistical Analysis
Specialized software is commonly used:
RevMan (Review Manager)
Comprehensive Meta-Analysis (CMA)
Stata
R
SPSS (limited applications)
The software combines results and generates graphical displays.
Forest Plot
A Forest Plot is the most common graphical presentation of a meta-analysis.
It shows:
Results of each individual study.
Confidence intervals.
Overall combined treatment effect.
Components of a Forest Plot
Squares represent individual study estimates.
Horizontal lines represent 95% confidence intervals.
The size of the square reflects the study's weight.
A diamond at the bottom represents the pooled effect estimate.
The vertical line indicates "no effect."
Interpretation
If the diamond does not cross the line of no effect, the overall result is statistically
significant.
If it crosses the line, the result is not statistically significant.
Physiotherapy Example
A forest plot of 12 RCTs shows that exercise therapy significantly reduces pain in patients
with knee osteoarthritis. The pooled effect estimate lies entirely on the side favoring exercise.
Funnel Plot
A Funnel Plot assesses publication bias.
Interpretation
Symmetrical funnel → Low publication bias.
Asymmetrical funnel → Possible publication bias.
Physiotherapy Example
Studies on dry needling for neck pain show an asymmetrical funnel plot, suggesting that
small studies with negative results may not have been published.
Publication Bias
Publication bias occurs when studies with positive findings are more likely to be published
than studies with negative or non-significant findings.
Consequences
Overestimation of treatment effectiveness.
Misleading clinical recommendations.
Sensitivity Analysis
Researchers repeat the analysis after removing certain studies to determine whether the
results remain consistent.
Physiotherapy Example
Removing one low-quality trial from a meta-analysis of exercise therapy for chronic low
back pain does not change the overall conclusion, increasing confidence in the findings.
Subgroup Analysis
Subgroup analysis examines whether treatment effects differ between specific groups.
Physiotherapy Example
A meta-analysis compares exercise therapy outcomes in:
Younger adults (<60 years).
Older adults (≥60 years).
Researchers determine whether age influences treatment effectiveness.
Interpreting Meta-analysis Results
Researchers evaluate:
Overall effect size.
Confidence intervals.
p-value.
Heterogeneity.
Clinical significance.
Risk of bias.
Quality of evidence.
Physiotherapy Example
Clinical Question
Does Blood Flow Restriction Training (BFRT) improve quadriceps strength after ACL
reconstruction?
Studies Included
15 RCTs.
Total participants: 1,020.
Results
Significant increase in quadriceps strength.
Improved functional outcomes.
Low heterogeneity (I² = 15%).
No serious publication bias.
Conclusion
Meta-analysis supports BFRT as an effective adjunct to conventional rehabilitation following
ACL reconstruction.
Advantages of Meta-analysis
Highest level of quantitative evidence.
Combines results from multiple studies.
Increases sample size and statistical power.
Improves precision of treatment effect estimates.
Resolves conflicting study findings.
Supports evidence-based clinical guidelines.
Helps identify research gaps.
Limitations of Meta-analysis
Depends on the quality of included studies.
Publication bias may affect conclusions.
High heterogeneity may reduce reliability.
Combining poorly designed studies can produce misleading results.
Time-consuming and requires statistical expertise.
Meta-analysis vs Systematic Review
Feature Systematic Review Meta-analysis
Purpose Summarizes available evidence Statistically combines study results
Statistical Optional Essential
Analysis
Output Narrative and/or quantitative Overall pooled effect estimate
synthesis
Requirement Comprehensive literature review Requires sufficiently similar studies
Evidence Level High Highest when based on high-quality
studies
Role of Meta-analysis in Evidence-Based Physiotherapy
Meta-analysis is widely used to evaluate:
Exercise therapy for low back pain.
Manual therapy for neck pain.
Blood Flow Restriction Training after ACL reconstruction.
Balance training after stroke.
Pulmonary rehabilitation for COPD.
Exercise programs for knee osteoarthritis.
Vestibular rehabilitation.
Sports injury prevention programs.
Clinical Case Example
Research Topic: Effectiveness of Exercise Therapy for Chronic Low Back Pain
Research Question: Does exercise therapy reduce pain more effectively than usual care?
Studies Included: 20 randomized controlled trials.
Participants: 2,350 patients.
Outcome Measures:
Visual Analogue Scale (VAS)
Oswestry Disability Index (ODI)
Quality of Life (SF-36)
Results:
Significant reduction in pain.
Improved functional ability.
Better quality of life.
Low heterogeneity (I² = 22%).
Clinical Implication: Strong evidence supports exercise therapy as a first-line treatment for
chronic low back pain.
THE COCHRANE COLLABORATION (COCHRANE)
Introduction
Evidence-Based Practice (EBP) requires healthcare professionals to use the best available
scientific evidence when making clinical decisions. However, thousands of research studies
are published every year, making it difficult for clinicians to identify reliable evidence. To
solve this problem, the Cochrane Collaboration, now known simply as Cochrane, was
established to produce high-quality, independent, and up-to-date systematic reviews that help
healthcare professionals make informed decisions.
Cochrane is recognized worldwide as one of the most trusted organizations for producing
systematic reviews and is considered a cornerstone of Evidence-Based Physiotherapy.
Definition
Cochrane is an independent, international, non-profit organization that prepares, maintains,
and promotes high-quality systematic reviews and other synthesized research evidence to
support evidence-based healthcare decision-making.
Historical Background
Founded: 1993
Founder: Iain Chalmers and an international group of researchers.
Named After: Archie Cochrane, a British epidemiologist who strongly advocated
using evidence from well-designed randomized controlled trials to improve
healthcare.
Archie Cochrane's Contribution
Archie Cochrane emphasized that healthcare decisions should be based on scientific
evidence rather than tradition or personal opinion. His ideas laid the foundation for
modern Evidence-Based Medicine (EBM) and Evidence-Based Physiotherapy (EBP).
Vision of Cochrane
"A world of improved health where decisions about health and healthcare are informed
by high-quality, relevant, and up-to-date synthesized research evidence."
Mission of Cochrane
Cochrane aims to:
Produce high-quality systematic reviews.
Make healthcare evidence accessible worldwide.
Support evidence-based healthcare.
Improve patient outcomes.
Promote transparency and scientific integrity.
Encourage international collaboration.
Objectives of Cochrane
The objectives are to:
Prepare systematic reviews of healthcare interventions.
Maintain and regularly update reviews.
Disseminate reliable evidence globally.
Reduce bias in healthcare research.
Improve clinical practice guidelines.
Promote evidence-informed healthcare policies.
Encourage high-quality research.
Core Principles of Cochrane
Cochrane follows several key principles:
1. Collaboration
2. Avoiding duplication
3. Minimizing bias
4. Scientific rigor
5. Transparency
6. Global participation
7. Independence
8. Continuous updating of evidence
Organizational Structure of Cochrane
Cochrane is a global network consisting of:
Review Groups
Geographic Groups
Methods Groups
Consumer Network
Executive Team
Editorial Board
Researchers and Volunteers
Researchers from over 100 countries contribute to Cochrane reviews.
Major Components of Cochrane
1. Cochrane Review Groups (CRGs)
These groups prepare and maintain systematic reviews related to specific healthcare
specialties.
Examples include:
Musculoskeletal Disorders
Neurology
Sports Medicine
Stroke
Pain Management
Public Health
Rehabilitation
Orthopaedics
Physiotherapy Example
The Musculoskeletal Review Group publishes systematic reviews on:
Low back pain
Osteoarthritis
Neck pain
Shoulder disorders
These reviews help physiotherapists choose effective rehabilitation interventions.
2. Methods Groups
These groups develop methodologies used in systematic reviews.
Responsibilities include:
Statistical methods.
Risk of bias assessment.
Meta-analysis techniques.
Diagnostic test reviews.
Prognostic research.
Qualitative evidence synthesis.
3. Geographic Groups
These groups promote Cochrane activities within different countries and regions by:
Conducting workshops.
Training researchers.
Supporting systematic reviews.
Promoting evidence-based healthcare.
4. Consumer Network
Patients, caregivers, and members of the public contribute by:
Identifying important healthcare questions.
Reviewing patient-friendly summaries.
Ensuring research addresses patient priorities.
Cochrane Database of Systematic Reviews (CDSR)
The Cochrane Database of Systematic Reviews (CDSR) is one of the world's most
respected sources of evidence.
It contains:
Systematic reviews.
Review protocols.
Updated evidence syntheses.
Plain language summaries.
Each review undergoes:
Peer review.
Editorial review.
Regular updates as new evidence becomes available.
What Does a Cochrane Review Include?
A typical Cochrane Review contains:
1. Title
2. Abstract
3. Background
4. Objectives
5. Methods
6. Results
7. Discussion
8. Authors' conclusions
9. Implications for practice
10. Implications for research
11. References
Steps in Conducting a Cochrane Systematic Review
Step 1: Identify the Clinical Question
Researchers formulate a focused clinical question using the PICO framework.
Physiotherapy Example
Population: Stroke patients
Intervention: Balance training
Comparison: Conventional therapy
Outcome: Balance and fall prevention
Step 2: Develop a Review Protocol
Researchers prepare a detailed protocol before beginning the review.
The protocol includes:
Objectives.
Search strategy.
Inclusion criteria.
Outcome measures.
Statistical methods.
This reduces bias and improves transparency.
Step 3: Comprehensive Literature Search
Researchers search multiple databases such as:
PubMed
MEDLINE
Embase
PEDro
CINAHL
CENTRAL (Cochrane Central Register of Controlled Trials)
Step 4: Select Eligible Studies
Studies are screened according to predefined inclusion and exclusion criteria.
Step 5: Assess Risk of Bias
Each study is critically appraised using standardized tools.
Common domains include:
Randomization.
Allocation concealment.
Blinding.
Incomplete outcome data.
Selective reporting.
Step 6: Extract Data
Researchers collect information on:
Participants.
Interventions.
Outcomes.
Statistical results.
Step 7: Data Synthesis
Evidence is synthesized through:
Narrative review.
Meta-analysis (when appropriate).
Step 8: Interpret Findings
Researchers evaluate:
Quality of evidence.
Strength of recommendations.
Clinical significance.
Limitations.
Step 9: Publish and Update
Unlike many reviews, Cochrane Reviews are regularly updated when new evidence becomes
available.
Risk of Bias Assessment
Cochrane developed the Risk of Bias (RoB) tool for randomized controlled trials.
The major domains include:
Domain Description
Selection Bias Randomization and allocation concealment
Performance Blinding of participants and personnel
Bias
Detection Bias Blinding of outcome assessors
Attrition Bias Incomplete outcome data
Reporting Bias Selective reporting of outcomes
Other Bias Any additional sources of bias
GRADE System in Cochrane
Many Cochrane Reviews use the GRADE (Grading of Recommendations Assessment,
Development and Evaluation) approach to assess the certainty of evidence.
Quality Meaning
High Very confident in the estimate of effect
Moderate Further research may change confidence
Low Further research is likely to change the estimate
Very Very uncertain about the estimate
Low
Physiotherapy Example
Clinical Question
Does exercise therapy reduce pain in knee osteoarthritis?
Cochrane Review Process
Researchers identify:
25 Randomized Controlled Trials.
2,800 participants.
Findings
Exercise therapy:
Reduces pain.
Improves physical function.
Enhances quality of life.
Has minimal adverse effects.
Clinical Implication
Exercise therapy is recommended as a first-line intervention for knee osteoarthritis.
Applications of Cochrane in Physiotherapy
Cochrane evidence supports physiotherapy in:
Musculoskeletal Physiotherapy
Low back pain
Neck pain
Osteoarthritis
Shoulder disorders
Tendinopathies
Sports Physiotherapy
ACL rehabilitation
Ankle sprain rehabilitation
Hamstring injury prevention
Return-to-sport programs
Blood Flow Restriction Training (BFRT)
Neurological Physiotherapy
Stroke rehabilitation
Parkinson's disease
Multiple sclerosis
Spinal cord injury
Cardiopulmonary Physiotherapy
COPD rehabilitation
Cardiac rehabilitation
Pulmonary rehabilitation
Pediatric Physiotherapy
Cerebral palsy
Developmental delay
Neuromuscular disorders
Advantages of Cochrane Reviews
Highest-quality systematic reviews.
Transparent and rigorous methodology.
Comprehensive literature searches.
Regularly updated evidence.
Reduces bias.
Supports clinical guideline development.
Widely accepted internationally.
Improves patient care and healthcare policy.
Limitations of Cochrane Reviews
Time-consuming to produce.
Dependent on the quality of available studies.
Some topics have limited high-quality evidence.
Reviews may become outdated if not updated promptly.
Access to some resources may require institutional subscriptions.
Role of Cochrane in Evidence-Based Physiotherapy
Cochrane enables physiotherapists to:
Select evidence-based interventions.
Compare rehabilitation strategies.
Develop treatment protocols.
Improve patient outcomes.
Critically appraise research.
Support lifelong professional learning.
Contribute to evidence-based healthcare policies.
Clinical Case Example
Clinical Question
Does exercise therapy improve chronic low back pain?
Cochrane Review
32 Randomized Controlled Trials.
3,500 participants.
Findings
Exercise therapy:
Significantly reduces pain.
Improves physical function.
Enhances quality of life.
Is more effective than no treatment or usual care.
Physiotherapy Application
A physiotherapist uses this evidence to prescribe individualized strengthening, flexibility, and
aerobic exercise programs for patients with chronic low back pain, while considering patient
preferences and functional goals.
Difference Between Cochrane Review and Traditional Review
Feature Cochrane Review Traditional Review
Methodology Systematic and predefined Often unsystematic
Literature Search Comprehensive May be limited
Study Selection Explicit criteria May be subjective
Risk of Bias Assessment Mandatory Often absent
Data Synthesis Structured, may include meta-analysis Narrative summary
Updating Regularly updated Rarely updated
Reliability Very high Variable
ECONOMIC EVALUATION OF THE EVIDENCE
Introduction
Healthcare resources such as money, equipment, time, and healthcare professionals are
limited. Therefore, healthcare providers must ensure that the available resources are used
efficiently while providing the best possible patient care. Economic evaluation is an
important component of Evidence-Based Physiotherapy (EBP) because it compares the
costs and health outcomes of different interventions to determine which option provides the
greatest value.
Economic evaluation does not only ask whether a treatment works, but also whether the
benefits justify the costs. This information is essential for clinicians, hospital administrators,
insurance companies, and policymakers when making decisions about adopting or funding
healthcare interventions.
Definition
Economic Evaluation is the systematic comparison of two or more healthcare interventions
by examining both their costs (resources used) and consequences (health outcomes) to
determine which intervention provides the best value for money.
Objectives of Economic Evaluation
Economic evaluation aims to:
Compare the costs and benefits of different interventions.
Identify the most cost-effective treatment.
Improve resource allocation.
Support evidence-based clinical decisions.
Assist healthcare planning and budgeting.
Reduce unnecessary healthcare expenditure.
Improve patient outcomes while controlling costs.
Importance of Economic Evaluation in Physiotherapy
Economic evaluation helps physiotherapists to:
Choose interventions that provide the best outcomes at reasonable costs.
Demonstrate the economic value of physiotherapy services.
Justify rehabilitation programs to hospital administrators and insurers.
Support policy decisions on healthcare funding.
Optimize the use of limited healthcare resources.
Promote efficient, evidence-based patient care.
Basic Concepts in Economic Evaluation
1. Cost
Cost refers to the resources consumed during healthcare delivery.
Types of Costs
A. Direct Costs
Expenses directly related to treatment.
Examples:
Physiotherapy consultation fees.
Exercise equipment.
Electrotherapy devices.
Hospital charges.
Medications.
Physiotherapy Example
The cost of supervised exercise sessions for knee osteoarthritis.
B. Indirect Costs
Costs resulting from reduced productivity or loss of income.
Examples:
Time away from work.
Transportation expenses.
Caregiver time.
Reduced work efficiency.
Physiotherapy Example
An athlete misses six weeks of competition after an ACL injury, resulting in lost income.
C. Intangible Costs
Costs that cannot be easily measured financially.
Examples:
Pain.
Emotional distress.
Anxiety.
Reduced quality of life.
Physiotherapy Example
A patient with chronic low back pain experiences persistent pain and depression despite
treatment.
2. Consequences (Outcomes)
Consequences are the health benefits produced by an intervention.
Examples:
Pain reduction.
Improved range of motion.
Increased muscle strength.
Improved walking ability.
Enhanced quality of life.
Faster return to work.
Reduced disability.
Types of Economic Evaluation
There are four major types of full economic evaluation:
1. Cost-Minimization Analysis (CMA)
2. Cost-Effectiveness Analysis (CEA)
3. Cost-Utility Analysis (CUA)
4. Cost-Benefit Analysis (CBA)
1. Cost-Minimization Analysis (CMA)
Definition
Cost-Minimization Analysis compares the costs of two or more interventions that have
already been shown to produce equivalent clinical outcomes. The intervention with the
lowest cost is considered the preferred option.
Key Principle
Equal outcomes → Compare only costs
When is CMA Used?
CMA is appropriate when:
Clinical effectiveness is identical.
Safety profiles are similar.
Outcomes are equivalent.
Physiotherapy Example
A physiotherapist compares:
Hospital-based supervised exercises.
Community physiotherapy center exercises.
If both programs produce the same improvement in knee function, the less expensive
program is preferred.
Advantages
Simple to perform.
Easy to interpret.
Useful when interventions have identical outcomes.
Limitations
Rarely applicable because treatments often differ in outcomes.
Requires strong evidence that outcomes are truly equivalent.
2. Cost-Effectiveness Analysis (CEA)
Definition
Cost-Effectiveness Analysis compares interventions based on costs and clinical outcomes
measured in natural units.
Examples of natural units:
Pain reduction.
Walking distance.
Life-years gained.
Number of falls prevented.
Improvement in ROM.
Increase in muscle strength.
Formula
Cost-Effectiveness Ratio (CER)
Cost
CER=
Clinical Outcome
Incremental Cost-Effectiveness Ratio (ICER)
When comparing two interventions:
Cost of Intervention A - Cost of Intervention B
ICER=
Effect of Intervention A - Effect of Intervention B
ICER indicates the additional cost required to achieve one additional unit of health benefit.
Physiotherapy Example
Comparing two rehabilitation programs after stroke:
Program Cost Walking
Improvement
Conventional ₹20,00 150 m
Physiotherapy 0
Robotic Gait Training ₹50,00 180 m
0
Robotic therapy improves walking slightly more but at a much higher cost. CEA helps
determine whether the additional benefit justifies the extra expense.
Advantages
Widely used in healthcare.
Easy to understand.
Useful for comparing treatments with the same outcome.
Limitations
Cannot compare interventions with different outcome measures.
Does not account for quality of life.
3. Cost-Utility Analysis (CUA)
Definition
Cost-Utility Analysis compares costs with outcomes adjusted for both quantity and quality
of life.
The most common outcome measure is the Quality-Adjusted Life Year (QALY).
Quality-Adjusted Life Year (QALY)
A QALY combines:
Length of life.
Quality of life.
Interpretation
1 QALY = One year of perfect health.
0 QALY = Death.
Values between 0 and 1 represent varying levels of health.
Physiotherapy Example
A pulmonary rehabilitation program for patients with COPD improves exercise tolerance and
quality of life. CUA estimates the cost per QALY gained to determine whether the program
provides good value.
Advantages
Considers both survival and quality of life.
Allows comparison across different diseases and interventions.
Frequently used in national health policy decisions.
Limitations
Measuring quality of life can be subjective.
QALY calculations require specialized instruments and methods.
4. Cost-Benefit Analysis (CBA)
Definition
Cost-Benefit Analysis compares both costs and benefits in monetary terms.
The intervention is considered worthwhile if the monetary value of the benefits exceeds the
costs.
Formula
Benefit–Cost Ratio
Total Benefits
Benefit−Cost Ratio=
Total Costs
Ratio > 1 → Benefits exceed costs.
Ratio = 1 → Costs equal benefits.
Ratio < 1 → Costs exceed benefits.
Physiotherapy Example
A workplace ergonomics and physiotherapy program costs ₹10,00,000 but reduces employee
absenteeism, saving the company ₹18,00,000.
Benefit–Cost Ratio = 18,00,000 ÷ 10,00,000 = 1.8
Since the ratio is greater than 1, the program is economically beneficial.
Advantages
Allows comparison of interventions from different sectors.
Useful for policy and investment decisions.
Demonstrates financial return on healthcare programs.
Limitations
Difficult to assign monetary values to health outcomes such as pain relief or improved
quality of life.
Ethical concerns may arise when valuing health in financial terms.
Comparison of the Four Types of Economic Evaluation
Type Costs Outcomes Measured Example in Physiotherapy
Measured
Cost-Minimization Money Outcomes assumed Hospital vs community
Analysis (CMA) equal exercise program with
identical outcomes
Cost-Effectiveness Money Natural clinical units Conventional vs robotic gait
Analysis (CEA) (pain, ROM, walking training after stroke
distance)
Cost-Utility Money Quality-Adjusted Life Pulmonary rehabilitation for
Analysis (CUA) Years (QALYs) COPD
Cost-Benefit Money Monetary value of Workplace physiotherapy
Analysis (CBA) benefits reducing absenteeism
Full vs Partial Economic Evaluation
Full Economic Evaluation
Compares both costs and outcomes.
Includes:
CMA
CEA
CUA
CBA
Partial Economic Evaluation
Examines only costs or only outcomes.
Examples:
Cost description.
Cost analysis.
Outcome description.
These do not compare alternative interventions.
Steps in Conducting an Economic Evaluation
1. Define the clinical question.
2. Identify alternative interventions.
3. Determine the perspective of the analysis (patient, hospital, insurer, or society).
4. Measure all relevant costs.
5. Measure health outcomes.
6. Select the appropriate type of economic evaluation.
7. Analyze and compare costs and outcomes.
8. Interpret results.
9. Make recommendations for practice or policy.
Perspective in Economic Evaluation
The perspective determines which costs and benefits are included.
Perspective Costs Considered
Patient Treatment fees, travel expenses, lost wages
Hospital Equipment, salaries, facility costs
Insurance Company Reimbursement and claims
Society All direct, indirect, and intangible costs
Clinical Example
Research Question
Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional
strengthening after ACL reconstruction?
Intervention A
Conventional strengthening.
Cost: ₹15,000
IKDC improvement: 20 points.
Intervention B
BFRT.
Cost: ₹20,000
IKDC improvement: 28 points.
Economic Evaluation
Although BFRT costs more, it produces greater functional improvement and may allow
patients to return to sport sooner. A Cost-Effectiveness Analysis (CEA) can determine
whether the additional benefit justifies the additional cost.
Applications of Economic Evaluation in Physiotherapy
Economic evaluation is used in:
Orthopaedic rehabilitation.
Sports physiotherapy.
Neurological rehabilitation.
Cardiac rehabilitation.
Pulmonary rehabilitation.
Community-based rehabilitation.
Fall prevention programs.
Occupational health and workplace ergonomics.
Tele-rehabilitation services.
Chronic pain management.
Advantages of Economic Evaluation
Supports evidence-based resource allocation.
Improves efficiency of healthcare spending.
Demonstrates the value of physiotherapy interventions.
Guides reimbursement and funding decisions.
Assists policymakers in developing healthcare programs.
Encourages cost-conscious clinical practice.
Limitations of Economic Evaluation
Accurate cost measurement can be challenging.
Long-term outcomes may be difficult to estimate.
Quality-of-life measures can be subjective.
Results may not be generalizable to different healthcare systems or countries.
Ethical concerns may arise when assigning monetary values to health outcomes.
Role of Economic Evaluation in Evidence-Based Physiotherapy
Economic evaluation enables physiotherapists to:
Deliver effective care while optimizing healthcare resources.
Select interventions that provide the best value for money.
Support funding applications for rehabilitation programs.
Demonstrate the economic impact of physiotherapy.
Improve patient outcomes without unnecessary expenditure.
Contribute to healthcare policy and guideline development.
CONDUCTING ECONOMIC EVALUATION
Introduction
Healthcare systems operate with limited resources, including finances, healthcare
professionals, equipment, and time. Therefore, healthcare providers must ensure that
available resources are used efficiently while maximizing patient outcomes. Economic
evaluation is a systematic method used to compare the costs and consequences (health
outcomes) of two or more healthcare interventions to determine which provides the best
value for money.
In Evidence-Based Physiotherapy (EBP), conducting an economic evaluation helps
physiotherapists determine whether a treatment is not only clinically effective but also
economically worthwhile. It supports decision-making at the level of clinicians, hospitals,
insurance providers, and governments.
Definition
Conducting an Economic Evaluation is the systematic process of identifying, measuring,
comparing, and analyzing the costs and health outcomes of alternative healthcare
interventions to determine which intervention provides the greatest value for available
resources.
Objectives of Conducting an Economic Evaluation
The objectives are to:
Compare the costs of different interventions.
Compare the health outcomes of interventions.
Identify the most cost-effective treatment.
Improve allocation of healthcare resources.
Support evidence-based clinical decisions.
Reduce unnecessary healthcare expenditure.
Improve patient outcomes while maintaining financial sustainability.
Importance of Economic Evaluation in Physiotherapy
Economic evaluation helps physiotherapists to:
Demonstrate the value of physiotherapy services.
Select interventions that provide the greatest benefit at reasonable cost.
Support funding requests for rehabilitation programs.
Assist hospital administrators in resource allocation.
Guide health insurance reimbursement decisions.
Improve healthcare efficiency.
Principles of Economic Evaluation
A good economic evaluation should:
Compare at least two interventions.
Measure both costs and outcomes.
Use transparent and reproducible methods.
Consider the perspective of the analysis.
Use reliable clinical evidence.
Report results clearly and objectively.
Steps in Conducting an Economic Evaluation
Economic evaluation is conducted through a series of systematic steps.
Step 1: Define the Clinical Problem
The first step is to identify the healthcare problem that requires evaluation.
Questions include:
What condition is being treated?
Why is evaluation needed?
Which interventions are available?
Physiotherapy Example
Clinical problem:
Patients recovering from Anterior Cruciate Ligament (ACL) reconstruction require
rehabilitation.
Question:
"Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional
strengthening?"
Step 2: Define the Study Objective
Researchers clearly state the purpose of the evaluation.
Example
To compare the costs and effectiveness of BFRT and conventional strengthening after ACL
reconstruction.
Step 3: Choose the Perspective
The perspective determines which costs and benefits will be included.
Types of Perspectives
A. Patient Perspective
Includes:
Treatment fees.
Travel expenses.
Time lost from work.
Personal equipment costs.
B. Hospital Perspective
Includes:
Staff salaries.
Equipment.
Hospital facilities.
Rehabilitation costs.
C. Insurance Perspective
Includes:
Reimbursement costs.
Healthcare claims.
Cost of treatment coverage.
D. Societal Perspective
The broadest perspective.
Includes:
Direct costs.
Indirect costs.
Productivity losses.
Caregiver costs.
Social costs.
Physiotherapy Example
Evaluating community-based stroke rehabilitation from a societal perspective includes
transportation costs, caregiver time, and loss of productivity in addition to physiotherapy
expenses.
Step 4: Identify Alternative Interventions
Economic evaluation compares two or more interventions.
Examples:
Exercise therapy vs electrotherapy.
BFRT vs conventional strengthening.
Robotic gait training vs conventional gait training.
Telerehabilitation vs hospital-based rehabilitation.
Physiotherapy Example
Comparison:
Conventional quadriceps strengthening.
Blood Flow Restriction Training.
Step 5: Identify and Measure Costs
Researchers identify all relevant costs associated with each intervention.
A. Direct Medical Costs
Examples:
Physiotherapy sessions.
Hospital admission.
Exercise equipment.
Medications.
Imaging.
B. Direct Non-Medical Costs
Examples:
Transportation.
Accommodation.
Home modifications.
C. Indirect Costs
Examples:
Loss of wages.
Reduced productivity.
Caregiver time.
D. Intangible Costs
Examples:
Pain.
Anxiety.
Emotional distress.
Reduced quality of life.
Physiotherapy Example
For a stroke rehabilitation program:
Direct medical costs:
Physiotherapy sessions.
Walking aids.
Indirect costs:
Caregiver leave from work.
Step 6: Measure Outcomes
Researchers identify the health outcomes associated with each intervention.
Examples include:
Pain reduction.
Functional improvement.
Muscle strength.
Range of motion.
Walking distance.
Quality of life.
Return to work.
Return to sport.
Physiotherapy Example
Outcome measures after ACL rehabilitation:
IKDC score.
Single-leg hop distance.
Quadriceps strength.
Time to return to sport.
Step 7: Select the Appropriate Type of Economic Evaluation
Researchers choose the appropriate method depending on the clinical question.
Type Outcome Measured
Cost-Minimization Analysis (CMA) Equivalent outcomes
Cost-Effectiveness Analysis (CEA) Natural clinical units
Cost-Utility Analysis (CUA) QALYs
Cost-Benefit Analysis (CBA) Monetary value
Physiotherapy Example
Comparing two exercise programs that produce different improvements in walking distance
would require Cost-Effectiveness Analysis (CEA).
Step 8: Collect Clinical Data
Clinical data may be obtained from:
Randomized Controlled Trials (RCTs).
Cohort studies.
Hospital records.
Registries.
Systematic reviews.
Meta-analyses.
Physiotherapy Example
Researchers use RCT data comparing BFRT and conventional strengthening after ACL
reconstruction.
Step 9: Analyze Costs
Researchers calculate the total cost of each intervention.
Example
Intervention Total Cost
Conventional Physiotherapy ₹18,000
BFRT ₹24,000
Step 10: Analyze Outcomes
Researchers compare clinical outcomes.
Example
Intervention IKDC Improvement
Conventional Exercise 18 points
BFRT 28 points
Step 11: Calculate Cost-Effectiveness
For CEA, the Incremental Cost-Effectiveness Ratio (ICER) is commonly used.
Formula
Cost of Intervention A - Cost of Intervention B
ICER=
Effect of Intervention A - Effect of Intervention B
Interpretation: ICER represents the additional cost required to achieve one additional unit of
health benefit.
Physiotherapy Example
BFRT costs ₹6,000 more than conventional exercise but improves the IKDC score by 10
additional points.
ICER = ₹6,000 ÷ 10 = ₹600 per additional IKDC point gained.
Step 12: Perform Sensitivity Analysis
Sensitivity analysis examines how changes in assumptions affect the results.
Researchers may vary:
Treatment costs.
Number of therapy sessions.
Equipment prices.
Success rates.
Patient adherence.
Physiotherapy Example
If the cost of BFRT equipment decreases, researchers recalculate the ICER to determine
whether BFRT becomes more cost-effective.
Step 13: Interpret Results
Researchers consider:
Clinical effectiveness.
Cost differences.
Statistical significance.
Clinical significance.
Quality of evidence.
Feasibility.
Physiotherapy Example
Although BFRT is more expensive, it may produce faster recovery and earlier return to sport,
making it cost-effective for competitive athletes.
Step 14: Draw Conclusions
Researchers summarize:
Which intervention provides better value.
Recommendations for clinical practice.
Recommendations for healthcare policy.
Areas requiring future research.
Cost Measurement Methods
Micro-Costing
Measures each resource individually.
Examples:
One physiotherapy session.
One elastic resistance band.
One goniometer.
Highly accurate but time-consuming.
Gross Costing
Uses average costs.
Example:
Average cost of one rehabilitation program.
Simpler but less precise.
Outcome Measurement Methods
Common physiotherapy outcomes include:
Outcome Measurement Tool
Pain Visual Analogue Scale (VAS), Numeric Pain Rating Scale (NPRS)
Function Oswestry Disability Index (ODI), WOMAC, IKDC
Quality of Life SF-36, EQ-5D
Balance Berg Balance Scale
Mobility Timed Up and Go (TUG), Six-Minute Walk Test (6MWT)
Strength Manual Muscle Testing (MMT), Hand-held Dynamometer
Clinical Example
Research Question
Is telerehabilitation more cost-effective than hospital-based physiotherapy after total knee
replacement?
Participants
100 patients.
Intervention A
Hospital rehabilitation.
Cost = ₹30,000.
Intervention B
Telerehabilitation.
Cost = ₹18,000.
Outcomes
Similar pain reduction.
Similar functional improvement.
Similar quality of life.
Economic Evaluation
Since both interventions produce comparable outcomes but telerehabilitation costs
substantially less, Cost-Minimization Analysis (CMA) indicates that telerehabilitation is the
preferred option.
Factors Affecting Economic Evaluation
Healthcare system.
Country-specific costs.
Inflation.
Exchange rates.
Patient adherence.
Treatment duration.
Severity of disease.
Availability of equipment.
Therapist expertise.
Challenges in Conducting Economic Evaluation
Difficulty measuring indirect and intangible costs.
Limited long-term follow-up data.
Variability in healthcare costs between regions.
Ethical concerns in assigning monetary values to health.
Differences in patient preferences and adherence.
Advantages of Conducting Economic Evaluation
Supports evidence-based resource allocation.
Improves healthcare efficiency.
Helps prioritize interventions with the greatest value.
Demonstrates the economic impact of physiotherapy.
Assists reimbursement and funding decisions.
Promotes sustainable healthcare systems.
Limitations
Requires accurate cost and outcome data.
Time-consuming and methodologically complex.
Results may not be generalizable across different healthcare settings.
Economic findings may change with new technologies or price fluctuations.
Clinical effectiveness should always be considered alongside cost.
Role in Evidence-Based Physiotherapy
Economic evaluation enables physiotherapists to:
Select interventions that maximize patient benefit within available resources.
Advocate for evidence-based rehabilitation programs.
Justify investments in physiotherapy services.
Contribute to healthcare policy and planning.
Improve patient outcomes while ensuring efficient use of healthcare resources.
Flowchart: Conducting an Economic Evaluation
Identify Clinical Problem
│
▼
Define Objectives
│
▼
Choose Perspective
│
▼
Identify Alternative Interventions
│
▼
Measure Costs
│
▼
Measure Outcomes
│
▼
Select Type of Economic Evaluation
│
▼
Analyze Costs and Outcomes
│
▼
Calculate ICER (if applicable)
│
▼
Perform Sensitivity Analysis
│
▼
Interpret Results
│
▼
Draw Conclusions and Recommendations
CRITICALLY REVIEWING ECONOMIC EVALUATION
Introduction
In Evidence-Based Physiotherapy (EBP), clinical decisions should be based not only on the
effectiveness of an intervention but also on its economic value. Economic evaluations help
determine whether the health benefits of a treatment justify its costs. However, not all
economic evaluations are of high quality. Some studies may have methodological
weaknesses, biased assumptions, or incomplete cost analyses.
Critical review (critical appraisal) of economic evaluation is the systematic assessment of
the validity, reliability, transparency, and applicability of an economic study before its
findings are used in clinical practice or healthcare policy.
A physiotherapist must critically evaluate whether an economic study provides trustworthy
evidence that can guide treatment selection, resource allocation, and patient care.
Definition
Critical review of economic evaluation is the systematic process of assessing the
methodological quality, validity, reliability, transparency, and applicability of an economic
evaluation study to determine whether its conclusions are appropriate for clinical decision-
making.
Objectives of Critically Reviewing Economic Evaluation
The objectives are to:
Assess the quality of the economic study.
Determine whether appropriate methods were used.
Evaluate the accuracy of cost and outcome measurements.
Identify potential sources of bias.
Assess whether the conclusions are supported by evidence.
Determine whether the results are applicable to clinical practice.
Improve evidence-based decision-making.
Importance in Physiotherapy
Critical appraisal helps physiotherapists to:
Select cost-effective rehabilitation programs.
Avoid adopting interventions with poor economic evidence.
Support funding proposals.
Improve healthcare resource utilization.
Develop evidence-based clinical guidelines.
Ensure patients receive effective and affordable treatment.
Why Critically Review Economic Evaluations?
Economic evaluations influence decisions about:
Treatment selection.
Hospital budgeting.
Insurance reimbursement.
National healthcare policies.
Allocation of rehabilitation resources.
If a study is poorly designed, it may recommend interventions that are ineffective,
unnecessarily expensive, or not applicable to the local healthcare setting.
Components of Critical Review
A high-quality economic evaluation should answer several key questions.
1. Is the Research Question Clearly Defined?
The study should clearly state:
Population.
Intervention.
Comparison.
Outcomes.
Type of economic evaluation.
Physiotherapy Example
Research Question:
"Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional
strengthening after ACL reconstruction?"
The question is specific, clinically relevant, and suitable for economic evaluation.
2. Was an Appropriate Type of Economic Evaluation Used?
Researchers should select the correct evaluation method.
Type Appropriate Situation
Cost-Minimization Analysis (CMA) Outcomes are equivalent
Cost-Effectiveness Analysis (CEA) Outcomes measured in natural units
Cost-Utility Analysis (CUA) Quality of life (QALYs)
Cost-Benefit Analysis (CBA) Costs and benefits expressed in money
Physiotherapy Example
If two exercise programs produce different improvements in walking distance, Cost-
Effectiveness Analysis (CEA) is appropriate rather than Cost-Minimization Analysis.
3. Was the Perspective Clearly Stated?
The study should specify whose costs and benefits were considered.
Possible perspectives include:
Patient.
Hospital.
Healthcare system.
Insurance provider.
Society.
Physiotherapy Example
A study evaluating telerehabilitation from the hospital perspective may exclude patient travel
costs, whereas a societal perspective would include them.
4. Were All Relevant Alternatives Compared?
Economic evaluation should compare realistic alternatives.
Physiotherapy Example
Comparing:
Conventional strengthening.
BFRT.
instead of evaluating BFRT alone.
5. Were All Relevant Costs Identified?
Researchers should include all important costs.
Direct Medical Costs
Physiotherapy sessions.
Equipment.
Hospital charges.
Medications.
Direct Non-Medical Costs
Transportation.
Home modifications.
Indirect Costs
Loss of wages.
Caregiver time.
Productivity loss.
Intangible Costs
Pain.
Anxiety.
Reduced quality of life.
Physiotherapy Example
A stroke rehabilitation study should include:
Therapist salary.
Walking aids.
Transportation.
Caregiver expenses.
6. Were Costs Measured Accurately?
Researchers should explain:
Cost sources.
Currency.
Price year.
Inflation adjustments.
Physiotherapy Example
The cost of robotic gait training should include:
Equipment purchase.
Maintenance.
Staff training.
Electricity.
Therapist time.
7. Were Outcomes Measured Appropriately?
Outcome measures should be:
Valid.
Reliable.
Clinically meaningful.
Common physiotherapy outcomes include:
Pain (VAS, NPRS).
Function (ODI, WOMAC, IKDC).
Balance (Berg Balance Scale).
Mobility (TUG, 6MWT).
Quality of life (SF-36, EQ-5D).
Physiotherapy Example
A knee osteoarthritis study measures:
WOMAC.
Pain.
Walking distance.
These are appropriate clinical outcomes.
8. Were Costs and Outcomes Measured Over an Appropriate Time Period?
The follow-up period should be long enough to capture important costs and benefits.
Physiotherapy Example
Evaluating ACL rehabilitation over only two weeks would miss long-term improvements in
return-to-sport outcomes.
A one-year follow-up would be more appropriate.
9. Were Costs and Outcomes Discounted?
When studies extend beyond one year, future costs and benefits should be discounted because
money and health benefits received today are generally valued more than those received in
the future.
Physiotherapy Example
A five-year stroke rehabilitation program should discount future healthcare costs.
10. Was Incremental Analysis Performed?
When comparing interventions, researchers should calculate the:
Incremental Cost-Effectiveness Ratio (ICER).
Formula
Difference in Costs
ICER=
Difference in Outcomes
Physiotherapy Example
BFRT costs ₹5,000 more but improves IKDC scores by 10 points.
ICER = ₹500 per additional IKDC point gained.
11. Was Sensitivity Analysis Conducted?
Sensitivity analysis examines whether conclusions remain stable if assumptions change.
Variables tested may include:
Equipment costs.
Number of treatment sessions.
Therapist salaries.
Patient adherence.
Physiotherapy Example
Researchers test whether BFRT remains cost-effective if equipment costs increase by 20%.
12. Were Results Clearly Presented?
Results should include:
Total costs.
Clinical outcomes.
ICER.
Confidence intervals.
Statistical analysis.
Graphs and tables.
Physiotherapy Example
The study reports:
Cost per patient.
Functional improvement.
Cost per QALY gained.
13. Were Ethical Issues Considered?
Researchers should consider:
Equity of access.
Fair distribution of resources.
Patient preferences.
Informed consent.
Physiotherapy Example
Robotic rehabilitation may be effective but unavailable in rural hospitals, raising concerns
about equitable access.
14. Are the Results Applicable to Local Practice?
Researchers should consider:
Healthcare system.
Available resources.
Patient population.
Clinical expertise.
Local treatment costs.
Physiotherapy Example
A study conducted in the United States may not directly apply to physiotherapy practice in
India due to differences in healthcare costs and reimbursement systems.
15. Are the Conclusions Supported by the Data?
Researchers should ensure that conclusions reflect the actual findings.
Physiotherapy Example
If BFRT provides only a small improvement but costs three times more than conventional
exercise, claiming it is the "best treatment" may not be justified without considering cost-
effectiveness.
Common Sources of Bias in Economic Evaluation
Type of Bias Description
Selection Bias Non-comparable patient groups
Measurement Bias Incorrect measurement of costs or outcomes
Publication Bias Positive studies more likely to be published
Reporting Bias Selective reporting of favorable results
Funding Bias Sponsoring organizations influencing conclusions
Checklist for Critical Review of Economic Evaluation
A reviewer should ask:
1. Was the research question clearly stated?
2. Was the correct type of economic evaluation used?
3. Was the study perspective appropriate?
4. Were all relevant alternatives compared?
5. Were all important costs identified?
6. Were costs measured accurately?
7. Were outcomes measured appropriately?
8. Was the time horizon sufficient?
9. Were future costs discounted (if required)?
10. Was ICER calculated correctly?
11. Was sensitivity analysis performed?
12. Were results presented clearly?
13. Are the conclusions justified?
14. Can the findings be applied to my patients?
Drummond Checklist
One of the most widely used tools for appraising economic evaluations is the Drummond
Checklist, which includes the following questions:
1. Was a well-defined question posed?
2. Were competing alternatives described?
3. Was the effectiveness of interventions established?
4. Were all relevant costs and outcomes identified?
5. Were costs and outcomes measured accurately?
6. Were costs and outcomes valued credibly?
7. Were future costs and outcomes discounted?
8. Was an incremental analysis performed?
9. Was uncertainty addressed through sensitivity analysis?
10. Were results presented clearly with appropriate discussion?
Physiotherapy Example
Research Topic
Cost-effectiveness of Telerehabilitation vs Hospital-Based Rehabilitation After Total
Knee Replacement
Critical Review
Research Question
✔ Clearly defined.
Perspective
✔ Societal perspective.
Alternatives
✔ Two rehabilitation programs compared.
Costs
✔ Included therapist salary, travel, equipment, and caregiver costs.
Outcomes
✔ WOMAC, VAS, and Quality of Life measured.
ICER
✔ Reported correctly.
Sensitivity Analysis
✔ Performed.
Applicability
✔ Suitable for urban rehabilitation settings but may not be applicable in regions with limited
internet access.
Conclusion
The study provides reliable evidence that telerehabilitation offers similar outcomes at a lower
overall cost, supporting its use in appropriate patient populations.
Advantages of Critically Reviewing Economic Evaluations
Improves evidence-based decision-making.
Identifies high-quality economic evidence.
Prevents adoption of inefficient interventions.
Supports effective resource allocation.
Enhances patient care.
Promotes transparent healthcare policies.
Limitations
Requires knowledge of health economics.
Some studies may omit important costs.
Cost estimates vary between countries and healthcare systems.
Long-term economic outcomes may be uncertain.
Results may become outdated as technology and costs change.
Role in Evidence-Based Physiotherapy
Critical appraisal of economic evaluations enables physiotherapists to:
Integrate clinical effectiveness with economic efficiency.
Select interventions that provide the best value for patients and healthcare systems.
Advocate for funding of effective rehabilitation programs.
Support sustainable and equitable physiotherapy services.
Contribute to policy decisions based on high-quality evidence.
LOCATING ECONOMIC EVALUATION IN THE LITERATURE
Introduction
In Evidence-Based Physiotherapy (EBP), clinicians should base treatment decisions not
only on clinical effectiveness but also on the economic value of interventions. Economic
evaluations help determine whether a healthcare intervention provides good value for the
resources invested. Before critically appraising or applying an economic evaluation, it must
first be located efficiently in the scientific literature.
Locating economic evaluation in the literature is the systematic process of searching,
identifying, and retrieving published economic evaluation studies from reliable databases and
other evidence sources. A structured search strategy ensures that physiotherapists identify the
best available evidence regarding the cost-effectiveness of rehabilitation interventions.
Definition
Locating economic evaluation in the literature is the systematic process of identifying,
searching, retrieving, and selecting published economic evaluation studies from scientific
databases and other reliable sources to support evidence-based healthcare decision-making.
Objectives
The objectives are to:
Identify published economic evaluation studies.
Locate high-quality evidence on healthcare costs and outcomes.
Support evidence-based clinical decision-making.
Compare the cost-effectiveness of interventions.
Avoid duplication of research.
Identify knowledge gaps.
Support healthcare policy and planning.
Importance in Physiotherapy
Locating economic evidence helps physiotherapists to:
Select cost-effective rehabilitation interventions.
Justify physiotherapy services to administrators and insurers.
Develop evidence-based treatment protocols.
Improve healthcare resource allocation.
Support research projects and systematic reviews.
Enhance patient care while reducing unnecessary expenditure.
Sources of Economic Evaluation Literature
Economic evaluations can be found in various sources.
1. Electronic Bibliographic Databases
These are the primary sources for locating research articles.
Common databases include:
PubMed/MEDLINE
Largest biomedical database.
Contains clinical and health economic studies.
Free access.
Physiotherapy Example
Search for the cost-effectiveness of exercise therapy for knee osteoarthritis.
PEDro (Physiotherapy Evidence Database)
Specialized database for physiotherapy.
Includes randomized controlled trials, systematic reviews, and clinical practice
guidelines.
Useful for identifying physiotherapy interventions, though economic evaluations may
be fewer than in broader medical databases.
Cochrane Library
Contains:
Cochrane Systematic Reviews.
CENTRAL (Cochrane Central Register of Controlled Trials).
Reviews often include evidence on economic implications and cost-effectiveness.
Embase
Extensive biomedical database.
Includes many European journals.
Strong coverage of pharmacoeconomics and health economics.
CINAHL
Covers nursing and allied health.
Useful for physiotherapy, occupational therapy, and rehabilitation research.
Scopus
Multidisciplinary database.
Includes citation tracking.
Useful for comprehensive literature searches.
Web of Science
Citation database.
Useful for identifying influential economic evaluation studies.
EconLit
Specialized database for economics and health economics.
Useful for locating cost-effectiveness studies and economic analyses.
NHS Economic Evaluation Database (NHS EED)
Historically provided critically appraised economic evaluations. Although no longer updated,
archived records remain useful for older studies.
Types of Literature Sources
Primary Sources
Original research conducted by investigators.
Examples:
Randomized Controlled Trials with economic evaluation.
Cohort studies.
Cost-effectiveness studies.
Secondary Sources
Summaries and syntheses of primary studies.
Examples:
Systematic reviews.
Meta-analyses.
Clinical practice guidelines.
Cochrane Reviews.
Tertiary Sources
Summarized reference materials.
Examples:
Textbooks.
Encyclopedias.
Clinical manuals.
Developing a Search Strategy
A well-planned search strategy increases the likelihood of finding relevant studies.
Step 1: Define the Clinical Question
Use the PICO framework.
Component Example
Population Patients with knee osteoarthritis
Intervention Exercise therapy
Comparison Usual care
Outcome Pain reduction and cost-effectiveness
Clinical Question
"Is exercise therapy cost-effective compared with usual care for patients with knee
osteoarthritis?"
Step 2: Identify Keywords
Break the research question into important concepts.
Keywords
Knee osteoarthritis
Exercise therapy
Physiotherapy
Rehabilitation
Cost-effectiveness
Economic evaluation
Cost-utility
Cost-benefit
Step 3: Identify Synonyms
Different authors may use different terminology.
Concept Synonyms
Physiotherapy Physical therapy, rehabilitation
Cost-effectiveness Economic evaluation, health economics
Exercise Therapeutic exercise, strengthening
Using synonyms improves the search.
Boolean Operators
Boolean operators combine search terms.
AND
Narrows the search.
Example:
ACL reconstruction AND cost-effectiveness
Finds articles containing both terms.
OR
Broadens the search.
Example:
Physiotherapy OR Physical Therapy
Finds articles containing either term.
NOT
Excludes unwanted terms.
Example:
Stroke NOT Pediatrics
Removes pediatric stroke studies.
Phrase Searching
Quotation marks search for an exact phrase.
Example:
"Blood Flow Restriction Training"
Truncation
Uses a symbol (commonly *) to retrieve words with the same root.
Example:
rehab*
Retrieves:
rehabilitation
rehabilitative
rehabilitating
Medical Subject Headings (MeSH)
MeSH terms are standardized indexing terms used in PubMed.
Examples:
Physical Therapy Modalities
Exercise Therapy
Cost-Benefit Analysis
Rehabilitation
Stroke
Using MeSH terms improves search precision.
Filters
Search results can be refined using filters.
Examples:
Randomized Controlled Trial.
Systematic Review.
Economic Evaluation.
English language.
Human studies.
Adults.
Publication date (e.g., last 10 years).
Screening Search Results
Researchers should:
1. Read titles.
2. Read abstracts.
3. Remove duplicates.
4. Exclude irrelevant articles.
5. Retrieve full-text articles.
6. Apply inclusion and exclusion criteria.
Inclusion Criteria
Examples:
Adult participants.
Physiotherapy interventions.
Full economic evaluations.
Peer-reviewed publications.
English language.
Exclusion Criteria
Examples:
Animal studies.
Editorials.
Conference abstracts.
Case reports.
Studies without economic data.
Assessing Relevance
After retrieving articles, researchers should evaluate whether the study:
Addresses the clinical question.
Uses an appropriate economic evaluation method.
Includes relevant patient populations.
Reports clinically meaningful outcomes.
Measures costs appropriately.
Managing Search Results
Reference management software helps organize citations.
Examples:
EndNote
Zotero
Mendeley
RefWorks
These tools help:
Store references.
Remove duplicates.
Generate citations.
Organize literature.
Grey Literature
Grey literature includes research not published in traditional journals.
Examples:
Government reports.
University theses.
Clinical trial registries.
Health technology assessment reports.
Conference proceedings.
Including grey literature reduces publication bias.
Searching Clinical Practice Guidelines
Guidelines often include economic evidence.
Examples:
National and international physiotherapy guidelines.
Orthopaedic rehabilitation guidelines.
Stroke rehabilitation guidelines.
Physiotherapy Example
Clinical Question
Is Blood Flow Restriction Training (BFRT) cost-effective after ACL reconstruction?
Search Strategy
Databases
PubMed
PEDro
Cochrane Library
Embase
Keywords
ACL reconstruction
Blood Flow Restriction Training
Cost-effectiveness
Physiotherapy
Rehabilitation
Boolean Search
("ACL reconstruction")
AND
("Blood Flow Restriction Training")
AND
("Cost-effectiveness")
AND
(Physiotherapy OR Rehabilitation)
Results
210 articles identified.
180 after duplicate removal.
45 full-text articles reviewed.
12 economic evaluation studies included.
Challenges in Locating Economic Evaluation Literature
Different terminology across studies.
Limited indexing of economic evaluations.
Access restrictions to subscription databases.
Incomplete reporting of costs.
Rapidly expanding literature.
Publication bias.
Tips for Effective Literature Searching
Develop a clear PICO question.
Use multiple databases.
Combine keywords with MeSH terms.
Apply Boolean operators correctly.
Use appropriate filters.
Search reference lists of relevant studies.
Include grey literature where appropriate.
Document the search strategy for transparency and reproducibility.
Role in Evidence-Based Physiotherapy
Locating economic evaluation literature enables physiotherapists to:
Compare the value of different rehabilitation interventions.
Identify cost-effective treatment strategies.
Support evidence-based clinical practice.
Contribute to systematic reviews and guideline development.
Improve patient care while optimizing healthcare resources.
Advantages of Systematic Literature Searching
Identifies the best available evidence.
Reduces selection bias.
Improves transparency and reproducibility.
Supports high-quality research.
Enhances evidence-based decision-making.
Facilitates comprehensive reviews.
Limitations
Time-consuming.
Some databases require subscriptions.
Relevant studies may be missed if search terms are inadequate.
Publication bias can limit available evidence.
Older studies may use outdated economic methods.
Flowchart: Locating Economic Evaluation in the Literature
Identify Clinical Problem
│
▼
Develop PICO Question
│
▼
Identify Keywords and Synonyms
│
▼
Select Databases
│
▼
Conduct Literature Search
│
▼
Apply Boolean Operators and Filters
│
▼
Screen Titles and Abstracts
│
▼
Retrieve Full-Text Articles
│
▼
Apply Inclusion and Exclusion Criteria
│
▼
Select Relevant Economic Evaluation Studies
│
▼
Critically Appraise the Studies
│
▼
Apply Findings to Evidence-Based Physiotherapy