0% found this document useful (0 votes)
3 views131 pages

Module 3 Detailed Notes

The document outlines the process of evaluating evidence in Evidence-Based Physiotherapy (EBP), emphasizing the importance of critically appraising research studies for validity, reliability, and clinical relevance. It details the steps involved in evidence evaluation, including assessing study design, validity, reliability, sample size, and applicability to patient care. Additionally, it introduces the Levels of Evidence hierarchy, which ranks research study designs based on their methodological quality and reliability, aiding physiotherapists in making informed clinical decisions.

Uploaded by

Babu S
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
3 views131 pages

Module 3 Detailed Notes

The document outlines the process of evaluating evidence in Evidence-Based Physiotherapy (EBP), emphasizing the importance of critically appraising research studies for validity, reliability, and clinical relevance. It details the steps involved in evidence evaluation, including assessing study design, validity, reliability, sample size, and applicability to patient care. Additionally, it introduces the Levels of Evidence hierarchy, which ranks research study designs based on their methodological quality and reliability, aiding physiotherapists in making informed clinical decisions.

Uploaded by

Babu S
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

EVIDENCE BASED PRACTICE

MODULE 3
EVALUATING THE EVIDENCE

Introduction

Evaluating the evidence is the process of critically examining research studies to determine
whether the findings are valid, reliable, clinically relevant, and applicable to patient care.
In Evidence-Based Physiotherapy (EBP), not all published studies are of equal quality. A
physiotherapist must assess the quality of research before applying it in clinical practice.

Evidence evaluation helps answer questions such as:

 Is the study scientifically sound?


 Can the results be trusted?
 Are the findings applicable to my patient?
 Will the intervention improve patient outcomes?

Definition

Evaluating the evidence is the systematic process of critically appraising research studies to
determine their validity, reliability, importance, and applicability before integrating them
into clinical decision-making.

Objectives of Evaluating Evidence

After evaluating evidence, a physiotherapist should be able to:

 Determine whether research findings are trustworthy.


 Identify strengths and weaknesses of a study.
 Detect bias and methodological flaws.
 Decide whether results can be applied to patients.
 Integrate evidence with clinical expertise and patient preferences.

Importance of Evaluating Evidence in Physiotherapy

Evidence evaluation helps physiotherapists:

 Choose effective treatment techniques.


 Avoid ineffective or harmful interventions.
 Improve patient safety.
 Promote evidence-based clinical practice.
 Optimize rehabilitation outcomes.
 Enhance professional credibility.
Steps in Evaluating the Evidence

Step 1: Identify the Research Question

Determine what the researchers intended to investigate.

Ask:

 What is the clinical question?


 Is it clearly stated?
 Is the objective specific?

Physiotherapy Example

Research Question:

"Does eccentric exercise reduce pain in patients with Achilles tendinopathy?"

This question clearly identifies:

 Population → Achilles tendinopathy patients


 Intervention → Eccentric exercises
 Outcome → Pain reduction

Step 2: Evaluate Study Design

Different research questions require different study designs.

Clinical Question Best Study Design


Treatment effectiveness Randomized Controlled Trial (RCT)
Diagnosis Diagnostic Accuracy Study
Prognosis Cohort Study
Risk Factors Case-Control Study
Patient experiences Qualitative Study
Overall evidence Systematic Review & Meta-analysis

Physiotherapy Example

Question:

"Does dry needling reduce neck pain?"

Best evidence:

Randomized Controlled Trial.


Step 3: Assess Validity

Validity refers to whether the study truly measures what it claims to measure.

Two major types:

Internal Validity

Measures whether the observed effect is actually due to the intervention.

Threats include:

 Selection bias
 Measurement bias
 Performance bias
 Attrition bias

Example

Two groups receive different rehabilitation programs after ACL reconstruction.

If one group receives additional strength training outside the study, results become biased.

External Validity

Indicates whether findings can be generalized to other patients.

Example

Study participants:

 Elite football players aged 18–22 years

Can results be applied to:

 Elderly osteoarthritis patients?

Probably not.

Step 4: Assess Reliability

Reliability refers to consistency of measurements.

A reliable assessment gives similar results when repeated.

Examples of reliable physiotherapy tools:

 Hand-held dynamometer
 Digital goniometer
 Isokinetic dynamometer
 Force plate
 Biodex Balance System

Example

If knee flexion ROM is measured today and tomorrow under identical conditions, similar
results should be obtained.

Step 5: Evaluate Sample Size

Large samples generally provide more reliable results.

Small samples may:

 Overestimate treatment effects


 Produce unstable conclusions

Physiotherapy Example

Study A:

10 patients after stroke

Study B:

250 patients after stroke

Study B provides stronger evidence.

Step 6: Assess Randomization

Randomization ensures every participant has an equal chance of entering either group.

Benefits:

 Reduces selection bias


 Produces comparable groups
 Improves validity

Example

ACL patients randomly assigned to:

Group A:

Conventional rehabilitation

Group B:

Neuromuscular rehabilitation
Step 7: Allocation Concealment

Researchers enrolling participants should not know future group assignments.

Purpose:

Prevents selection bias.

Step 8: Blinding

Blinding minimizes bias.

Types:

Single blind

Patient unaware of treatment.

Double blind

Patient and assessor unaware.

Triple blind

Patient, assessor, and statistician unaware.

Physiotherapy Example

Comparing therapeutic ultrasound with placebo ultrasound.

Patients should not know whether the machine is active.

Outcome assessor should also remain blinded.

Step 9: Assess Outcome Measures

Outcome measures should be:

 Valid
 Reliable
 Responsive
 Clinically meaningful
Common Physiotherapy Outcome Measures

Condition Outcome Measure


Low back Oswestry Disability Index (ODI)
pain
Knee OA WOMAC
Stroke Berg Balance Scale
Balance Timed Up and Go Test
ACL IKDC Score
Shoulder SPADI
General health SF-36
Pain Visual Analogue Scale (VAS), Numeric Pain Rating Scale (NPRS)

Step 10: Evaluate Statistical Analysis

Check whether appropriate statistical tests were used.

Common tests

Data Type Statistical Test


Two independent groups Independent t-test
Same subjects before-after Paired t-test
Three or more groups ANOVA
Association Chi-square
Correlation Pearson/Spearman correlation
Prediction Regression analysis

Step 11: Statistical Significance

Most studies use

p < 0.05

Meaning:

Less than 5% probability that findings occurred by chance.

Example

Pain reduction after exercise

p = 0.003

Statistically significant.
Step 12: Clinical Significance

A statistically significant result may not be clinically meaningful.

Example

Pain score reduced:

From 8/10 to 7.8/10

Although p < 0.05,

Patients may not actually feel better.

Clinical significance asks:

"Does the patient experience meaningful improvement?"

Step 13: Effect Size

Effect size measures how large the treatment effect is.

Interpretation (Cohen's d):

 Small = 0.2
 Moderate = 0.5
 Large = 0.8

Physiotherapy Example

Strength gains after resistance training

Effect size = 0.92

Large clinical benefit.

Step 14: Confidence Interval (CI)

Confidence interval estimates the precision of results.

Example

Pain reduction:

Mean difference = 3.2

95% CI = 2.4–4.0

Narrow CI = more precise.


Step 15: Risk of Bias

Common sources of bias:

Type of Bias Description


Selection bias Unequal participant selection
Performance bias Differences in treatment received
Detection bias Outcome assessment influenced
Attrition bias Participant dropouts
Reporting bias Selective publication of positive results

Step 16: Applicability (Clinical Relevance)

Before applying evidence ask:

 Are my patients similar?


 Is equipment available?
 Is treatment affordable?
 Is it acceptable to patients?
 Do benefits outweigh risks?

Physiotherapy Example

Study recommends robotic gait training.

Your clinic has no robotic device.

Evidence may not be practically applicable.

Critical Appraisal Checklist

A physiotherapist should ask:

1. Was the research question clearly defined?


2. Was the study design appropriate?
3. Was randomization performed?
4. Was allocation concealed?
5. Was blinding used?
6. Was sample size adequate?
7. Were outcome measures valid?
8. Were statistical analyses appropriate?
9. Are results clinically important?
10. Can findings be applied to my patient?
Physiotherapy Case Example

Clinical Problem

A physiotherapist wants to know whether Blood Flow Restriction Training (BFRT)


improves quadriceps strength after ACL reconstruction.

Research Findings

 120 participants
 Randomized Controlled Trial
 Blinded assessor
 Valid outcome measures
 Follow-up: 12 weeks
 p < 0.001
 Effect size = 0.89
 Low risk of bias

Evaluation

 Strong study design


 Adequate sample size
 Reliable measurements
 Significant results
 Large treatment effect
 Applicable to sports physiotherapy

Conclusion: The evidence supports incorporating BFRT into rehabilitation after ACL
reconstruction, provided there are no contraindications and the clinician is trained in its use.

Advantages of Evaluating Evidence

 Improves quality of patient care.


 Supports informed clinical decision-making.
 Reduces ineffective treatments.
 Enhances patient safety.
 Promotes lifelong learning.
 Improves rehabilitation outcomes.
 Encourages cost-effective healthcare.

Limitations

 Requires knowledge of research methodology and statistics.


 High-quality evidence may not be available for every condition.
 Time-consuming to appraise studies.
 Results may not always be generalizable to all patient populations.
 Access to full-text research articles may be limited.
LEVELS OF EVIDENCE IN RESEARCH USING QUANTITATIVE METHODS

Introduction

In Evidence-Based Physiotherapy (EBP), clinical decisions should be based on the best


available scientific evidence. However, not all research studies provide the same level of
confidence. Some study designs produce stronger and more reliable evidence than others. The
Levels of Evidence are a hierarchical system used to rank research according to the strength,
quality, and risk of bias of the evidence they provide.

Higher levels of evidence generally offer greater confidence in the results because they use
rigorous study designs that minimize bias and random error.

Definition

Levels of Evidence refer to a hierarchical ranking of research study designs based on their
methodological quality, validity, reliability, and ability to answer clinical questions. This
hierarchy helps healthcare professionals identify the most trustworthy evidence for clinical
decision-making.

Objectives of Levels of Evidence

The levels of evidence help physiotherapists to:

 Identify the strongest available evidence.


 Differentiate high-quality from low-quality research.
 Make evidence-based treatment decisions.
 Reduce bias in clinical practice.
 Improve patient outcomes.
 Support the development of clinical guidelines.

Importance in Physiotherapy

Understanding levels of evidence enables physiotherapists to:

 Select effective rehabilitation protocols.


 Avoid ineffective or harmful interventions.
 Critically appraise research literature.
 Develop evidence-based treatment plans.
 Improve patient safety and quality of care.
 Contribute to research and guideline development.
Hierarchy of Quantitative Evidence

The evidence hierarchy is commonly represented as a pyramid, with the strongest evidence
at the top and the weakest at the bottom.

Level Type of Evidence Strength


Level I Systematic Reviews and Meta-analyses of Randomized Controlled Highest
Trials (RCTs)
Level II Randomized Controlled Trials (RCTs) Very
High
Level III Controlled Clinical Trials (Non-randomized) High
Level IV Cohort Studies and Case-Control Studies Moderate
Level V Cross-Sectional Studies Low
Level VI Case Series and Case Reports Very Low
Level Expert Opinion, Clinical Experience Lowest
VII

Evidence Pyramid

Level I
Systematic Reviews & Meta-analysis

Randomized Trials

Controlled Clinical Trials

Cohort & Case-Control Studies

Cross-Sectional Studies

Case Series / Case Reports

Expert Opinion / Clinical Experience

As we move upward:

 Study quality increases.


 Risk of bias decreases.
 Confidence in results improves.

Level I – Systematic Review and Meta-analysis

Definition

A Systematic Review is a structured review of all available high-quality studies on a specific


clinical question using predefined methods.
A Meta-analysis statistically combines the results of multiple studies to provide an overall
estimate of treatment effect.

Characteristics

 Comprehensive literature search.


 Clearly defined inclusion and exclusion criteria.
 Critical appraisal of included studies.
 Combines results from multiple RCTs.
 Provides the highest level of quantitative evidence.

Advantages

 Highest scientific reliability.


 Large combined sample size.
 Reduces random error.
 Produces strong clinical recommendations.

Limitations

 Depends on the quality of included studies.


 Publication bias may influence results.
 Time-consuming to conduct.

Physiotherapy Example

A systematic review analyzes 25 RCTs evaluating Blood Flow Restriction Training


(BFRT) after ACL reconstruction.

Conclusion: BFRT significantly improves quadriceps strength and functional recovery


compared with conventional rehabilitation.

This provides the strongest evidence supporting BFRT in sports physiotherapy.

Level II – Randomized Controlled Trial (RCT)

Definition

An RCT is an experimental study in which participants are randomly assigned to intervention


or control groups to compare treatment outcomes.

Characteristics

 Random allocation.
 Control group.
 Prospective design.
 Blinding whenever possible.
 Direct comparison of interventions.
Advantages

 Minimizes selection bias.


 Strong cause-and-effect evidence.
 High internal validity.

Limitations

 Expensive.
 Time-consuming.
 Ethical limitations for some interventions.
 Blinding may be difficult in physiotherapy.

Physiotherapy Example

Research Question: Does eccentric exercise reduce pain in Achilles tendinopathy?

Participants:

 Group A: Eccentric exercise.


 Group B: Conventional stretching.

After 12 weeks:

 Group A shows greater pain reduction and improved function.

Conclusion: Eccentric exercise is more effective than stretching.

Level III – Controlled Clinical Trial (Non-randomized)

Definition

Participants receive different interventions, but group allocation is not random.

Characteristics

 Intervention study.
 Control group present.
 No randomization.
 Higher risk of selection bias.

Advantages

 Easier to conduct than RCTs.


 Useful when randomization is not feasible.
Limitations

 Greater risk of bias.


 Less reliable than RCTs.

Physiotherapy Example

Hospital A provides aquatic therapy for knee osteoarthritis, while Hospital B provides land-
based exercise. Outcomes are compared without random assignment.

Level IV – Cohort Study

Definition

A cohort study follows groups of participants over time to observe outcomes based on
different exposures or interventions.

Characteristics

 Observational study.
 Prospective or retrospective.
 No intervention by researchers.
 Measures incidence and prognosis.

Advantages

 Useful for prognosis.


 Can study multiple outcomes.
 Suitable when RCTs are impractical.

Limitations

 Confounding variables.
 Long follow-up periods.
 Cannot definitively establish causation.

Physiotherapy Example

Athletes who complete neuromuscular training are followed for one competitive season and
compared with athletes who do not. The incidence of ACL injuries is recorded.

Level IV – Case-Control Study

Definition

Compares participants with a condition (cases) to those without the condition (controls) to
identify previous exposures or risk factors.
Characteristics

 Retrospective.
 Begins with the outcome.
 Looks backward to identify risk factors.

Advantages

 Suitable for rare conditions.


 Quick and cost-effective.

Limitations

 Recall bias.
 Selection bias.
 Cannot calculate disease incidence directly.

Physiotherapy Example

Researchers compare athletes with chronic ankle instability to healthy athletes to determine
whether previous ankle sprains increase the risk of long-term instability.

Level V – Cross-Sectional Study

Definition

A cross-sectional study measures exposure and outcome at a single point in time

Characteristics

 Snapshot of a population.
 Measures prevalence.
 No follow-up.

Advantages

 Fast.
 Inexpensive.
 Useful for surveys.

Limitations

 Cannot establish cause-and-effect.


 Cannot determine the sequence of events.

Physiotherapy Example

A survey of office workers measures the prevalence of neck pain and poor sitting posture
during one month.
Level VI – Case Series and Case Reports

Definition

A case report describes one patient, while a case series describes several patients with similar
conditions.

Characteristics

 Descriptive.
 No control group.
 Often reports unusual cases or innovative treatments.

Advantages

 Identifies new clinical observations.


 Generates ideas for future research.

Limitations

 Cannot establish effectiveness.


 Limited generalizability.

Physiotherapy Example

A physiotherapist reports successful rehabilitation of three elite football players with patellar
tendinopathy using a novel isometric exercise protocol.

Level VII – Expert Opinion

Definition

Recommendations based on the experience of clinicians or expert panels rather than


systematic research.

Characteristics

 Clinical experience.
 Consensus statements.
 Narrative reviews.
 Opinion articles.

Advantages

 Helpful when research evidence is lacking.


 Provides practical guidance.
Limitations

 Highest risk of bias.


 May reflect personal beliefs rather than scientific evidence.

Physiotherapy Example

An experienced sports physiotherapist recommends cryotherapy immediately after acute


ankle sprain based on years of clinical practice, despite limited high-quality research.

Comparison of Levels of Evidence

Level Study Design Randomization Control Strength of


Group Evidence
I Systematic Yes (included Yes Highest
Review/Meta-analysis studies)
II Randomized Controlled Yes Yes Very High
Trial
III Controlled Clinical Trial No Yes High
IV Cohort Study No Observational Moderate
IV Case-Control Study No Observational Moderate
V Cross-Sectional Study No No Low
VI Case Series/Case Report No No Very Low
VII Expert Opinion No No Lowest

Applying Levels of Evidence in Physiotherapy

Example 1: Knee Osteoarthritis

Clinical Question: Does exercise reduce pain?

 Level I: Meta-analysis confirms exercise therapy improves pain and function.


 Level II: RCT compares strengthening exercises with education alone.
 Level III: Non-randomized comparison of aquatic versus land-based exercise.
 Level IV: Cohort study follows patients participating in exercise programs.
 Level VII: Expert recommends specific exercises based on experience.

The physiotherapist should prioritize Level I evidence while considering patient needs and
available resources.

Example 2: ACL Rehabilitation

Clinical Question: Does Blood Flow Restriction Training improve quadriceps strength after
ACL reconstruction?

 Level I: Systematic review shows significant improvements.


 Level II: RCT demonstrates greater strength gains with BFRT.
 Level III: Controlled trial supports similar findings without randomization.
 Level IV: Cohort study reports better return-to-sport outcomes.
 Level VI: Case series describes successful rehabilitation in elite athletes.

The strongest recommendation would come from Level I and II evidence.

Limitations of the Evidence Hierarchy

 High-level evidence is not available for every clinical question.


 RCTs may be impractical or unethical in some situations.
 Poorly conducted RCTs may provide weaker evidence than well-conducted
observational studies.
 Patient preferences and clinical expertise must always be integrated with research
evidence.
LEVELS OF EVIDENCE CLASSIFICATION SYSTEM

Introduction

In Evidence-Based Practice (EBP), healthcare professionals need a systematic way to judge


the quality and strength of research before applying it to patient care. The Levels of Evidence
Classification System is a standardized framework that ranks research studies according to
their methodological quality, validity, reliability, and risk of bias.

The classification system helps physiotherapists, clinicians, educators, and researchers


determine how much confidence can be placed in research findings. It forms the basis for
developing clinical practice guidelines, treatment recommendations, and healthcare
policies.

Definition

The Levels of Evidence Classification System is a hierarchical framework used to


categorize research studies based on the strength of scientific evidence they provide for
answering clinical questions. It ranks evidence from the highest quality (systematic reviews
and randomized controlled trials) to the lowest quality (expert opinion).

Objectives of the Levels of Evidence Classification System

The classification system aims to:

 Identify the highest-quality evidence available.


 Assist clinicians in making evidence-based decisions.
 Reduce the influence of bias in clinical practice.
 Standardize the evaluation of research studies.
 Support the development of clinical practice guidelines.
 Improve patient care and treatment outcomes.
 Facilitate research appraisal and interpretation.

Need for a Classification System

Without a standardized classification system:

 Clinicians may rely on poor-quality studies.


 Conflicting research findings become difficult to interpret.
 Treatment decisions may be inconsistent.
 Clinical guidelines may not be evidence-based.

A classification system provides a common language for evaluating research quality and
ensures that stronger evidence is given greater importance.
Characteristics of a Good Classification System

An effective evidence classification system should:

 Be simple and easy to understand.


 Clearly differentiate between levels of evidence.
 Consider study design and methodological quality.
 Be applicable to different types of clinical questions.
 Be reproducible and transparent.
 Support evidence-based clinical decision-making.

Common Levels of Evidence Classification Systems

Several organizations have developed evidence classification systems. The most commonly
used include:

1. Oxford Centre for Evidence-Based Medicine (OCEBM)


2. Joanna Briggs Institute (JBI)
3. GRADE (Grading of Recommendations Assessment, Development and Evaluation)
4. National Health and Medical Research Council (NHMRC)
5. American Physical Therapy Association (APTA) Evidence Framework

Although the terminology varies slightly, all systems rank evidence from stronger to weaker
based on study design and quality.

Oxford Centre for Evidence-Based Medicine (OCEBM) Classification

The OCEBM is one of the most widely used systems in medicine and physiotherapy.

Level Type of Evidence Examples

Level 1 Systematic Reviews, Meta-analyses, High- Best evidence for treatment


quality Randomized Controlled Trials effectiveness

Level 2 Individual Randomized Controlled Trials or Clinical intervention studies


Prospective Cohort Studies

Level 3 Non-randomized Controlled Studies, Case- Observational comparative studies


Control Studies

Level 4 Case Series and Poor-quality Cohort Studies Descriptive clinical research

Level 5 Expert Opinion, Narrative Reviews, Lowest level of evidence


Laboratory Research

Description of Each Level


Level 1 – Highest Level of Evidence

Definition

Evidence obtained from:

 Systematic reviews
 Meta-analyses
 High-quality randomized controlled trials

Characteristics

 Comprehensive literature review.


 Low risk of bias.
 Large sample sizes.
 Consistent findings across studies.

Physiotherapy Example

A meta-analysis of 30 randomized controlled trials concludes that exercise therapy


significantly improves pain and physical function in patients with knee osteoarthritis,
providing strong support for exercise as a first-line intervention.

Strengths

 Highest reliability.
 Strong clinical recommendations.
 Excellent external validity.

Limitations

 Dependent on the quality of included studies.


 Publication bias may influence conclusions.

Level 2 – High-Quality Individual Studies

Definition

Evidence from:

 Randomized Controlled Trials (RCTs)


 Prospective cohort studies

Characteristics

 Random allocation (RCTs).


 Controlled interventions.
 Prospective follow-up.
 Reduced bias.
Physiotherapy Example

An RCT compares Blood Flow Restriction Training (BFRT) with conventional


strengthening after ACL reconstruction. Patients receiving BFRT show greater improvements
in quadriceps strength and functional outcomes.

Strengths

 High internal validity.


 Strong evidence for treatment effectiveness.

Limitations

 Expensive and time-consuming.


 Blinding may be difficult in rehabilitation studies.

Level 3 – Moderate Evidence

Definition

Evidence from:

 Non-randomized controlled trials.


 Case-control studies.

Characteristics

 No randomization.
 Greater risk of bias.
 Useful when RCTs are impractical.

Physiotherapy Example

Researchers compare outcomes of patients receiving aquatic therapy in one rehabilitation


center with those receiving land-based exercise in another center, without random
assignment.

Strengths

 Practical in real-world settings.


 Useful for studying risk factors.

Limitations

 Higher susceptibility to confounding factors.


 Lower internal validity than RCTs.

Level 4 – Limited Evidence


Definition

Evidence from:

 Case series.
 Poor-quality cohort studies.

Characteristics

 Descriptive.
 No control group.
 Limited ability to establish cause and effect.

Physiotherapy Example

A physiotherapist reports rehabilitation outcomes of six elite football players treated with a
new proprioceptive training program after ankle sprains.

Strengths

 Generates new clinical ideas.


 Useful for rare conditions.

Limitations

 Small sample size.


 Cannot establish treatment effectiveness.

Level 5 – Lowest Level of Evidence

Definition

Evidence based on:

 Expert opinion.
 Clinical experience.
 Narrative reviews.
 Laboratory research without clinical validation.

Characteristics

 No systematic methodology.
 High risk of bias.
 Often used when research evidence is unavailable.

Physiotherapy Example
An experienced sports physiotherapist recommends a specific warm-up routine for injury
prevention based primarily on years of clinical practice rather than high-quality research.

Strengths

 Provides guidance in areas lacking research.


 Draws on extensive clinical expertise.

Limitations

 Subjective.
 Least reliable for determining treatment effectiveness.

GRADE Classification System

The GRADE system is widely used to assess the certainty of evidence and the strength of
recommendations in clinical guidelines.

Quality of Interpretation
Evidence
High Further research is very unlikely to change confidence in the estimate
of effect.
Moderate Further research may have an important impact on confidence in the
estimate.
Low Further research is likely to change the estimate of effect.
Very Low The true effect is likely to be substantially different from the
estimated effect.

Physiotherapy Example

When developing guidelines for managing chronic low back pain:

 Multiple high-quality RCTs supporting exercise therapy would be graded as High


certainty.
 Limited observational studies on a newer intervention might receive a Low certainty
rating.

Joanna Briggs Institute (JBI) Levels of Evidence

The JBI system classifies evidence according to the type of clinical question, such as:

 Effectiveness of interventions.
 Diagnostic accuracy.
 Prognosis.
 Etiology and risk.
 Economic evaluation.
 Meaningfulness (qualitative research).

This allows researchers to select the most appropriate study design for different healthcare
questions.
Choosing the Appropriate Level of Evidence

Clinical Question Preferred Study Design Evidence Level


Treatment effectiveness Systematic Review / RCT Level 1–2
Diagnosis Diagnostic Accuracy High
Study
Prognosis Cohort Study Moderate
Risk factors Case-Control Study Moderate
Prevalence Cross-Sectional Study Lower
Rare clinical conditions Case Series Low

Application in Physiotherapy

Example 1: Knee Osteoarthritis

Clinical Question: Does strengthening exercise reduce pain?

 Level 1: Meta-analysis demonstrates consistent pain reduction and functional


improvement.
 Level 2: Individual RCTs confirm the effectiveness of strengthening programs.
 Level 3: Non-randomized comparative studies provide additional supportive
evidence.
 Level 5: Expert opinion recommends specific exercise progressions when evidence is
limited.

A physiotherapist should prioritize Level 1 and Level 2 evidence while considering the
patient's preferences and clinical circumstances.

Example 2: Stroke Rehabilitation

Clinical Question: Does task-oriented training improve upper limb function?

 High-quality systematic reviews and RCTs support task-oriented training as an


effective rehabilitation strategy.
 Case series may provide preliminary evidence for novel technologies, such as robotic-
assisted therapy, until stronger studies become available.

Advantages of the Levels of Evidence Classification System


 Promotes evidence-based clinical practice.
 Improves patient safety.
 Standardizes research appraisal.
 Reduces bias in decision-making.
 Supports guideline development.
 Encourages the use of high-quality research.
 Helps allocate healthcare resources effectively.
 Improves consistency in clinical care.

Limitations of the Classification System

 High-level evidence may not exist for every clinical problem.


 Study design alone does not guarantee high quality; poorly conducted RCTs may
provide weaker evidence than well-conducted observational studies.
 Some important clinical questions cannot be answered ethically through randomized
trials.
 The classification system should be used alongside critical appraisal, clinical
expertise, and patient preferences.

OUTCOME MEASUREMENT
Introduction

Outcome Measurement is a fundamental component of Evidence-Based Physiotherapy


(EBP). It involves the systematic assessment of a patient's health status before, during, and
after an intervention to determine whether treatment has achieved its intended goals.

Outcome measurement enables physiotherapists to objectively evaluate the effectiveness of


rehabilitation, monitor patient progress, modify treatment plans when necessary, and
demonstrate the value of physiotherapy services. Reliable outcome measures also provide
evidence for clinical research, quality improvement, and healthcare decision-making.

Definition

Outcome Measurement is the process of using standardized, valid, and reliable assessment
tools to evaluate changes in a patient's health status, function, participation, and quality of life
following healthcare interventions.

Objectives of Outcome Measurement

Outcome measurement aims to:

 Evaluate treatment effectiveness.


 Monitor patient progress over time.
 Assist in clinical decision-making.
 Compare different treatment approaches.
 Support evidence-based practice.
 Improve communication among healthcare professionals.
 Enhance patient satisfaction.
 Contribute to clinical research and audits.

Importance of Outcome Measurement in Physiotherapy

Outcome measurement helps physiotherapists to:

 Assess baseline patient status.


 Set realistic rehabilitation goals.
 Measure improvement objectively.
 Identify patients who are not progressing.
 Modify treatment plans appropriately.
 Demonstrate treatment effectiveness.
 Improve accountability and quality of care.
 Support insurance and reimbursement claims.

Characteristics of a Good Outcome Measure

An ideal outcome measure should be:


1. Valid

Measures what it is intended to measure.

Example:
The Visual Analogue Scale (VAS) accurately measures pain intensity.

2. Reliable

Produces consistent results under similar conditions.

Example:
A goniometer should provide similar knee flexion measurements when used repeatedly by
trained clinicians.

3. Responsive

Able to detect clinically important changes over time.

Example:
The Oswestry Disability Index (ODI) detects improvement in patients with low back pain
after rehabilitation.

4. Practical

Easy to administer, inexpensive, and time-efficient.

Example:
The Timed Up and Go (TUG) test takes less than 5 minutes.

5. Interpretable

Scores should be easy to understand and clinically meaningful.

Types of Outcome Measures

Outcome measures are broadly classified into:

1. Patient-Reported Outcome Measures (PROMs)

Patients report their own symptoms, function, and quality of life.

Examples:

 Visual Analogue Scale (VAS)


 Numeric Pain Rating Scale (NPRS)
 Oswestry Disability Index (ODI)
 WOMAC
 SPADI
 DASH
 IKDC
 SF-36

Advantages

 Reflect patient's perspective.


 Easy to administer.
 Assess pain and disability.

Limitations

 Subjective.
 Influenced by emotions and expectations.

Physiotherapy Example

A patient with chronic low back pain reports:

Before treatment:

VAS = 8/10

After 6 weeks:

VAS = 3/10

Pain has significantly improved.

2. Performance-Based Outcome Measures

Measure the patient's ability to perform functional tasks.

Examples

 Timed Up and Go Test (TUG)


 Six-Minute Walk Test (6MWT)
 Ten-Meter Walk Test
 Sit-to-Stand Test
 Berg Balance Scale
 Functional Reach Test

Advantages

 Objective.
 Reflect real-life function.

Limitations

 Require space and equipment.


 Influenced by patient motivation.

Physiotherapy Example

Stroke rehabilitation

Before therapy:

TUG = 28 seconds

After rehabilitation:

TUG = 14 seconds

Mobility has significantly improved.

3. Impairment-Based Outcome Measures

Assess physical impairments.

Examples

 Range of Motion (ROM)


 Manual Muscle Testing (MMT)
 Hand-held Dynamometry
 Grip Strength
 Muscle Length Tests
 Joint Stability Tests

Physiotherapy Example

ACL Rehabilitation

Quadriceps strength

Week 1:

MMT = Grade 3

Week 8:

MMT = Grade 5
Significant strength improvement.

4. Physiological Outcome Measures

Measure physiological functions.

Examples

 Heart Rate
 Blood Pressure
 VO₂ Max
 Peak Expiratory Flow Rate
 Oxygen Saturation
 Pulmonary Function Tests

Physiotherapy Example

Cardiac rehabilitation

Resting heart rate

Before program: 92 bpm

After 8 weeks:n74 bpm

Cardiovascular fitness improved.

Domains of Outcome Measurement

1. Pain

Common Outcome Measures

 Visual Analogue Scale (VAS)


 Numeric Pain Rating Scale (NPRS)
 McGill Pain Questionnaire

Physiotherapy Example

Tennis elbow rehabilitation

Pain decreases from: VAS = 7 to VAS = 2

2. Range of Motion (ROM)

Measured using:
 Universal Goniometer
 Digital Goniometer
 Inclinometer

Physiotherapy Example

Frozen Shoulder

Initial shoulder abduction 70°

After physiotherapy 160°

3. Muscle Strength

Assessment Tools

 Manual Muscle Testing


 Hand-held Dynamometer
 Isokinetic Dynamometer

Physiotherapy Example

After rotator cuff repair

Shoulder abduction strength

Grade 2 → Grade 5

4. Functional Mobility

Outcome Measures

 Timed Up and Go Test


 Six-Minute Walk Test
 Five Times Sit-to-Stand Test

Physiotherapy Example

Total Knee Replacement

Walking distance

Before rehabilitation 120 m

After rehabilitation 420 m

5. Balance

Outcome Measures
 Berg Balance Scale
 Functional Reach Test
 Y Balance Test
 Star Excursion Balance Test

Physiotherapy Example

Older adult

Berg Balance Scale

38/56

52/56

Fall risk reduced.

6. Quality of Life

Outcome Measures

 SF-36
 EQ-5D
 WHOQOL

Physiotherapy Example

Cancer survivor rehabilitation

Improved physical functioning and emotional well-being following exercise therapy.

Common Physiotherapy Outcome Measures

Clinical Condition Outcome Measure


Low Back Pain Oswestry Disability Index (ODI)
Neck Pain Neck Disability Index (NDI)
Knee Osteoarthritis WOMAC
ACL Injury IKDC, Lysholm Knee Score
Shoulder Disorders SPADI, Constant Score
Stroke Fugl-Meyer Assessment, Barthel Index
Parkinson's Disease UPDRS
Balance Disorders Berg Balance Scale
Falls Risk Timed Up and Go (TUG)
General Health SF-36
International Classification of Functioning (ICF) Framework

The World Health Organization (WHO) recommends outcome measurement based on the
International Classification of Functioning, Disability and Health (ICF).

The ICF framework has three major domains:

1. Body Structure and Function

Measures impairments.

Examples

 Pain
 ROM
 Muscle strength
 Spasticity

Physiotherapy Example

Increase knee flexion from 80° to 130°.

2. Activity

Measures the ability to perform tasks.

Examples

 Walking
 Stair climbing
 Dressing
 Sit-to-Stand

Physiotherapy Example

Patient walks independently after stroke rehabilitation.

3. Participation

Measures involvement in daily life.

Examples

 Work
 Sports
 School
 Social activities

Physiotherapy Example
Football player returns to competitive sport after ACL reconstruction.

Selecting an Appropriate Outcome Measure

The physiotherapist should consider:

 Patient's condition.
 Age.
 Clinical setting.
 Purpose of assessment.
 Validity and reliability.
 Time available.
 Equipment required.
 Sensitivity to change.
 Cultural and language suitability.

Outcome Measurement Process

Step 1

Assess baseline status.

Example

Pain VAS = 8

Step 2

Develop treatment goals.

Example

Reduce pain to VAS <3.

Step 3

Provide intervention.

Example

Exercise therapy

Manual therapy

Electrotherapy

Step 4

Reassess outcomes.
Example

VAS

ROM

Strength

Function

Step 5

Compare results.

Determine whether goals have been achieved.

Step 6

Modify treatment if necessary.

Clinical Example

Patient

55-year-old female

Knee Osteoarthritis

Baseline Assessment

Pain

VAS = 8

ROM

90°

WOMAC

68/96

Walking distance

120 m

Intervention

 Quadriceps strengthening
 Stretching
 Balance training
 Patient education
 Aerobic exercise

Eight Weeks Later

Pain

VAS = 3

ROM

125°

WOMAC

32/96

Walking distance

420 m

Interpretation

Outcome measures indicate significant improvement in pain, mobility, function, and walking
capacity, demonstrating the effectiveness of the rehabilitation program.

Advantages of Outcome Measurement

 Provides objective evidence of treatment effectiveness.


 Improves patient-centered care.
 Supports clinical decision-making.
 Enhances communication among healthcare professionals.
 Facilitates research and quality improvement.
 Assists in developing clinical guidelines.
 Increases accountability and professional credibility.
 Encourages continuous monitoring of patient progress.

Limitations of Outcome Measurement

 Some tools require specialized training.


 Certain measures may be time-consuming.
 Patient-reported measures can be influenced by motivation, mood, and expectations.
 Cultural or language differences may affect responses.
 No single outcome measure assesses all aspects of health; multiple measures are often
needed.

Outcome Measures in Sports Physiotherapy

Sports Injury Recommended Outcome Measures


ACL Reconstruction IKDC, Lysholm Knee Score, Single-Leg Hop Tests, Isokinetic
Strength Testing
Ankle Sprain FAAM, Cumberland Ankle Instability Tool (CAIT), Star Excursion
Balance Test
Shoulder Instability WOSI, SPADI, Constant-Murley Score
Achilles VISA-A Questionnaire
Tendinopathy
Patellar VISA-P Questionnaire
Tendinopathy
Hamstring Injury Active Knee Extension Test, Nordic Hamstring Strength Test,
Sprint Performance

BIOSTATISTICS
Introduction

Biostatistics is the branch of statistics that applies statistical principles and methods to
biological, medical, and health sciences. It plays a vital role in Evidence-Based
Physiotherapy (EBP) by helping clinicians design research, analyze data, interpret results,
and make informed clinical decisions.

Physiotherapists use biostatistics to determine whether a treatment is effective, compare


rehabilitation methods, assess patient outcomes, and critically appraise research. It transforms
raw clinical data into meaningful information that supports safe and effective patient care.

Definition

Biostatistics is the application of statistical methods to the collection, organization, analysis,


interpretation, and presentation of data related to biological, medical, and health sciences.

Objectives of Biostatistics

Biostatistics aims to:

 Collect accurate health-related data.


 Organize and summarize research findings.
 Analyze clinical data scientifically.
 Compare treatment effectiveness.
 Test research hypotheses.
 Draw valid conclusions from research.
 Support evidence-based clinical practice.
 Improve patient care and healthcare decision-making.

Importance of Biostatistics in Physiotherapy

Biostatistics helps physiotherapists to:

 Evaluate treatment outcomes.


 Compare rehabilitation techniques.
 Measure changes in pain, strength, and function.
 Interpret research findings.
 Develop clinical guidelines.
 Conduct high-quality research.
 Improve patient safety and quality of care.
 Support publication of scientific studies.

Applications of Biostatistics in Physiotherapy

Biostatistics is used in:


 Clinical trials.
 Sports injury research.
 Neurological rehabilitation.
 Cardiopulmonary rehabilitation.
 Orthopaedic rehabilitation.
 Community-based rehabilitation.
 Outcome measurement.
 Quality improvement programs.
 Epidemiological studies.
 Systematic reviews and meta-analyses.

Physiotherapy Example

A physiotherapist compares Blood Flow Restriction Training (BFRT) with conventional


strengthening after ACL reconstruction. Biostatistics helps determine whether the differences
in muscle strength are statistically significant.

Steps in Biostatistical Analysis

1. Define the research problem.


2. Formulate research objectives.
3. Develop hypotheses.
4. Collect data.
5. Organize data.
6. Analyze data using statistical tests.
7. Interpret results.
8. Draw conclusions.
9. Report findings.

Types of Data

1. Qualitative (Categorical) Data

Describes characteristics or categories.

Types

Nominal Data

Categories without any order.

Examples:

 Gender
 Blood group
 Type of injury
 Dominant hand

Physiotherapy Example
Comparing the number of male and female athletes with ACL injuries.

Ordinal Data

Categories with a natural order.

Examples:

 Pain severity (Mild, Moderate, Severe)


 Muscle strength grades (MMT 0–5)
 Functional Independence Measure (FIM)

Physiotherapy Example

Grading spasticity using the Modified Ashworth Scale.

2. Quantitative (Numerical) Data

Data expressed as numbers.

A. Discrete Data

Whole numbers.

Examples:

 Number of falls
 Number of therapy sessions
 Number of injuries

B. Continuous Data

Can take any value within a range.

Examples:

 Height
 Weight
 Blood pressure
 Range of motion
 Walking speed

Physiotherapy Example

Measuring knee flexion from 90° to 130° using a goniometer

Levels of Measurement

Scale Characteristics Example


Nomina Categories only Gender, Injury type
l
Ordinal Ranked categories Pain severity, MMT grades
Interval Equal intervals, no true zero Temperature (°C)
Ratio Equal intervals with true zero Height, Weight, ROM, Time

Descriptive Statistics

Descriptive statistics summarize and present data in a meaningful way.

Measures of Central Tendency

Mean

Average value.

Formula

Mean = Sum of observations ÷ Number of observations

Example

Pain scores:

6, 5, 7, 8, 4

Mean = 6

Median

Middle value after arranging data in order.

Example:

2, 4, 5, 7, 9

Median = 5

Useful for skewed data.

Mode

Most frequently occurring value.

Example:

5, 5, 6, 7, 8

Mode = 5
Measures of Dispersion

These describe how spread out the data are.

Range

Difference between highest and lowest values.

Example:

Highest = 90°

Lowest = 40°

Range = 50°

Variance

Measures the average squared deviation from the mean.

Higher variance indicates greater variability.

Standard Deviation (SD)

The most common measure of variability.

Interpretation

Small SD → Data clustered closely around the mean.

Large SD → Data widely scattered.

Physiotherapy Example

Quadriceps strength

Group A

Mean = 45 kg

SD = 2 kg

Group B

Mean = 45 kg

SD = 10 kg

Group A has more consistent strength measurements.


Data Presentation

Tables

Useful for organizing numerical information.

Example:

Patient Pain Score (VAS)


1 8
2 6
3 5

Graphs

Bar Chart

Used for categorical data.

Example:

Number of patients with different shoulder injuries.

Histogram

Shows frequency distribution of continuous data.

Example:

Distribution of walking speed among stroke patients.

Pie Chart

Shows proportions or percentages.

Example:

Types of sports injuries in a clinic.

Line Graph

Shows changes over time.

Example:

Pain reduction over six weeks of rehabilitation.

Scatter Plot
Displays the relationship between two continuous variables.

Example:

Relationship between BMI and knee pain severity.

Probability

Probability is the likelihood that an event will occur.

Values range from:

 0 = Impossible
 1 = Certain

Physiotherapy Example

The probability of an athlete sustaining a hamstring injury during a season can be estimated
using injury surveillance data.

Sampling

Sampling is the process of selecting participants from a larger population.

Types of Sampling

Probability Sampling

 Simple random sampling


 Systematic sampling
 Stratified sampling
 Cluster sampling

Non-Probability Sampling

 Convenience sampling
 Purposive sampling
 Quota sampling
 Snowball sampling

Physiotherapy Example

Randomly selecting 100 patients with knee osteoarthritis from a hospital database for a
clinical trial.

Hypothesis
A hypothesis is a testable statement about a relationship or difference.

Null Hypothesis (H₀)

States that there is no difference or no association.

Example:

"There is no difference in pain reduction between exercise therapy and electrotherapy."

Alternative Hypothesis (H₁)

States that a difference or association exists.

Example:

"Exercise therapy reduces pain more than electrotherapy."

Errors in Hypothesis Testing

Type I Error (α)

Rejecting a true null hypothesis (False Positive).

Example:

Concluding that a new physiotherapy intervention is effective when it is not.

Type II Error (β)

Failing to reject a false null hypothesis (False Negative).

Example:

Concluding that exercise therapy has no benefit when it actually improves outcomes.

Significance Level (p-value)

The p-value indicates the probability that the observed results occurred by chance.

Interpretation

 p < 0.05 → Statistically significant.


 p ≥ 0.05 → Not statistically significant.

Physiotherapy Example
An RCT comparing two rehabilitation programs reports p = 0.01, indicating that the
difference in outcomes is unlikely to be due to chance.

Confidence Interval (CI)

A confidence interval estimates the range within which the true value is likely to lie.

Example

Mean pain reduction = 3.5 points

95% CI = 2.8 to 4.2

A narrow confidence interval indicates greater precision.

Inferential Statistics

Inferential statistics allow researchers to draw conclusions about a population based on


sample data.

Common uses include:

 Comparing treatment groups.


 Identifying relationships.
 Making predictions.
 Testing hypotheses.

Common Statistical Tests

Parametric Tests

Used when data are normally distributed.

Statistical Test Purpose Physiotherapy Example


Independent t- Compare two independent BFRT vs conventional exercise after
test groups ACL reconstruction
Paired t-test Compare the same group Pain before and after manual therapy
before and after treatment
One-way Compare three or more groups Compare aquatic therapy, cycling, and
ANOVA strengthening exercises
Pearson Assess relationship between Relationship between quadriceps
Correlation continuous variables strength and hop distance

Non-Parametric Tests
Used when data are not normally distributed or are ordinal.

Statistical Test Purpose Physiotherapy Example


Mann–Whitney U Compare two independent Compare pain scores between two
Test groups treatment groups
Wilcoxon Signed- Compare paired Compare pre- and post-treatment pain
Rank Test observations scores
Kruskal–Wallis Compare three or more Compare disability scores across
Test independent groups three rehabilitation methods
Spearman Assess relationship between Relationship between pain severity
Correlation ranked variables and disability score

Correlation

Correlation measures the strength and direction of the relationship between two variables.

Correlation Coefficient (r) Interpretation


+1 Perfect positive correlation
+0.75 Strong positive correlation
+0.50 Moderate positive correlation
0 No correlation
–0.50 Moderate negative correlation
–1 Perfect negative correlation

Physiotherapy Example

A positive correlation between quadriceps strength and single-leg hop distance after ACL
reconstruction indicates that stronger muscles are associated with better functional
performance.

Regression Analysis

Regression predicts the value of one variable based on another.

Physiotherapy Example

Predicting walking speed in stroke patients using lower-limb muscle strength and balance
scores.

Sensitivity and Specificity

These are used to evaluate diagnostic tests.

 Sensitivity: Ability of a test to correctly identify patients with the condition (true
positives).
 Specificity: Ability of a test to correctly identify patients without the condition (true
negatives).
Physiotherapy Example

Assessing the accuracy of the Lachman Test for diagnosing ACL injuries.

Role of Biostatistics in Evidence-Based Physiotherapy

Biostatistics enables physiotherapists to:

 Critically appraise research.


 Interpret clinical trial results.
 Compare treatment effectiveness.
 Develop evidence-based treatment plans.
 Conduct systematic reviews and meta-analyses.
 Improve patient outcomes through data-driven decision-making.

Advantages of Biostatistics

 Supports scientific decision-making.


 Improves research quality.
 Enhances interpretation of clinical data.
 Helps identify effective interventions.
 Reduces bias.
 Facilitates evidence-based practice.
 Assists in healthcare planning and policy development.

Limitations of Biostatistics

 Requires appropriate study design and data collection.


 Incorrect statistical methods can produce misleading results.
 Statistical significance does not always imply clinical significance.
 Results depend on sample size and data quality.
 Interpretation requires statistical knowledge.

Clinical Case Example

Research Question: Does Blood Flow Restriction Training (BFRT) improve quadriceps
strength after ACL reconstruction compared with conventional strengthening?

Study Design: Randomized Controlled Trial

Participants: 80 post-ACL reconstruction patients.

Outcome Measures:

 Quadriceps strength (Hand-held Dynamometer)


 IKDC score
 Single-leg hop distance
Statistical Analysis:

 Independent t-test for between-group comparisons.


 Paired t-test for within-group changes.
 Significance level: p < 0.05.
 95% confidence intervals reported.

Results:

 BFRT group demonstrated significantly greater strength gains (p = 0.003) and higher
IKDC scores than the conventional exercise group.

Conclusion:

Biostatistical analysis supports the effectiveness of BFRT as part of ACL rehabilitation.

THE CRITICAL REVIEW OF RESEARCH USING QUALITATIVE METHODS


Introduction

Evidence-Based Physiotherapy (EBP) integrates the best available research evidence,


clinical expertise, and patient values. While quantitative research answers questions such as
"Does a treatment work?", qualitative research explores "How do patients experience
illness, rehabilitation, and healthcare?"

A critical review (critical appraisal) of qualitative research is the systematic evaluation of a


study's trustworthiness, methodological rigor, credibility, relevance, and applicability to
clinical practice. It helps physiotherapists determine whether qualitative findings can improve
patient-centered care and rehabilitation outcomes.

Definition

A critical review of qualitative research is the systematic process of evaluating the quality,
credibility, trustworthiness, relevance, and applicability of qualitative studies before applying
their findings to clinical practice.

Objectives of Critical Review

The objectives are to:

 Determine the quality of qualitative research.


 Assess the credibility of study findings.
 Identify strengths and limitations.
 Evaluate methodological rigor.
 Assess whether findings are transferable to clinical practice.
 Improve evidence-based decision-making.
 Promote patient-centered physiotherapy.

Importance in Physiotherapy

Critical appraisal of qualitative research helps physiotherapists:

 Understand patients' experiences of pain and disability.


 Identify barriers to rehabilitation.
 Improve communication with patients.
 Enhance patient satisfaction.
 Develop individualized treatment plans.
 Improve adherence to exercise programs.
 Support holistic rehabilitation.

What is Qualitative Research?

Qualitative research focuses on understanding:


 Experiences
 Beliefs
 Feelings
 Perceptions
 Behaviors
 Social interactions

Rather than using numbers, it collects non-numerical data through interviews, focus groups,
observations, diaries, and document analysis.

Examples of Qualitative Research Questions

 How do stroke survivors experience physiotherapy rehabilitation?


 What challenges do athletes face during return-to-sport after ACL reconstruction?
 How do patients perceive chronic low back pain?
 What motivates older adults to continue home exercise programs?

Characteristics of Qualitative Research

 Explores human experiences.


 Uses open-ended questions.
 Small sample sizes.
 Flexible research design.
 Data collected in natural settings.
 Emphasizes participants' perspectives.
 Produces rich, descriptive findings.

Common Qualitative Research Designs

Design Purpose Physiotherapy Example


Phenomenology Explores lived Experiences of patients recovering from
experiences stroke
Grounded Theory Develops theories How athletes regain confidence after ACL
injury
Ethnography Studies cultures and Rehabilitation practices within elite sports
behaviors teams
Case Study In-depth investigation of Rehabilitation journey of a patient with
a case spinal cord injury
Narrative Explores personal stories Life experiences of a patient with chronic
Research pain

Why Critically Review Qualitative Research?

Not all qualitative studies are equally trustworthy. Critical review helps determine:
 Was the study well designed?
 Were appropriate participants selected?
 Was data collected rigorously?
 Were findings supported by evidence?
 Can the findings be applied to physiotherapy practice?

Components of Critical Review

1. Research Question

The research question should be:

 Clearly stated.
 Focused.
 Relevant.
 Appropriate for qualitative research.

Physiotherapy Example

Research Question:

"What are the experiences of football players returning to sport after ACL reconstruction?"

This question explores experiences rather than treatment effectiveness.

2. Research Design

The chosen qualitative design should match the research question.

Example

If the aim is to understand patients' lived experiences, phenomenology is appropriate.

Physiotherapy Example

To explore how stroke survivors adapt to daily activities after rehabilitation, a


phenomenological study is suitable.

3. Sampling

Qualitative studies usually use purposive sampling, selecting participants who have direct
experience of the phenomenon.

Types of Sampling

 Purposive sampling
 Snowball sampling
 Convenience sampling
 Theoretical sampling

Physiotherapy Example

Researchers recruit 15 athletes who have successfully returned to sport after ACL
reconstruction to explore their rehabilitation experiences.

4. Sample Size

Qualitative studies generally include fewer participants than quantitative studies.

Typical sample sizes:

 Interviews: 10–30 participants.


 Focus groups: 6–12 participants per group.

The emphasis is on data saturation, the point at which no new themes emerge.

Physiotherapy Example

Researchers interview patients with chronic low back pain until no new experiences or ideas
are identified.

5. Data Collection Methods

Common methods include:

Interviews

 Structured
 Semi-structured
 Unstructured

Physiotherapy Example

Interviewing stroke patients about challenges encountered during gait rehabilitation.

Focus Groups

Small groups discuss common experiences.

Example

A group of athletes discusses barriers to completing rehabilitation exercises.

Observation

Researchers observe behaviors without interfering.


Example

Observing balance training sessions in older adults.

Document Analysis

Reviewing diaries, medical records, or rehabilitation journals.

6. Data Analysis

Qualitative data are analyzed by identifying patterns and themes.

Common methods include:

 Thematic Analysis
 Content Analysis
 Framework Analysis
 Grounded Theory Analysis

Physiotherapy Example

Researchers identify recurring themes among patients with chronic neck pain:

 Fear of movement.
 Difficulty returning to work.
 Anxiety about pain recurrence.
 Importance of therapist support.

7. Trustworthiness of Qualitative Research

Trustworthiness replaces the concepts of validity and reliability used in quantitative research.

It consists of four components:

A. Credibility

Equivalent to internal validity.

Questions:

 Are the findings believable?


 Were participants accurately represented?

Methods to improve credibility:

 Member checking.
 Prolonged engagement.
 Triangulation.
Physiotherapy Example

Stroke patients review interview transcripts to confirm that their experiences have been
accurately interpreted

B. Transferability

Equivalent to external validity.

Questions:

 Can findings be applied to similar settings?

Researchers should provide detailed descriptions of participants and settings.

Physiotherapy Example

Findings from patients undergoing knee replacement rehabilitation may be transferable to


similar orthopedic rehabilitation settings.

C. Dependability

Equivalent to reliability.

Questions:

 Would similar findings be obtained if the study were repeated?

Researchers maintain an audit trail documenting all methodological decisions.

D. Confirmability

Equivalent to objectivity.

Questions:

 Are findings based on participants' experiences rather than researcher bias?

Researchers should document personal assumptions and use participant quotations to support
interpretations.

Reflexivity

Researchers acknowledge how their own beliefs, experiences, and professional backgrounds
may influence the research process.

Physiotherapy Example
A sports physiotherapist studying ACL rehabilitation acknowledges that previous clinical
experience could influence interpretation of interview data and actively reflects on this during
analysis.

Triangulation

Triangulation improves study credibility by using multiple sources.

Types include:

 Data triangulation.
 Investigator triangulation.
 Method triangulation.
 Theory triangulation.

Physiotherapy Example

Researchers combine:

 Patient interviews.
 Physiotherapist interviews.
 Clinical observations.

to obtain a comprehensive understanding of stroke rehabilitation experiences.

Ethical Considerations

Researchers should ensure:

 Ethical approval.
 Informed consent.
 Confidentiality.
 Voluntary participation.
 Right to withdraw.
 Protection of participant privacy.

Reporting of Results

Good qualitative studies include:

 Major themes.
 Supporting participant quotations.
 Interpretation of findings.
 Comparison with existing literature.
 Clinical implications.

Physiotherapy Example
Theme: Fear of Reinjury

"Even after my knee became strong, I was afraid to sprint because I thought I would tear my
ACL again."

This quotation supports the theme and highlights the psychological aspects of rehabilitation.

CASP (Critical Appraisal Skills Programme) Checklist for Qualitative Research

The CASP Qualitative Checklist is commonly used to critically appraise qualitative studies.

It includes 10 questions:

1. Was there a clear statement of the research aims?


2. Was a qualitative methodology appropriate?
3. Was the research design suitable?
4. Was the recruitment strategy appropriate?
5. Were data collected appropriately?
6. Was the relationship between researcher and participants considered?
7. Were ethical issues addressed?
8. Was data analysis sufficiently rigorous?
9. Are the findings clearly presented?
10. How valuable is the research?

Physiotherapy Example of Critical Review

Research Topic

Experiences of Patients Following ACL Reconstruction During Return to Sport

Appraisal

Research Question

✔ Clearly defined

Design

✔ Phenomenological study appropriate.

Sampling

✔ Purposive sampling of 20 athletes.

Data Collection

✔ Semi-structured interviews.
Data Analysis

✔ Thematic analysis with independent coding by two researchers.

Credibility

✔ Member checking completed.

Transferability

✔ Participant characteristics clearly described.

Dependability

✔ Audit trail maintained.

Confirmability

✔ Researcher reflexivity reported.

Clinical Application

The study emphasizes that psychological readiness is an important component of return-to-


sport decision-making. Physiotherapists should therefore assess confidence, fear of reinjury,
and self-efficacy in addition to physical recovery.

Strengths of Qualitative Research

 Provides rich and detailed information.


 Explores patient perspectives.
 Supports patient-centered care.
 Identifies barriers to rehabilitation.
 Improves communication.
 Generates new hypotheses.
 Complements quantitative research.

Limitations of Qualitative Research

 Small sample sizes.


 Findings are not always generalizable.
 Potential researcher bias.
 Time-consuming data collection and analysis.
 Interpretation may vary among researchers.
Comparison of Quantitative and Qualitative Research

Feature Quantitative Research Qualitative Research


Purpose Measure effectiveness and Explore experiences and meanings
relationships
Data Numerical Textual, verbal, observational
Sample Size Large Small
Analysis Statistical tests Thematic/content analysis
Outcome Numbers and statistical Themes and participant perspectives
significance
Physiotherapy Does strengthening How do patients experience
Example reduce knee pain? rehabilitation after knee replacement?

Application in Evidence-Based Physiotherapy

Qualitative evidence helps physiotherapists to:

 Understand patient expectations.


 Improve therapeutic communication.
 Address psychosocial barriers.
 Enhance adherence to rehabilitation.
 Develop individualized rehabilitation programs.
 Deliver holistic, patient-centered care.

SYSTEMATICALLY REVIEWING THE EVIDENCE


Introduction

In Evidence-Based Physiotherapy (EBP), clinicians often encounter numerous research


studies on the same clinical question, with some studies reporting different or even
conflicting results. A Systematic Review is a scientific method of identifying, evaluating,
and synthesizing all relevant research on a specific question using a predefined and
transparent methodology. Unlike traditional narrative reviews, systematic reviews minimize
bias through a rigorous and reproducible process.

Systematic reviews are considered one of the highest levels of evidence because they
summarize the best available research, helping physiotherapists make informed clinical
decisions and develop evidence-based rehabilitation programs.

Definition

A Systematic Review is a structured, comprehensive, and transparent review of all relevant


research studies addressing a clearly defined clinical question using explicit methods to
identify, appraise, and synthesize the available evidence.

Objectives of a Systematic Review

A systematic review aims to:

 Summarize all available evidence on a clinical question.


 Minimize bias in literature review.
 Assess the quality of included studies.
 Provide reliable recommendations for clinical practice.
 Identify gaps in current knowledge.
 Support evidence-based decision-making.
 Guide healthcare policy and clinical guidelines.

Importance of Systematic Reviews in Physiotherapy

Systematic reviews help physiotherapists to:

 Select the most effective treatment interventions.


 Compare different rehabilitation techniques.
 Develop evidence-based treatment protocols.
 Improve patient safety and clinical outcomes.
 Reduce unnecessary or ineffective treatments.
 Support teaching, research, and policy development.

Characteristics of a Good Systematic Review

A high-quality systematic review should:


 Address a clearly defined clinical question.
 Follow a predefined protocol.
 Use a comprehensive literature search.
 Apply explicit inclusion and exclusion criteria.
 Critically appraise study quality.
 Synthesize findings objectively.
 Report methods transparently.
 Update findings when new evidence becomes available.

Stages of a Systematic Review

A systematic review follows a series of well-defined stages.

Stage 1: Identify the Research Problem

The first step is to identify an important clinical problem requiring evidence.

Researchers determine:

 What clinical issue needs investigation?


 Why is the review necessary?
 What uncertainty exists in current practice?

Physiotherapy Example

Many rehabilitation techniques are available after Anterior Cruciate Ligament (ACL)
reconstruction, but it is unclear whether Blood Flow Restriction Training (BFRT)
improves recovery more than conventional strengthening.

Clinical Problem:

"Is BFRT more effective than conventional strengthening after ACL reconstruction?"

Stage 2: Formulate the Review Question

A clear and focused research question is developed, usually using the PICO framework.

PICO Framework

Component Descriptio Example


n
P Population Patients after ACL reconstruction
I Intervention Blood Flow Restriction Training
C Comparison Conventional strengthening exercises
O Outcome Quadriceps strength, function, return to sport

Physiotherapy Example

Research Question:

"Does Blood Flow Restriction Training improve quadriceps strength compared with
conventional strengthening after ACL reconstruction?"

Stage 3: Develop a Review Protocol

A protocol is prepared before starting the review to ensure transparency and reduce bias.

The protocol includes:

 Research question.
 Objectives.
 Eligibility criteria.
 Search strategy.
 Databases to be searched.
 Outcome measures.
 Methods of quality assessment.
 Data extraction procedures.
 Statistical analysis plan.

Protocols are commonly registered in PROSPERO before the review begins.

Physiotherapy Example

Researchers specify that only randomized controlled trials involving adults after ACL
reconstruction will be included.

Stage 4: Literature Search

A comprehensive search is conducted to identify all relevant studies.

Common databases include:

 PubMed/MEDLINE
 Cochrane Library
 PEDro (Physiotherapy Evidence Database)
 CINAHL
 Scopus
 Web of Science
 Embase
 Google Scholar

Researchers use keywords, Boolean operators (AND, OR, NOT), and Medical Subject
Headings (MeSH).

Example Search Strategy

ACL reconstruction AND


Blood Flow Restriction Training AND
Physiotherapy OR Rehabilitation

Physiotherapy Example

Researchers search PubMed, PEDro, and Cochrane Library to identify studies on BFRT
following ACL reconstruction.

Stage 5: Screening of Studies

The search may identify hundreds or thousands of studies.

Researchers remove:

 Duplicate articles.
 Irrelevant titles.
 Studies unrelated to the research question.

Screening occurs in two stages:

A. Title and Abstract Screening

Irrelevant studies are excluded.

B. Full-Text Screening

Remaining studies are reviewed in detail to determine eligibility.

Physiotherapy Example

Initial search:

1,250 studies

After removing duplicates:

980 studies


Title screening:

220 studies

Full-text review:

40 studies

Eligible studies:

15 Randomized Controlled Trials

Stage 6: Apply Inclusion and Exclusion Criteria

Researchers define clear criteria before selecting studies.

Inclusion Criteria

Examples:

 Adults aged 18 years or older.


 ACL reconstruction patients.
 Randomized Controlled Trials.
 English-language publications.
 Studies measuring quadriceps strength.

Exclusion Criteria

Examples:

 Animal studies.
 Pediatric populations.
 Case reports.
 Conference abstracts.
 Non-English articles.

Physiotherapy Example

A study evaluating BFRT in healthy athletes without ACL injury would be excluded.

Stage 7: Assess the Quality of Studies (Critical Appraisal)


Each included study is critically evaluated for methodological quality and risk of bias.

Common appraisal tools include:

 PEDro Scale (Physiotherapy)


 Cochrane Risk of Bias Tool
 CASP Checklist
 Newcastle–Ottawa Scale

Researchers assess:

 Randomization.
 Blinding.
 Allocation concealment.
 Follow-up.
 Statistical analysis.
 Outcome measures.

Physiotherapy Example

Each RCT on BFRT is assessed using the PEDro Scale.

Studies scoring 8–10 are considered high quality.

Stage 8: Data Extraction

Researchers systematically collect relevant information from each study.

Typical information includes:

 Author.
 Year of publication.
 Country.
 Study design.
 Sample size.
 Participant characteristics.
 Intervention.
 Comparison group.
 Outcome measures.
 Results.

Example Data Extraction Table

Author Sample Size Intervention Outcome


Smith et 60 BFRT Improved quadriceps strength
al.
Lee et al. 45 Conventional exercise Moderate improvement

Physiotherapy Example
Researchers record:

 IKDC scores.
 Quadriceps strength.
 Return-to-sport rates.
 Pain scores.
 Functional outcomes.

Stage 9: Data Synthesis

After extracting data, findings from all included studies are combined.

There are two methods:

A. Narrative Synthesis

Results are summarized descriptively.

Used when studies differ considerably in:

 Participants.
 Interventions.
 Outcomes.

Example

Five studies reported improved pain after exercise therapy, while three reported no significant
difference.

B. Quantitative Synthesis (Meta-analysis)

If studies are sufficiently similar, statistical methods combine results into one overall estimate
of treatment effect.

Physiotherapy Example

Ten RCTs comparing BFRT with conventional exercise are statistically combined to
determine overall effectiveness.

Stage 10: Interpret Results

Researchers interpret:

 Strength of evidence.
 Consistency of findings.
 Clinical significance.
 Statistical significance.
 Limitations.
 Applicability to practice.
Physiotherapy Example

Most studies report improved quadriceps strength with BFRT, but evidence for faster return
to sport is less consistent.

Stage 11: Draw Conclusions

Researchers summarize:

 Main findings.
 Clinical implications.
 Recommendations for practice.
 Recommendations for future research.

Physiotherapy Example

Conclusion:

Current evidence suggests that BFRT improves quadriceps strength after ACL reconstruction
and can be considered an effective adjunct to rehabilitation when appropriately supervised.

Stage 12: Report the Review

The review is written according to international reporting guidelines.

The preferred guideline is:

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses)

PRISMA ensures complete and transparent reporting.

PRISMA Flow Diagram

The PRISMA flowchart shows the number of studies at each stage of the review.

Identification


Database Search


Remove Duplicates


Title & Abstract Screening


Full-Text Assessment


Studies Included in Review

Flowchart of the Systematic Review Process

Clinical Problem


Develop Research Question (PICO)


Prepare Protocol


Literature Search


Screen Studies


Apply Eligibility Criteria


Critical Appraisal


Data Extraction


Data Synthesis


Interpret Results


Draw Conclusions


Publish Review

Physiotherapy Example

Clinical Question

Does exercise therapy improve pain in patients with knee osteoarthritis?

Stage 1
Develop PICO question.

Stage 2

Search PubMed, PEDro, Cochrane Library.

Stage 3

Retrieve 1,500 studies.

Stage 4

Remove duplicates.

Stage 5

Screen titles and abstracts.

Stage 6

Assess 30 full-text articles.

Stage 7

Include 18 high-quality RCTs.

Stage 8

Assess quality using PEDro Scale.

Stage 9

Perform meta-analysis.

Stage 10

Conclude that strengthening exercises significantly reduce pain and improve function.

Advantages of Systematic Reviews


 Highest level of evidence.
 Comprehensive and transparent.
 Reduces bias.
 Summarizes multiple studies.
 Supports evidence-based clinical practice.
 Improves treatment recommendations.
 Identifies research gaps.
 Guides healthcare policy and clinical guidelines.

Limitations of Systematic Reviews

 Time-consuming and resource-intensive.


 Quality depends on the included studies.
 Publication bias may influence findings.
 Heterogeneity among studies may limit comparisons.
 Rapidly evolving evidence may make reviews outdated.

Role in Evidence-Based Physiotherapy

Systematic reviews help physiotherapists:

 Choose the most effective interventions.


 Compare rehabilitation protocols.
 Develop clinical practice guidelines.
 Improve patient outcomes.
 Support continuing professional development.
 Promote consistent, evidence-based care.

META-ANALYSIS
Introduction

In Evidence-Based Physiotherapy (EBP), clinicians often find multiple research studies


investigating the same intervention. Individual studies may produce different or conflicting
results because of variations in sample size, methodology, or patient characteristics. Meta-
analysis is a statistical technique that combines the results of several independent studies
addressing the same research question to provide a single, more precise estimate of the
treatment effect.

Meta-analysis is usually conducted as part of a systematic review and is considered one of


the highest levels of evidence for clinical decision-making.

Definition

Meta-analysis is a statistical method that combines the quantitative results of multiple


independent studies addressing the same research question to calculate an overall estimate of
the intervention's effect.

Objectives of Meta-analysis

Meta-analysis aims to:

 Combine findings from multiple studies.


 Increase statistical power by enlarging the effective sample size.
 Provide a more precise estimate of treatment effects.
 Resolve inconsistencies among study findings.
 Identify factors that influence treatment outcomes.
 Support evidence-based clinical practice.
 Inform clinical guidelines and healthcare policy.

Importance of Meta-analysis in Physiotherapy

Meta-analysis helps physiotherapists to:

 Select the most effective rehabilitation interventions.


 Compare different physiotherapy techniques.
 Improve confidence in treatment recommendations.
 Develop evidence-based clinical practice guidelines.
 Reduce uncertainty in clinical decision-making.
 Improve patient outcomes through stronger evidence.

Relationship Between Systematic Review and Meta-analysis


Although often used together, they are different.

Systematic Review Meta-analysis


Comprehensive review of all relevant studies Statistical combination of study results
May or may not include statistical analysis Always includes statistical analysis
Focuses on identifying and critically appraising Focuses on calculating an overall effect
studies size
Can include qualitative synthesis Provides quantitative synthesis

Important: Every meta-analysis is based on a systematic review, but not every systematic
review includes a meta-analysis. A meta-analysis can only be performed when the included
studies are sufficiently similar in terms of participants, interventions, and outcomes.

Characteristics of a Good Meta-analysis

A high-quality meta-analysis should:

 Be based on a well-conducted systematic review.


 Include a clearly defined research question.
 Use explicit inclusion and exclusion criteria.
 Include high-quality studies.
 Assess the risk of bias.
 Evaluate heterogeneity among studies.
 Use appropriate statistical methods.
 Report results transparently.

Steps in Conducting a Meta-analysis

Step 1: Formulate the Research Question

A focused clinical question is developed using the PICO framework.

Physiotherapy Example

Population: Patients with knee osteoarthritis

Intervention: Strengthening exercises

Comparison: Conventional care

Outcome: Pain reduction and improved function

Research Question:
"Do strengthening exercises reduce pain more effectively than conventional care in patients
with knee osteoarthritis?"

Step 2: Conduct a Systematic Literature Search

Researchers search databases such as:

 PubMed/MEDLINE
 Cochrane Library
 PEDro
 CINAHL
 Scopus
 Embase

All relevant studies are identified using predefined search strategies.

Step 3: Select Eligible Studies

Studies are screened according to predefined eligibility criteria.

Inclusion Criteria

 Randomized Controlled Trials (RCTs).


 Adult patients.
 Similar interventions.
 Common outcome measures.

Exclusion Criteria

 Case reports.
 Animal studies.
 Conference abstracts.
 Studies with insufficient data.

Physiotherapy Example

Only RCTs comparing Blood Flow Restriction Training (BFRT) with conventional
strengthening after ACL reconstruction are included.

Step 4: Assess Study Quality

Researchers critically appraise each study using tools such as:

 PEDro Scale.
 Cochrane Risk of Bias Tool.
 CASP Checklist.

Studies with poor methodological quality may be excluded or analyzed separately.

Step 5: Extract Data


Important information collected includes:

 Author.
 Publication year.
 Sample size.
 Participant characteristics.
 Intervention.
 Comparison group.
 Outcome measures.
 Statistical results.

Example

Study Sample Size Intervention Outcome


Smith et al. 60 BFRT Quadriceps strength ↑
Lee et al. 48 Conventional exercise Moderate improvement
Kumar et al. 72 BFRT Functional score ↑

Step 6: Calculate Effect Size

The effect size measures the magnitude of the treatment effect across studies.

Common effect size measures include:

 Mean Difference (MD)


 Standardized Mean Difference (SMD)
 Risk Ratio (RR)
 Odds Ratio (OR)

Physiotherapy Example

Five studies evaluating exercise therapy for chronic low back pain report different pain
scales. Researchers use the Standardized Mean Difference (SMD) to combine results into
one overall estimate.

Step 7: Assess Heterogeneity

Heterogeneity refers to differences among the included studies.

Differences may arise from:

 Patient characteristics.
 Treatment protocols.
 Outcome measures.
 Study quality.

Statistical Tests
 Chi-square (Q test)
 I² statistic

Interpretation of I²

I² Value Interpretation
0–25% Low heterogeneity
26–50% Moderate heterogeneity
51–75% Substantial heterogeneity
>75% Considerable heterogeneity

Physiotherapy Example

Ten studies investigating exercise therapy for knee osteoarthritis show I² = 18%, indicating
low heterogeneity and allowing confident pooling of results.

Fixed-Effect Model

Definition

Assumes all included studies estimate the same true treatment effect.

Appropriate When

 Studies are very similar.


 Heterogeneity is low.

Advantages

 Greater statistical precision.

Limitations

 Not suitable when studies differ substantially.

Random-Effects Model

Definition

Assumes the true treatment effect varies between studies.

Appropriate When

 Moderate or high heterogeneity exists.

Advantages

 More realistic for clinical research.

Limitations
 Wider confidence intervals.

Physiotherapy Example

Studies evaluating balance training after stroke differ in patient severity and treatment
duration. A random-effects model is chosen to account for these variations.

Step 8: Perform Statistical Analysis

Specialized software is commonly used:

 RevMan (Review Manager)


 Comprehensive Meta-Analysis (CMA)
 Stata
 R
 SPSS (limited applications)

The software combines results and generates graphical displays.

Forest Plot

A Forest Plot is the most common graphical presentation of a meta-analysis.

It shows:

 Results of each individual study.


 Confidence intervals.
 Overall combined treatment effect.

Components of a Forest Plot

 Squares represent individual study estimates.


 Horizontal lines represent 95% confidence intervals.
 The size of the square reflects the study's weight.
 A diamond at the bottom represents the pooled effect estimate.
 The vertical line indicates "no effect."

Interpretation

 If the diamond does not cross the line of no effect, the overall result is statistically
significant.
 If it crosses the line, the result is not statistically significant.

Physiotherapy Example
A forest plot of 12 RCTs shows that exercise therapy significantly reduces pain in patients
with knee osteoarthritis. The pooled effect estimate lies entirely on the side favoring exercise.

Funnel Plot

A Funnel Plot assesses publication bias.

Interpretation

 Symmetrical funnel → Low publication bias.


 Asymmetrical funnel → Possible publication bias.

Physiotherapy Example

Studies on dry needling for neck pain show an asymmetrical funnel plot, suggesting that
small studies with negative results may not have been published.

Publication Bias

Publication bias occurs when studies with positive findings are more likely to be published
than studies with negative or non-significant findings.

Consequences

 Overestimation of treatment effectiveness.


 Misleading clinical recommendations.

Sensitivity Analysis

Researchers repeat the analysis after removing certain studies to determine whether the
results remain consistent.

Physiotherapy Example

Removing one low-quality trial from a meta-analysis of exercise therapy for chronic low
back pain does not change the overall conclusion, increasing confidence in the findings.

Subgroup Analysis

Subgroup analysis examines whether treatment effects differ between specific groups.

Physiotherapy Example

A meta-analysis compares exercise therapy outcomes in:

 Younger adults (<60 years).


 Older adults (≥60 years).
Researchers determine whether age influences treatment effectiveness.

Interpreting Meta-analysis Results

Researchers evaluate:

 Overall effect size.


 Confidence intervals.
 p-value.
 Heterogeneity.
 Clinical significance.
 Risk of bias.
 Quality of evidence.

Physiotherapy Example

Clinical Question

Does Blood Flow Restriction Training (BFRT) improve quadriceps strength after ACL
reconstruction?

Studies Included

 15 RCTs.
 Total participants: 1,020.

Results

 Significant increase in quadriceps strength.


 Improved functional outcomes.
 Low heterogeneity (I² = 15%).
 No serious publication bias.

Conclusion

Meta-analysis supports BFRT as an effective adjunct to conventional rehabilitation following


ACL reconstruction.

Advantages of Meta-analysis

 Highest level of quantitative evidence.


 Combines results from multiple studies.
 Increases sample size and statistical power.
 Improves precision of treatment effect estimates.
 Resolves conflicting study findings.
 Supports evidence-based clinical guidelines.
 Helps identify research gaps.

Limitations of Meta-analysis
 Depends on the quality of included studies.
 Publication bias may affect conclusions.
 High heterogeneity may reduce reliability.
 Combining poorly designed studies can produce misleading results.
 Time-consuming and requires statistical expertise.

Meta-analysis vs Systematic Review

Feature Systematic Review Meta-analysis


Purpose Summarizes available evidence Statistically combines study results
Statistical Optional Essential
Analysis
Output Narrative and/or quantitative Overall pooled effect estimate
synthesis
Requirement Comprehensive literature review Requires sufficiently similar studies
Evidence Level High Highest when based on high-quality
studies

Role of Meta-analysis in Evidence-Based Physiotherapy

Meta-analysis is widely used to evaluate:

 Exercise therapy for low back pain.


 Manual therapy for neck pain.
 Blood Flow Restriction Training after ACL reconstruction.
 Balance training after stroke.
 Pulmonary rehabilitation for COPD.
 Exercise programs for knee osteoarthritis.
 Vestibular rehabilitation.
 Sports injury prevention programs.

Clinical Case Example

Research Topic: Effectiveness of Exercise Therapy for Chronic Low Back Pain

Research Question: Does exercise therapy reduce pain more effectively than usual care?

Studies Included: 20 randomized controlled trials.

Participants: 2,350 patients.

Outcome Measures:

 Visual Analogue Scale (VAS)


 Oswestry Disability Index (ODI)
 Quality of Life (SF-36)

Results:

 Significant reduction in pain.


 Improved functional ability.
 Better quality of life.
 Low heterogeneity (I² = 22%).

Clinical Implication: Strong evidence supports exercise therapy as a first-line treatment for
chronic low back pain.

THE COCHRANE COLLABORATION (COCHRANE)


Introduction

Evidence-Based Practice (EBP) requires healthcare professionals to use the best available
scientific evidence when making clinical decisions. However, thousands of research studies
are published every year, making it difficult for clinicians to identify reliable evidence. To
solve this problem, the Cochrane Collaboration, now known simply as Cochrane, was
established to produce high-quality, independent, and up-to-date systematic reviews that help
healthcare professionals make informed decisions.

Cochrane is recognized worldwide as one of the most trusted organizations for producing
systematic reviews and is considered a cornerstone of Evidence-Based Physiotherapy.

Definition

Cochrane is an independent, international, non-profit organization that prepares, maintains,


and promotes high-quality systematic reviews and other synthesized research evidence to
support evidence-based healthcare decision-making.

Historical Background

 Founded: 1993
 Founder: Iain Chalmers and an international group of researchers.
 Named After: Archie Cochrane, a British epidemiologist who strongly advocated
using evidence from well-designed randomized controlled trials to improve
healthcare.

Archie Cochrane's Contribution

Archie Cochrane emphasized that healthcare decisions should be based on scientific


evidence rather than tradition or personal opinion. His ideas laid the foundation for
modern Evidence-Based Medicine (EBM) and Evidence-Based Physiotherapy (EBP).

Vision of Cochrane

"A world of improved health where decisions about health and healthcare are informed
by high-quality, relevant, and up-to-date synthesized research evidence."

Mission of Cochrane

Cochrane aims to:

 Produce high-quality systematic reviews.


 Make healthcare evidence accessible worldwide.
 Support evidence-based healthcare.
 Improve patient outcomes.
 Promote transparency and scientific integrity.
 Encourage international collaboration.
Objectives of Cochrane

The objectives are to:

 Prepare systematic reviews of healthcare interventions.


 Maintain and regularly update reviews.
 Disseminate reliable evidence globally.
 Reduce bias in healthcare research.
 Improve clinical practice guidelines.
 Promote evidence-informed healthcare policies.
 Encourage high-quality research.

Core Principles of Cochrane

Cochrane follows several key principles:

1. Collaboration
2. Avoiding duplication
3. Minimizing bias
4. Scientific rigor
5. Transparency
6. Global participation
7. Independence
8. Continuous updating of evidence

Organizational Structure of Cochrane

Cochrane is a global network consisting of:

 Review Groups
 Geographic Groups
 Methods Groups
 Consumer Network
 Executive Team
 Editorial Board
 Researchers and Volunteers

Researchers from over 100 countries contribute to Cochrane reviews.

Major Components of Cochrane

1. Cochrane Review Groups (CRGs)

These groups prepare and maintain systematic reviews related to specific healthcare
specialties.

Examples include:
 Musculoskeletal Disorders
 Neurology
 Sports Medicine
 Stroke
 Pain Management
 Public Health
 Rehabilitation
 Orthopaedics

Physiotherapy Example

The Musculoskeletal Review Group publishes systematic reviews on:

 Low back pain


 Osteoarthritis
 Neck pain
 Shoulder disorders

These reviews help physiotherapists choose effective rehabilitation interventions.

2. Methods Groups

These groups develop methodologies used in systematic reviews.

Responsibilities include:

 Statistical methods.
 Risk of bias assessment.
 Meta-analysis techniques.
 Diagnostic test reviews.
 Prognostic research.
 Qualitative evidence synthesis.

3. Geographic Groups

These groups promote Cochrane activities within different countries and regions by:

 Conducting workshops.
 Training researchers.
 Supporting systematic reviews.
 Promoting evidence-based healthcare.

4. Consumer Network

Patients, caregivers, and members of the public contribute by:

 Identifying important healthcare questions.


 Reviewing patient-friendly summaries.
 Ensuring research addresses patient priorities.
Cochrane Database of Systematic Reviews (CDSR)

The Cochrane Database of Systematic Reviews (CDSR) is one of the world's most
respected sources of evidence.

It contains:

 Systematic reviews.
 Review protocols.
 Updated evidence syntheses.
 Plain language summaries.

Each review undergoes:

 Peer review.
 Editorial review.
 Regular updates as new evidence becomes available.

What Does a Cochrane Review Include?

A typical Cochrane Review contains:

1. Title
2. Abstract
3. Background
4. Objectives
5. Methods
6. Results
7. Discussion
8. Authors' conclusions
9. Implications for practice
10. Implications for research
11. References

Steps in Conducting a Cochrane Systematic Review

Step 1: Identify the Clinical Question

Researchers formulate a focused clinical question using the PICO framework.

Physiotherapy Example

Population: Stroke patients

Intervention: Balance training

Comparison: Conventional therapy


Outcome: Balance and fall prevention

Step 2: Develop a Review Protocol

Researchers prepare a detailed protocol before beginning the review.

The protocol includes:

 Objectives.
 Search strategy.
 Inclusion criteria.
 Outcome measures.
 Statistical methods.

This reduces bias and improves transparency.

Step 3: Comprehensive Literature Search

Researchers search multiple databases such as:

 PubMed
 MEDLINE
 Embase
 PEDro
 CINAHL
 CENTRAL (Cochrane Central Register of Controlled Trials)

Step 4: Select Eligible Studies

Studies are screened according to predefined inclusion and exclusion criteria.

Step 5: Assess Risk of Bias

Each study is critically appraised using standardized tools.

Common domains include:

 Randomization.
 Allocation concealment.
 Blinding.
 Incomplete outcome data.
 Selective reporting.

Step 6: Extract Data

Researchers collect information on:

 Participants.
 Interventions.
 Outcomes.
 Statistical results.

Step 7: Data Synthesis

Evidence is synthesized through:

 Narrative review.
 Meta-analysis (when appropriate).

Step 8: Interpret Findings

Researchers evaluate:

 Quality of evidence.
 Strength of recommendations.
 Clinical significance.
 Limitations.

Step 9: Publish and Update

Unlike many reviews, Cochrane Reviews are regularly updated when new evidence becomes
available.

Risk of Bias Assessment

Cochrane developed the Risk of Bias (RoB) tool for randomized controlled trials.

The major domains include:

Domain Description
Selection Bias Randomization and allocation concealment
Performance Blinding of participants and personnel
Bias
Detection Bias Blinding of outcome assessors
Attrition Bias Incomplete outcome data
Reporting Bias Selective reporting of outcomes
Other Bias Any additional sources of bias

GRADE System in Cochrane


Many Cochrane Reviews use the GRADE (Grading of Recommendations Assessment,
Development and Evaluation) approach to assess the certainty of evidence.

Quality Meaning
High Very confident in the estimate of effect
Moderate Further research may change confidence
Low Further research is likely to change the estimate
Very Very uncertain about the estimate
Low

Physiotherapy Example

Clinical Question

Does exercise therapy reduce pain in knee osteoarthritis?

Cochrane Review Process

Researchers identify:

 25 Randomized Controlled Trials.


 2,800 participants.

Findings

Exercise therapy:

 Reduces pain.
 Improves physical function.
 Enhances quality of life.
 Has minimal adverse effects.

Clinical Implication

Exercise therapy is recommended as a first-line intervention for knee osteoarthritis.

Applications of Cochrane in Physiotherapy

Cochrane evidence supports physiotherapy in:

Musculoskeletal Physiotherapy

 Low back pain


 Neck pain
 Osteoarthritis
 Shoulder disorders
 Tendinopathies

Sports Physiotherapy
 ACL rehabilitation
 Ankle sprain rehabilitation
 Hamstring injury prevention
 Return-to-sport programs
 Blood Flow Restriction Training (BFRT)

Neurological Physiotherapy

 Stroke rehabilitation
 Parkinson's disease
 Multiple sclerosis
 Spinal cord injury

Cardiopulmonary Physiotherapy

 COPD rehabilitation
 Cardiac rehabilitation
 Pulmonary rehabilitation

Pediatric Physiotherapy

 Cerebral palsy
 Developmental delay
 Neuromuscular disorders

Advantages of Cochrane Reviews

 Highest-quality systematic reviews.


 Transparent and rigorous methodology.
 Comprehensive literature searches.
 Regularly updated evidence.
 Reduces bias.
 Supports clinical guideline development.
 Widely accepted internationally.
 Improves patient care and healthcare policy.

Limitations of Cochrane Reviews

 Time-consuming to produce.
 Dependent on the quality of available studies.
 Some topics have limited high-quality evidence.
 Reviews may become outdated if not updated promptly.
 Access to some resources may require institutional subscriptions.

Role of Cochrane in Evidence-Based Physiotherapy


Cochrane enables physiotherapists to:

 Select evidence-based interventions.


 Compare rehabilitation strategies.
 Develop treatment protocols.
 Improve patient outcomes.
 Critically appraise research.
 Support lifelong professional learning.
 Contribute to evidence-based healthcare policies.

Clinical Case Example

Clinical Question

Does exercise therapy improve chronic low back pain?

Cochrane Review

 32 Randomized Controlled Trials.


 3,500 participants.

Findings

Exercise therapy:

 Significantly reduces pain.


 Improves physical function.
 Enhances quality of life.
 Is more effective than no treatment or usual care.

Physiotherapy Application

A physiotherapist uses this evidence to prescribe individualized strengthening, flexibility, and


aerobic exercise programs for patients with chronic low back pain, while considering patient
preferences and functional goals.

Difference Between Cochrane Review and Traditional Review

Feature Cochrane Review Traditional Review


Methodology Systematic and predefined Often unsystematic
Literature Search Comprehensive May be limited
Study Selection Explicit criteria May be subjective
Risk of Bias Assessment Mandatory Often absent
Data Synthesis Structured, may include meta-analysis Narrative summary
Updating Regularly updated Rarely updated
Reliability Very high Variable

ECONOMIC EVALUATION OF THE EVIDENCE


Introduction

Healthcare resources such as money, equipment, time, and healthcare professionals are
limited. Therefore, healthcare providers must ensure that the available resources are used
efficiently while providing the best possible patient care. Economic evaluation is an
important component of Evidence-Based Physiotherapy (EBP) because it compares the
costs and health outcomes of different interventions to determine which option provides the
greatest value.

Economic evaluation does not only ask whether a treatment works, but also whether the
benefits justify the costs. This information is essential for clinicians, hospital administrators,
insurance companies, and policymakers when making decisions about adopting or funding
healthcare interventions.

Definition

Economic Evaluation is the systematic comparison of two or more healthcare interventions


by examining both their costs (resources used) and consequences (health outcomes) to
determine which intervention provides the best value for money.

Objectives of Economic Evaluation

Economic evaluation aims to:

 Compare the costs and benefits of different interventions.


 Identify the most cost-effective treatment.
 Improve resource allocation.
 Support evidence-based clinical decisions.
 Assist healthcare planning and budgeting.
 Reduce unnecessary healthcare expenditure.
 Improve patient outcomes while controlling costs.

Importance of Economic Evaluation in Physiotherapy

Economic evaluation helps physiotherapists to:

 Choose interventions that provide the best outcomes at reasonable costs.


 Demonstrate the economic value of physiotherapy services.
 Justify rehabilitation programs to hospital administrators and insurers.
 Support policy decisions on healthcare funding.
 Optimize the use of limited healthcare resources.
 Promote efficient, evidence-based patient care.

Basic Concepts in Economic Evaluation


1. Cost

Cost refers to the resources consumed during healthcare delivery.

Types of Costs

A. Direct Costs

Expenses directly related to treatment.

Examples:

 Physiotherapy consultation fees.


 Exercise equipment.
 Electrotherapy devices.
 Hospital charges.
 Medications.

Physiotherapy Example

The cost of supervised exercise sessions for knee osteoarthritis.

B. Indirect Costs

Costs resulting from reduced productivity or loss of income.

Examples:

 Time away from work.


 Transportation expenses.
 Caregiver time.
 Reduced work efficiency.

Physiotherapy Example

An athlete misses six weeks of competition after an ACL injury, resulting in lost income.

C. Intangible Costs

Costs that cannot be easily measured financially.

Examples:

 Pain.
 Emotional distress.
 Anxiety.
 Reduced quality of life.

Physiotherapy Example
A patient with chronic low back pain experiences persistent pain and depression despite
treatment.

2. Consequences (Outcomes)

Consequences are the health benefits produced by an intervention.

Examples:

 Pain reduction.
 Improved range of motion.
 Increased muscle strength.
 Improved walking ability.
 Enhanced quality of life.
 Faster return to work.
 Reduced disability.

Types of Economic Evaluation

There are four major types of full economic evaluation:

1. Cost-Minimization Analysis (CMA)


2. Cost-Effectiveness Analysis (CEA)
3. Cost-Utility Analysis (CUA)
4. Cost-Benefit Analysis (CBA)

1. Cost-Minimization Analysis (CMA)

Definition

Cost-Minimization Analysis compares the costs of two or more interventions that have
already been shown to produce equivalent clinical outcomes. The intervention with the
lowest cost is considered the preferred option.

Key Principle

Equal outcomes → Compare only costs

When is CMA Used?

CMA is appropriate when:

 Clinical effectiveness is identical.


 Safety profiles are similar.
 Outcomes are equivalent.

Physiotherapy Example
A physiotherapist compares:

 Hospital-based supervised exercises.


 Community physiotherapy center exercises.

If both programs produce the same improvement in knee function, the less expensive
program is preferred.

Advantages

 Simple to perform.
 Easy to interpret.
 Useful when interventions have identical outcomes.

Limitations

 Rarely applicable because treatments often differ in outcomes.


 Requires strong evidence that outcomes are truly equivalent.

2. Cost-Effectiveness Analysis (CEA)

Definition

Cost-Effectiveness Analysis compares interventions based on costs and clinical outcomes


measured in natural units.

Examples of natural units:

 Pain reduction.
 Walking distance.
 Life-years gained.
 Number of falls prevented.
 Improvement in ROM.
 Increase in muscle strength.

Formula

Cost-Effectiveness Ratio (CER)

Cost
CER=
Clinical Outcome

Incremental Cost-Effectiveness Ratio (ICER)

When comparing two interventions:

Cost of Intervention A - Cost of Intervention B


ICER=
Effect of Intervention A - Effect of Intervention B

ICER indicates the additional cost required to achieve one additional unit of health benefit.
Physiotherapy Example

Comparing two rehabilitation programs after stroke:

Program Cost Walking


Improvement
Conventional ₹20,00 150 m
Physiotherapy 0
Robotic Gait Training ₹50,00 180 m
0

Robotic therapy improves walking slightly more but at a much higher cost. CEA helps
determine whether the additional benefit justifies the extra expense.

Advantages

 Widely used in healthcare.


 Easy to understand.
 Useful for comparing treatments with the same outcome.

Limitations

 Cannot compare interventions with different outcome measures.


 Does not account for quality of life.

3. Cost-Utility Analysis (CUA)

Definition

Cost-Utility Analysis compares costs with outcomes adjusted for both quantity and quality
of life.

The most common outcome measure is the Quality-Adjusted Life Year (QALY).

Quality-Adjusted Life Year (QALY)

A QALY combines:

 Length of life.
 Quality of life.

Interpretation

 1 QALY = One year of perfect health.


 0 QALY = Death.
 Values between 0 and 1 represent varying levels of health.

Physiotherapy Example
A pulmonary rehabilitation program for patients with COPD improves exercise tolerance and
quality of life. CUA estimates the cost per QALY gained to determine whether the program
provides good value.

Advantages

 Considers both survival and quality of life.


 Allows comparison across different diseases and interventions.
 Frequently used in national health policy decisions.

Limitations

 Measuring quality of life can be subjective.


 QALY calculations require specialized instruments and methods.

4. Cost-Benefit Analysis (CBA)

Definition

Cost-Benefit Analysis compares both costs and benefits in monetary terms.

The intervention is considered worthwhile if the monetary value of the benefits exceeds the
costs.

Formula

Benefit–Cost Ratio

Total Benefits
Benefit−Cost Ratio=
Total Costs

 Ratio > 1 → Benefits exceed costs.


 Ratio = 1 → Costs equal benefits.
 Ratio < 1 → Costs exceed benefits.

Physiotherapy Example

A workplace ergonomics and physiotherapy program costs ₹10,00,000 but reduces employee
absenteeism, saving the company ₹18,00,000.

Benefit–Cost Ratio = 18,00,000 ÷ 10,00,000 = 1.8

Since the ratio is greater than 1, the program is economically beneficial.

Advantages

 Allows comparison of interventions from different sectors.


 Useful for policy and investment decisions.
 Demonstrates financial return on healthcare programs.
Limitations

 Difficult to assign monetary values to health outcomes such as pain relief or improved
quality of life.
 Ethical concerns may arise when valuing health in financial terms.

Comparison of the Four Types of Economic Evaluation

Type Costs Outcomes Measured Example in Physiotherapy


Measured
Cost-Minimization Money Outcomes assumed Hospital vs community
Analysis (CMA) equal exercise program with
identical outcomes
Cost-Effectiveness Money Natural clinical units Conventional vs robotic gait
Analysis (CEA) (pain, ROM, walking training after stroke
distance)
Cost-Utility Money Quality-Adjusted Life Pulmonary rehabilitation for
Analysis (CUA) Years (QALYs) COPD
Cost-Benefit Money Monetary value of Workplace physiotherapy
Analysis (CBA) benefits reducing absenteeism

Full vs Partial Economic Evaluation

Full Economic Evaluation

Compares both costs and outcomes.

Includes:

 CMA
 CEA
 CUA
 CBA

Partial Economic Evaluation

Examines only costs or only outcomes.

Examples:

 Cost description.
 Cost analysis.
 Outcome description.

These do not compare alternative interventions.

Steps in Conducting an Economic Evaluation


1. Define the clinical question.
2. Identify alternative interventions.
3. Determine the perspective of the analysis (patient, hospital, insurer, or society).
4. Measure all relevant costs.
5. Measure health outcomes.
6. Select the appropriate type of economic evaluation.
7. Analyze and compare costs and outcomes.
8. Interpret results.
9. Make recommendations for practice or policy.

Perspective in Economic Evaluation

The perspective determines which costs and benefits are included.

Perspective Costs Considered


Patient Treatment fees, travel expenses, lost wages
Hospital Equipment, salaries, facility costs
Insurance Company Reimbursement and claims
Society All direct, indirect, and intangible costs

Clinical Example

Research Question

Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional


strengthening after ACL reconstruction?

Intervention A

Conventional strengthening.

 Cost: ₹15,000
 IKDC improvement: 20 points.

Intervention B

BFRT.

 Cost: ₹20,000
 IKDC improvement: 28 points.

Economic Evaluation

Although BFRT costs more, it produces greater functional improvement and may allow
patients to return to sport sooner. A Cost-Effectiveness Analysis (CEA) can determine
whether the additional benefit justifies the additional cost.

Applications of Economic Evaluation in Physiotherapy


Economic evaluation is used in:

 Orthopaedic rehabilitation.
 Sports physiotherapy.
 Neurological rehabilitation.
 Cardiac rehabilitation.
 Pulmonary rehabilitation.
 Community-based rehabilitation.
 Fall prevention programs.
 Occupational health and workplace ergonomics.
 Tele-rehabilitation services.
 Chronic pain management.

Advantages of Economic Evaluation

 Supports evidence-based resource allocation.


 Improves efficiency of healthcare spending.
 Demonstrates the value of physiotherapy interventions.
 Guides reimbursement and funding decisions.
 Assists policymakers in developing healthcare programs.
 Encourages cost-conscious clinical practice.

Limitations of Economic Evaluation

 Accurate cost measurement can be challenging.


 Long-term outcomes may be difficult to estimate.
 Quality-of-life measures can be subjective.
 Results may not be generalizable to different healthcare systems or countries.
 Ethical concerns may arise when assigning monetary values to health outcomes.

Role of Economic Evaluation in Evidence-Based Physiotherapy

Economic evaluation enables physiotherapists to:

 Deliver effective care while optimizing healthcare resources.


 Select interventions that provide the best value for money.
 Support funding applications for rehabilitation programs.
 Demonstrate the economic impact of physiotherapy.
 Improve patient outcomes without unnecessary expenditure.
 Contribute to healthcare policy and guideline development.

CONDUCTING ECONOMIC EVALUATION


Introduction

Healthcare systems operate with limited resources, including finances, healthcare


professionals, equipment, and time. Therefore, healthcare providers must ensure that
available resources are used efficiently while maximizing patient outcomes. Economic
evaluation is a systematic method used to compare the costs and consequences (health
outcomes) of two or more healthcare interventions to determine which provides the best
value for money.

In Evidence-Based Physiotherapy (EBP), conducting an economic evaluation helps


physiotherapists determine whether a treatment is not only clinically effective but also
economically worthwhile. It supports decision-making at the level of clinicians, hospitals,
insurance providers, and governments.

Definition

Conducting an Economic Evaluation is the systematic process of identifying, measuring,


comparing, and analyzing the costs and health outcomes of alternative healthcare
interventions to determine which intervention provides the greatest value for available
resources.

Objectives of Conducting an Economic Evaluation

The objectives are to:

 Compare the costs of different interventions.


 Compare the health outcomes of interventions.
 Identify the most cost-effective treatment.
 Improve allocation of healthcare resources.
 Support evidence-based clinical decisions.
 Reduce unnecessary healthcare expenditure.
 Improve patient outcomes while maintaining financial sustainability.

Importance of Economic Evaluation in Physiotherapy

Economic evaluation helps physiotherapists to:

 Demonstrate the value of physiotherapy services.


 Select interventions that provide the greatest benefit at reasonable cost.
 Support funding requests for rehabilitation programs.
 Assist hospital administrators in resource allocation.
 Guide health insurance reimbursement decisions.
 Improve healthcare efficiency.

Principles of Economic Evaluation


A good economic evaluation should:

 Compare at least two interventions.


 Measure both costs and outcomes.
 Use transparent and reproducible methods.
 Consider the perspective of the analysis.
 Use reliable clinical evidence.
 Report results clearly and objectively.

Steps in Conducting an Economic Evaluation

Economic evaluation is conducted through a series of systematic steps.

Step 1: Define the Clinical Problem

The first step is to identify the healthcare problem that requires evaluation.

Questions include:

 What condition is being treated?


 Why is evaluation needed?
 Which interventions are available?

Physiotherapy Example

Clinical problem:

Patients recovering from Anterior Cruciate Ligament (ACL) reconstruction require


rehabilitation.

Question:

"Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional
strengthening?"

Step 2: Define the Study Objective

Researchers clearly state the purpose of the evaluation.

Example

To compare the costs and effectiveness of BFRT and conventional strengthening after ACL
reconstruction.

Step 3: Choose the Perspective


The perspective determines which costs and benefits will be included.

Types of Perspectives

A. Patient Perspective

Includes:

 Treatment fees.
 Travel expenses.
 Time lost from work.
 Personal equipment costs.

B. Hospital Perspective

Includes:

 Staff salaries.
 Equipment.
 Hospital facilities.
 Rehabilitation costs.

C. Insurance Perspective

Includes:

 Reimbursement costs.
 Healthcare claims.
 Cost of treatment coverage.

D. Societal Perspective

The broadest perspective.

Includes:

 Direct costs.
 Indirect costs.
 Productivity losses.
 Caregiver costs.
 Social costs.

Physiotherapy Example

Evaluating community-based stroke rehabilitation from a societal perspective includes


transportation costs, caregiver time, and loss of productivity in addition to physiotherapy
expenses.

Step 4: Identify Alternative Interventions


Economic evaluation compares two or more interventions.

Examples:

 Exercise therapy vs electrotherapy.


 BFRT vs conventional strengthening.
 Robotic gait training vs conventional gait training.
 Telerehabilitation vs hospital-based rehabilitation.

Physiotherapy Example

Comparison:

 Conventional quadriceps strengthening.


 Blood Flow Restriction Training.

Step 5: Identify and Measure Costs

Researchers identify all relevant costs associated with each intervention.

A. Direct Medical Costs

Examples:

 Physiotherapy sessions.
 Hospital admission.
 Exercise equipment.
 Medications.
 Imaging.

B. Direct Non-Medical Costs

Examples:

 Transportation.
 Accommodation.
 Home modifications.

C. Indirect Costs

Examples:

 Loss of wages.
 Reduced productivity.
 Caregiver time.

D. Intangible Costs
Examples:

 Pain.
 Anxiety.
 Emotional distress.
 Reduced quality of life.

Physiotherapy Example

For a stroke rehabilitation program:

Direct medical costs:

 Physiotherapy sessions.
 Walking aids.

Indirect costs:

 Caregiver leave from work.

Step 6: Measure Outcomes

Researchers identify the health outcomes associated with each intervention.

Examples include:

 Pain reduction.
 Functional improvement.
 Muscle strength.
 Range of motion.
 Walking distance.
 Quality of life.
 Return to work.
 Return to sport.

Physiotherapy Example

Outcome measures after ACL rehabilitation:

 IKDC score.
 Single-leg hop distance.
 Quadriceps strength.
 Time to return to sport.

Step 7: Select the Appropriate Type of Economic Evaluation


Researchers choose the appropriate method depending on the clinical question.

Type Outcome Measured


Cost-Minimization Analysis (CMA) Equivalent outcomes
Cost-Effectiveness Analysis (CEA) Natural clinical units
Cost-Utility Analysis (CUA) QALYs
Cost-Benefit Analysis (CBA) Monetary value

Physiotherapy Example

Comparing two exercise programs that produce different improvements in walking distance
would require Cost-Effectiveness Analysis (CEA).

Step 8: Collect Clinical Data

Clinical data may be obtained from:

 Randomized Controlled Trials (RCTs).


 Cohort studies.
 Hospital records.
 Registries.
 Systematic reviews.
 Meta-analyses.

Physiotherapy Example

Researchers use RCT data comparing BFRT and conventional strengthening after ACL
reconstruction.

Step 9: Analyze Costs

Researchers calculate the total cost of each intervention.

Example

Intervention Total Cost


Conventional Physiotherapy ₹18,000
BFRT ₹24,000

Step 10: Analyze Outcomes

Researchers compare clinical outcomes.

Example
Intervention IKDC Improvement
Conventional Exercise 18 points
BFRT 28 points

Step 11: Calculate Cost-Effectiveness

For CEA, the Incremental Cost-Effectiveness Ratio (ICER) is commonly used.

Formula

Cost of Intervention A - Cost of Intervention B


ICER=
Effect of Intervention A - Effect of Intervention B

Interpretation: ICER represents the additional cost required to achieve one additional unit of
health benefit.

Physiotherapy Example

BFRT costs ₹6,000 more than conventional exercise but improves the IKDC score by 10
additional points.

ICER = ₹6,000 ÷ 10 = ₹600 per additional IKDC point gained.

Step 12: Perform Sensitivity Analysis

Sensitivity analysis examines how changes in assumptions affect the results.

Researchers may vary:

 Treatment costs.
 Number of therapy sessions.
 Equipment prices.
 Success rates.
 Patient adherence.

Physiotherapy Example

If the cost of BFRT equipment decreases, researchers recalculate the ICER to determine
whether BFRT becomes more cost-effective.

Step 13: Interpret Results

Researchers consider:

 Clinical effectiveness.
 Cost differences.
 Statistical significance.
 Clinical significance.
 Quality of evidence.
 Feasibility.

Physiotherapy Example

Although BFRT is more expensive, it may produce faster recovery and earlier return to sport,
making it cost-effective for competitive athletes.

Step 14: Draw Conclusions

Researchers summarize:

 Which intervention provides better value.


 Recommendations for clinical practice.
 Recommendations for healthcare policy.
 Areas requiring future research.

Cost Measurement Methods

Micro-Costing

Measures each resource individually.

Examples:

 One physiotherapy session.


 One elastic resistance band.
 One goniometer.

Highly accurate but time-consuming.

Gross Costing

Uses average costs.

Example:

Average cost of one rehabilitation program.

Simpler but less precise.

Outcome Measurement Methods

Common physiotherapy outcomes include:


Outcome Measurement Tool
Pain Visual Analogue Scale (VAS), Numeric Pain Rating Scale (NPRS)
Function Oswestry Disability Index (ODI), WOMAC, IKDC
Quality of Life SF-36, EQ-5D
Balance Berg Balance Scale
Mobility Timed Up and Go (TUG), Six-Minute Walk Test (6MWT)
Strength Manual Muscle Testing (MMT), Hand-held Dynamometer

Clinical Example

Research Question

Is telerehabilitation more cost-effective than hospital-based physiotherapy after total knee


replacement?

Participants

100 patients.

Intervention A

Hospital rehabilitation.

Cost = ₹30,000.

Intervention B

Telerehabilitation.

Cost = ₹18,000.

Outcomes

 Similar pain reduction.


 Similar functional improvement.
 Similar quality of life.

Economic Evaluation

Since both interventions produce comparable outcomes but telerehabilitation costs


substantially less, Cost-Minimization Analysis (CMA) indicates that telerehabilitation is the
preferred option.

Factors Affecting Economic Evaluation

 Healthcare system.
 Country-specific costs.
 Inflation.
 Exchange rates.
 Patient adherence.
 Treatment duration.
 Severity of disease.
 Availability of equipment.
 Therapist expertise.

Challenges in Conducting Economic Evaluation

 Difficulty measuring indirect and intangible costs.


 Limited long-term follow-up data.
 Variability in healthcare costs between regions.
 Ethical concerns in assigning monetary values to health.
 Differences in patient preferences and adherence.

Advantages of Conducting Economic Evaluation

 Supports evidence-based resource allocation.


 Improves healthcare efficiency.
 Helps prioritize interventions with the greatest value.
 Demonstrates the economic impact of physiotherapy.
 Assists reimbursement and funding decisions.
 Promotes sustainable healthcare systems.

Limitations

 Requires accurate cost and outcome data.


 Time-consuming and methodologically complex.
 Results may not be generalizable across different healthcare settings.
 Economic findings may change with new technologies or price fluctuations.
 Clinical effectiveness should always be considered alongside cost.

Role in Evidence-Based Physiotherapy

Economic evaluation enables physiotherapists to:

 Select interventions that maximize patient benefit within available resources.


 Advocate for evidence-based rehabilitation programs.
 Justify investments in physiotherapy services.
 Contribute to healthcare policy and planning.
 Improve patient outcomes while ensuring efficient use of healthcare resources.

Flowchart: Conducting an Economic Evaluation


Identify Clinical Problem


Define Objectives


Choose Perspective


Identify Alternative Interventions


Measure Costs


Measure Outcomes


Select Type of Economic Evaluation


Analyze Costs and Outcomes


Calculate ICER (if applicable)


Perform Sensitivity Analysis


Interpret Results


Draw Conclusions and Recommendations

CRITICALLY REVIEWING ECONOMIC EVALUATION


Introduction

In Evidence-Based Physiotherapy (EBP), clinical decisions should be based not only on the
effectiveness of an intervention but also on its economic value. Economic evaluations help
determine whether the health benefits of a treatment justify its costs. However, not all
economic evaluations are of high quality. Some studies may have methodological
weaknesses, biased assumptions, or incomplete cost analyses.

Critical review (critical appraisal) of economic evaluation is the systematic assessment of


the validity, reliability, transparency, and applicability of an economic study before its
findings are used in clinical practice or healthcare policy.

A physiotherapist must critically evaluate whether an economic study provides trustworthy


evidence that can guide treatment selection, resource allocation, and patient care.

Definition

Critical review of economic evaluation is the systematic process of assessing the


methodological quality, validity, reliability, transparency, and applicability of an economic
evaluation study to determine whether its conclusions are appropriate for clinical decision-
making.

Objectives of Critically Reviewing Economic Evaluation

The objectives are to:

 Assess the quality of the economic study.


 Determine whether appropriate methods were used.
 Evaluate the accuracy of cost and outcome measurements.
 Identify potential sources of bias.
 Assess whether the conclusions are supported by evidence.
 Determine whether the results are applicable to clinical practice.
 Improve evidence-based decision-making.

Importance in Physiotherapy

Critical appraisal helps physiotherapists to:

 Select cost-effective rehabilitation programs.


 Avoid adopting interventions with poor economic evidence.
 Support funding proposals.
 Improve healthcare resource utilization.
 Develop evidence-based clinical guidelines.
 Ensure patients receive effective and affordable treatment.

Why Critically Review Economic Evaluations?

Economic evaluations influence decisions about:


 Treatment selection.
 Hospital budgeting.
 Insurance reimbursement.
 National healthcare policies.
 Allocation of rehabilitation resources.

If a study is poorly designed, it may recommend interventions that are ineffective,


unnecessarily expensive, or not applicable to the local healthcare setting.

Components of Critical Review

A high-quality economic evaluation should answer several key questions.

1. Is the Research Question Clearly Defined?

The study should clearly state:

 Population.
 Intervention.
 Comparison.
 Outcomes.
 Type of economic evaluation.

Physiotherapy Example

Research Question:

"Is Blood Flow Restriction Training (BFRT) more cost-effective than conventional
strengthening after ACL reconstruction?"

The question is specific, clinically relevant, and suitable for economic evaluation.

2. Was an Appropriate Type of Economic Evaluation Used?

Researchers should select the correct evaluation method.

Type Appropriate Situation


Cost-Minimization Analysis (CMA) Outcomes are equivalent
Cost-Effectiveness Analysis (CEA) Outcomes measured in natural units
Cost-Utility Analysis (CUA) Quality of life (QALYs)
Cost-Benefit Analysis (CBA) Costs and benefits expressed in money

Physiotherapy Example
If two exercise programs produce different improvements in walking distance, Cost-
Effectiveness Analysis (CEA) is appropriate rather than Cost-Minimization Analysis.

3. Was the Perspective Clearly Stated?

The study should specify whose costs and benefits were considered.

Possible perspectives include:

 Patient.
 Hospital.
 Healthcare system.
 Insurance provider.
 Society.

Physiotherapy Example

A study evaluating telerehabilitation from the hospital perspective may exclude patient travel
costs, whereas a societal perspective would include them.

4. Were All Relevant Alternatives Compared?

Economic evaluation should compare realistic alternatives.

Physiotherapy Example

Comparing:

 Conventional strengthening.
 BFRT.

instead of evaluating BFRT alone.

5. Were All Relevant Costs Identified?

Researchers should include all important costs.

Direct Medical Costs

 Physiotherapy sessions.
 Equipment.
 Hospital charges.
 Medications.

Direct Non-Medical Costs

 Transportation.
 Home modifications.

Indirect Costs
 Loss of wages.
 Caregiver time.
 Productivity loss.

Intangible Costs

 Pain.
 Anxiety.
 Reduced quality of life.

Physiotherapy Example

A stroke rehabilitation study should include:

 Therapist salary.
 Walking aids.
 Transportation.
 Caregiver expenses.

6. Were Costs Measured Accurately?

Researchers should explain:

 Cost sources.
 Currency.
 Price year.
 Inflation adjustments.

Physiotherapy Example

The cost of robotic gait training should include:

 Equipment purchase.
 Maintenance.
 Staff training.
 Electricity.
 Therapist time.

7. Were Outcomes Measured Appropriately?

Outcome measures should be:

 Valid.
 Reliable.
 Clinically meaningful.

Common physiotherapy outcomes include:


 Pain (VAS, NPRS).
 Function (ODI, WOMAC, IKDC).
 Balance (Berg Balance Scale).
 Mobility (TUG, 6MWT).
 Quality of life (SF-36, EQ-5D).

Physiotherapy Example

A knee osteoarthritis study measures:

 WOMAC.
 Pain.
 Walking distance.

These are appropriate clinical outcomes.

8. Were Costs and Outcomes Measured Over an Appropriate Time Period?

The follow-up period should be long enough to capture important costs and benefits.

Physiotherapy Example

Evaluating ACL rehabilitation over only two weeks would miss long-term improvements in
return-to-sport outcomes.

A one-year follow-up would be more appropriate.

9. Were Costs and Outcomes Discounted?

When studies extend beyond one year, future costs and benefits should be discounted because
money and health benefits received today are generally valued more than those received in
the future.

Physiotherapy Example

A five-year stroke rehabilitation program should discount future healthcare costs.

10. Was Incremental Analysis Performed?

When comparing interventions, researchers should calculate the:

Incremental Cost-Effectiveness Ratio (ICER).

Formula

Difference in Costs
ICER=
Difference in Outcomes

Physiotherapy Example
BFRT costs ₹5,000 more but improves IKDC scores by 10 points.

ICER = ₹500 per additional IKDC point gained.

11. Was Sensitivity Analysis Conducted?

Sensitivity analysis examines whether conclusions remain stable if assumptions change.

Variables tested may include:

 Equipment costs.
 Number of treatment sessions.
 Therapist salaries.
 Patient adherence.

Physiotherapy Example

Researchers test whether BFRT remains cost-effective if equipment costs increase by 20%.

12. Were Results Clearly Presented?

Results should include:

 Total costs.
 Clinical outcomes.
 ICER.
 Confidence intervals.
 Statistical analysis.
 Graphs and tables.

Physiotherapy Example

The study reports:

 Cost per patient.


 Functional improvement.
 Cost per QALY gained.

13. Were Ethical Issues Considered?

Researchers should consider:

 Equity of access.
 Fair distribution of resources.
 Patient preferences.
 Informed consent.

Physiotherapy Example
Robotic rehabilitation may be effective but unavailable in rural hospitals, raising concerns
about equitable access.

14. Are the Results Applicable to Local Practice?

Researchers should consider:

 Healthcare system.
 Available resources.
 Patient population.
 Clinical expertise.
 Local treatment costs.

Physiotherapy Example

A study conducted in the United States may not directly apply to physiotherapy practice in
India due to differences in healthcare costs and reimbursement systems.

15. Are the Conclusions Supported by the Data?

Researchers should ensure that conclusions reflect the actual findings.

Physiotherapy Example

If BFRT provides only a small improvement but costs three times more than conventional
exercise, claiming it is the "best treatment" may not be justified without considering cost-
effectiveness.

Common Sources of Bias in Economic Evaluation

Type of Bias Description


Selection Bias Non-comparable patient groups
Measurement Bias Incorrect measurement of costs or outcomes
Publication Bias Positive studies more likely to be published
Reporting Bias Selective reporting of favorable results
Funding Bias Sponsoring organizations influencing conclusions

Checklist for Critical Review of Economic Evaluation

A reviewer should ask:

1. Was the research question clearly stated?


2. Was the correct type of economic evaluation used?
3. Was the study perspective appropriate?
4. Were all relevant alternatives compared?
5. Were all important costs identified?
6. Were costs measured accurately?
7. Were outcomes measured appropriately?
8. Was the time horizon sufficient?
9. Were future costs discounted (if required)?
10. Was ICER calculated correctly?
11. Was sensitivity analysis performed?
12. Were results presented clearly?
13. Are the conclusions justified?
14. Can the findings be applied to my patients?

Drummond Checklist

One of the most widely used tools for appraising economic evaluations is the Drummond
Checklist, which includes the following questions:

1. Was a well-defined question posed?


2. Were competing alternatives described?
3. Was the effectiveness of interventions established?
4. Were all relevant costs and outcomes identified?
5. Were costs and outcomes measured accurately?
6. Were costs and outcomes valued credibly?
7. Were future costs and outcomes discounted?
8. Was an incremental analysis performed?
9. Was uncertainty addressed through sensitivity analysis?
10. Were results presented clearly with appropriate discussion?

Physiotherapy Example

Research Topic

Cost-effectiveness of Telerehabilitation vs Hospital-Based Rehabilitation After Total


Knee Replacement

Critical Review

Research Question

✔ Clearly defined.

Perspective

✔ Societal perspective.

Alternatives

✔ Two rehabilitation programs compared.

Costs

✔ Included therapist salary, travel, equipment, and caregiver costs.


Outcomes

✔ WOMAC, VAS, and Quality of Life measured.

ICER

✔ Reported correctly.

Sensitivity Analysis

✔ Performed.

Applicability

✔ Suitable for urban rehabilitation settings but may not be applicable in regions with limited
internet access.

Conclusion

The study provides reliable evidence that telerehabilitation offers similar outcomes at a lower
overall cost, supporting its use in appropriate patient populations.

Advantages of Critically Reviewing Economic Evaluations

 Improves evidence-based decision-making.


 Identifies high-quality economic evidence.
 Prevents adoption of inefficient interventions.
 Supports effective resource allocation.
 Enhances patient care.
 Promotes transparent healthcare policies.

Limitations

 Requires knowledge of health economics.


 Some studies may omit important costs.
 Cost estimates vary between countries and healthcare systems.
 Long-term economic outcomes may be uncertain.
 Results may become outdated as technology and costs change.

Role in Evidence-Based Physiotherapy

Critical appraisal of economic evaluations enables physiotherapists to:

 Integrate clinical effectiveness with economic efficiency.


 Select interventions that provide the best value for patients and healthcare systems.
 Advocate for funding of effective rehabilitation programs.
 Support sustainable and equitable physiotherapy services.
 Contribute to policy decisions based on high-quality evidence.
LOCATING ECONOMIC EVALUATION IN THE LITERATURE

Introduction
In Evidence-Based Physiotherapy (EBP), clinicians should base treatment decisions not
only on clinical effectiveness but also on the economic value of interventions. Economic
evaluations help determine whether a healthcare intervention provides good value for the
resources invested. Before critically appraising or applying an economic evaluation, it must
first be located efficiently in the scientific literature.

Locating economic evaluation in the literature is the systematic process of searching,


identifying, and retrieving published economic evaluation studies from reliable databases and
other evidence sources. A structured search strategy ensures that physiotherapists identify the
best available evidence regarding the cost-effectiveness of rehabilitation interventions.

Definition

Locating economic evaluation in the literature is the systematic process of identifying,


searching, retrieving, and selecting published economic evaluation studies from scientific
databases and other reliable sources to support evidence-based healthcare decision-making.

Objectives

The objectives are to:

 Identify published economic evaluation studies.


 Locate high-quality evidence on healthcare costs and outcomes.
 Support evidence-based clinical decision-making.
 Compare the cost-effectiveness of interventions.
 Avoid duplication of research.
 Identify knowledge gaps.
 Support healthcare policy and planning.

Importance in Physiotherapy

Locating economic evidence helps physiotherapists to:

 Select cost-effective rehabilitation interventions.


 Justify physiotherapy services to administrators and insurers.
 Develop evidence-based treatment protocols.
 Improve healthcare resource allocation.
 Support research projects and systematic reviews.
 Enhance patient care while reducing unnecessary expenditure.

Sources of Economic Evaluation Literature

Economic evaluations can be found in various sources.

1. Electronic Bibliographic Databases


These are the primary sources for locating research articles.

Common databases include:

PubMed/MEDLINE

 Largest biomedical database.


 Contains clinical and health economic studies.
 Free access.

Physiotherapy Example

Search for the cost-effectiveness of exercise therapy for knee osteoarthritis.

PEDro (Physiotherapy Evidence Database)

 Specialized database for physiotherapy.


 Includes randomized controlled trials, systematic reviews, and clinical practice
guidelines.
 Useful for identifying physiotherapy interventions, though economic evaluations may
be fewer than in broader medical databases.

Cochrane Library

Contains:

 Cochrane Systematic Reviews.


 CENTRAL (Cochrane Central Register of Controlled Trials).
 Reviews often include evidence on economic implications and cost-effectiveness.

Embase

 Extensive biomedical database.


 Includes many European journals.
 Strong coverage of pharmacoeconomics and health economics.

CINAHL

 Covers nursing and allied health.


 Useful for physiotherapy, occupational therapy, and rehabilitation research.

Scopus

 Multidisciplinary database.
 Includes citation tracking.
 Useful for comprehensive literature searches.

Web of Science

 Citation database.
 Useful for identifying influential economic evaluation studies.

EconLit

 Specialized database for economics and health economics.


 Useful for locating cost-effectiveness studies and economic analyses.

NHS Economic Evaluation Database (NHS EED)

Historically provided critically appraised economic evaluations. Although no longer updated,


archived records remain useful for older studies.

Types of Literature Sources

Primary Sources

Original research conducted by investigators.

Examples:

 Randomized Controlled Trials with economic evaluation.


 Cohort studies.
 Cost-effectiveness studies.

Secondary Sources

Summaries and syntheses of primary studies.

Examples:

 Systematic reviews.
 Meta-analyses.
 Clinical practice guidelines.
 Cochrane Reviews.

Tertiary Sources

Summarized reference materials.

Examples:

 Textbooks.
 Encyclopedias.
 Clinical manuals.

Developing a Search Strategy

A well-planned search strategy increases the likelihood of finding relevant studies.

Step 1: Define the Clinical Question


Use the PICO framework.

Component Example
Population Patients with knee osteoarthritis
Intervention Exercise therapy
Comparison Usual care
Outcome Pain reduction and cost-effectiveness

Clinical Question

"Is exercise therapy cost-effective compared with usual care for patients with knee
osteoarthritis?"

Step 2: Identify Keywords

Break the research question into important concepts.

Keywords

 Knee osteoarthritis
 Exercise therapy
 Physiotherapy
 Rehabilitation
 Cost-effectiveness
 Economic evaluation
 Cost-utility
 Cost-benefit

Step 3: Identify Synonyms

Different authors may use different terminology.

Concept Synonyms
Physiotherapy Physical therapy, rehabilitation
Cost-effectiveness Economic evaluation, health economics
Exercise Therapeutic exercise, strengthening

Using synonyms improves the search.

Boolean Operators

Boolean operators combine search terms.

AND
Narrows the search.

Example:

ACL reconstruction AND cost-effectiveness

Finds articles containing both terms.

OR

Broadens the search.

Example:

Physiotherapy OR Physical Therapy

Finds articles containing either term.

NOT

Excludes unwanted terms.

Example:

Stroke NOT Pediatrics

Removes pediatric stroke studies.

Phrase Searching

Quotation marks search for an exact phrase.

Example:

"Blood Flow Restriction Training"

Truncation

Uses a symbol (commonly *) to retrieve words with the same root.

Example:

rehab*

Retrieves:

 rehabilitation
 rehabilitative
 rehabilitating
Medical Subject Headings (MeSH)

MeSH terms are standardized indexing terms used in PubMed.

Examples:

 Physical Therapy Modalities


 Exercise Therapy
 Cost-Benefit Analysis
 Rehabilitation
 Stroke

Using MeSH terms improves search precision.

Filters

Search results can be refined using filters.

Examples:

 Randomized Controlled Trial.


 Systematic Review.
 Economic Evaluation.
 English language.
 Human studies.
 Adults.
 Publication date (e.g., last 10 years).

Screening Search Results

Researchers should:

1. Read titles.
2. Read abstracts.
3. Remove duplicates.
4. Exclude irrelevant articles.
5. Retrieve full-text articles.
6. Apply inclusion and exclusion criteria.

Inclusion Criteria

Examples:

 Adult participants.
 Physiotherapy interventions.
 Full economic evaluations.
 Peer-reviewed publications.
 English language.

Exclusion Criteria
Examples:

 Animal studies.
 Editorials.
 Conference abstracts.
 Case reports.
 Studies without economic data.

Assessing Relevance

After retrieving articles, researchers should evaluate whether the study:

 Addresses the clinical question.


 Uses an appropriate economic evaluation method.
 Includes relevant patient populations.
 Reports clinically meaningful outcomes.
 Measures costs appropriately.

Managing Search Results

Reference management software helps organize citations.

Examples:

 EndNote
 Zotero
 Mendeley
 RefWorks

These tools help:

 Store references.
 Remove duplicates.
 Generate citations.
 Organize literature.

Grey Literature

Grey literature includes research not published in traditional journals.

Examples:

 Government reports.
 University theses.
 Clinical trial registries.
 Health technology assessment reports.
 Conference proceedings.
Including grey literature reduces publication bias.

Searching Clinical Practice Guidelines

Guidelines often include economic evidence.

Examples:

 National and international physiotherapy guidelines.


 Orthopaedic rehabilitation guidelines.
 Stroke rehabilitation guidelines.

Physiotherapy Example

Clinical Question

Is Blood Flow Restriction Training (BFRT) cost-effective after ACL reconstruction?

Search Strategy

Databases

 PubMed
 PEDro
 Cochrane Library
 Embase

Keywords

 ACL reconstruction
 Blood Flow Restriction Training
 Cost-effectiveness
 Physiotherapy
 Rehabilitation

Boolean Search

("ACL reconstruction")
AND
("Blood Flow Restriction Training")
AND
("Cost-effectiveness")
AND
(Physiotherapy OR Rehabilitation)

Results

 210 articles identified.


 180 after duplicate removal.
 45 full-text articles reviewed.
 12 economic evaluation studies included.

Challenges in Locating Economic Evaluation Literature

 Different terminology across studies.


 Limited indexing of economic evaluations.
 Access restrictions to subscription databases.
 Incomplete reporting of costs.
 Rapidly expanding literature.
 Publication bias.

Tips for Effective Literature Searching

 Develop a clear PICO question.


 Use multiple databases.
 Combine keywords with MeSH terms.
 Apply Boolean operators correctly.
 Use appropriate filters.
 Search reference lists of relevant studies.
 Include grey literature where appropriate.
 Document the search strategy for transparency and reproducibility.

Role in Evidence-Based Physiotherapy

Locating economic evaluation literature enables physiotherapists to:

 Compare the value of different rehabilitation interventions.


 Identify cost-effective treatment strategies.
 Support evidence-based clinical practice.
 Contribute to systematic reviews and guideline development.
 Improve patient care while optimizing healthcare resources.

Advantages of Systematic Literature Searching

 Identifies the best available evidence.


 Reduces selection bias.
 Improves transparency and reproducibility.
 Supports high-quality research.
 Enhances evidence-based decision-making.
 Facilitates comprehensive reviews.

Limitations

 Time-consuming.
 Some databases require subscriptions.
 Relevant studies may be missed if search terms are inadequate.
 Publication bias can limit available evidence.
 Older studies may use outdated economic methods.

Flowchart: Locating Economic Evaluation in the Literature


Identify Clinical Problem


Develop PICO Question


Identify Keywords and Synonyms


Select Databases


Conduct Literature Search


Apply Boolean Operators and Filters


Screen Titles and Abstracts


Retrieve Full-Text Articles


Apply Inclusion and Exclusion Criteria


Select Relevant Economic Evaluation Studies


Critically Appraise the Studies


Apply Findings to Evidence-Based Physiotherapy

You might also like