USING A MIXED METHODS
APPROACH TO ENHANCE AND
VALIDATE YOUR RESEARCH
Dr Caroline Bulsara,
Brightwater Group Research Centre Manager &
Adjunct Senior Lecturer, Notre Dame University
What does mixed methods mean to
you?
Mixed Methods as
a “Movement”
“The emergence of mixed
methods as a third
methodological movement
in the social and behavioral
sciences began during the
1980’s.” (p. 697)
-Tashakkori &
Teddlie (2003)
3
Use of mixed methods approach
• Variation in data collection leads to greater
validity.
• Answers the question from a number of
perspectives.
• Ensures that there are no ‘gaps’ to the
information / data collected.
• Ensures that pre existing assumptions from the
researcher are less likely.
• When one methodology does not provide all the
information required.
Defining mixed methods
• Also called ‘multi-methodology’. Triangulation .
• Evolved from evaluation research.
• “Involved integrating quantitative and
qualitative approaches to generating new
knowledge and can involve either concurrent or
sequential use of these two classes of methods
to follow a line of inquiry.” – Stange K et al (2006).
• “Integrating quantitative and qualitative data
collection and analysis in a single study or a
program of enquiry.” – Creswell et al 2003.
A Definition
Mixed methods research is a methodology for conducting
research that involves collecting, analyzing, and integrating (or
mixing) quantitative and qualitative research (and data) in a
single study or a longitudinal program of inquiry. The purpose of
this form of research is that both qualitative and quantitative
research, in combination, provide a better understanding of a
research problem or issue than either research approach alone.
Aspects of this definition:
Collecting both quantitative and qualitative data
Mixing the data
Single vs multiple-phase project
Raises issues: how, what, where, why, value (of mixing)
6
Criteria for mixed methods
research rigour
• Reasons for mixing qualitative and
quantitative approaches . Benefits?
• Types of data collected and analysed.
• Priority for qual or quan?
• Implementation sequence – sequential or
concurrent.
• Phase at which integration of data occurs.
Scope of mixed methods approach
• Generally in health research there are a number
of stakeholders / population groups to consider
around one particular issue.
• Can be a on a micro or macro scale.
• Examples:
A health service with community outreach.
A NGO providing community support services.
A general practice screening program.
Background mixed methods
• Approach and main focus on either qualitative
or quantitative will depend on popn.
• Instrument design model.
• Triangulation design model.
• Data transformation design model.
• Explanatory model.
Mixing (How)
Converge data:
Qual Results Quan
Connect data:
Qual Quan Results
Embed the data:
Quan data
Qual data
10
Parsimonious Designs (Creswell & Plano Clark, 2007)
Concurrent Mixed Methods Designs
Triangulation Design
QUAN QUAL
Data & Data &
Interpretation
Results Results
Embedded Design
QUAN Intervention QUAN
Pre-test Post-test
Interpretation
Data & Data &
qual
Results Results
Process
11
Sequential Mixed Methods Designs (Creswell & Plano Clark, 2007)
Explanatory Design
QUAN qual
Data & Data & Interpretation
Results Results
Following up
Exploratory Design
QUAL quan
Data & Data &
Interpretation
Results Building to
Results
Sequential Embedded Design
Before-
QUAN After-
Intervention
intervention
Trial intervention
qual qual Interpretation
12
Focus on design
Triangulative model Instrument design model
• Frequently used in primary • Priority to quantitative data.
health care research. • Two phases begins with
• Gathers data at the same time. qualitative and then moves to
• Integrate all data in order to quantitative design and
clarify or better understand testing.
the problem. • Integration in the data analysis
• Quantitative and qualitative stage.
are given equal priority. • Uses the qualitative
• Reported on in separate information to develop an
sections of a report. instrument for data collection.
• Discussion brings salient • Eg Scale development or Focus
points together in the report. groups to create a
questionnaire.
Focus on design 2
Data transformation model Explanatory model
• Suited to primary care – • Quantitative research
retrospective or prospective. questions or hypotheses will
address the research question
• Initial quantitative (survey) or issue.
followed by some qualitative • Information from the first
phase will be explored further
questions to explore results. in a second qualitative phase.
• Can analyse qualitative data • Qualitative data collection will
(open ended) and be used to explore important
quantitative results with a few
numerically code. participants.
• The reason for following up
with qualitative research in the
second phase is better
understand and explain the
quantitative results.
EXAMPLES OF MIXED METHODS TYPE
RESEARCH QUESTIONS
• Triangulative questions:
- How well has a school health initiative
for high school students been received?
- What are the issues in accessing services
for those affected by traumatic injury?
• What information do we require?
• What evidence do we require to show the
outcomes?
Example planning
What are the issues in accessing services for
those affected by traumatic injury?
• What groups / populations / stakeholders?
• What parameters do we set?
• Who do we contact to / how do we go about
collecting our data?
What data do we require?
What groups What parameters?
/representatives? - Types of injury.
- Persons with Catastrophic - Level of care required.
injury (CI). - Compensation?
- Carers (family) of persons - Age groups.
with CI.
- Paid care?
- Service providers / orgs
for those affected by CI. - Length of hospital stay.
- Health professionals. - Types of aids and
appliances.
- Impact on family.
EXAMPLES OF MIXED METHODS TYPE
RESEARCH QUESTIONS 2
• Instrument design model questions:
- How can we best define what
empowerment means to cancer patients?
- What are the access issues for disabled
persons attending a general practice for a medical
problem?
• What information do we require?
• What evidence / information do we require to
develop a survey / instrument?
Example planning 2
What are the access issues for disabled persons
attending a general practice for a medical
problem?
• What is already in place?
• Who can we get our information from –
maximum amount of information?
• How do we go about collecting this
information?
• What sort of information can we use to
quantify the problem?
Useful ways to find out about topic
• Group meetings and discussions
• Meetings with key people / community
champions
• Previous written material and other
documentation
• Observing the place / location - dynamics
Getting the right information
- sampling approaches
• Asking ourselves who has the greatest amount
of relevant information.
• Consider those groups – best way to contact
and approach them.
• Initial stages may not need to be a broader
population perspective.
• E.g. Seniors safety in medicines project.
Qual + quan sampling
• May initially use non probability techniques –
qualitative. Focus groups , interviews.
• Which group will give the optimal information
on the topic?
Large random Small select
sample group
Using a mixed methods approach -
Conclusions
• Can be labour intensive.
• Involves multiple stages of data collection.
• Provides greater breadth of perspectives
around a certain issue.
• Combining approaches helps overcome
deficiencies in one method only.
• Effectively allows populations with limited
language skills or trust issues to participate.
• Can help define more ‘nebulous’ concepts.
• Prevents researcher assumptions about a
particular population.
• Lends itself well to outcomes driven research
(eg needs assessments or evaluations).