Module 1: The Philosophy of Methodological Choice
The Epistemological Landscape
Knowledge in research is not "found" as much as it is "constructed" or "measured" based on
the researcher’s philosophical positioning. To understand methods, one must first master the
three pillars of research philosophy: Ontology, Epistemology, and Axiology.
Positivism and Post-Positivism
Positivism is the cornerstone of the natural sciences. It posits that reality is external, objective,
and independent of the observer. The method of obtaining knowledge here is strictly
Deductive.
The Positivist Method: Knowledge is obtained by formulating a hypothesis based on existing
theory and then subjecting it to empirical testing. If the data aligns with the hypothesis, the
theory is supported; if not, it is refuted.
Post-Positivism: Recognizing that human observers are inherently biased, post-positivism
argues that we can never know "The Truth" with absolute certainty. Instead, we obtain
knowledge by "failing to reject" hypotheses. This led to the development of the Null Hypothesis
(H_0) framework.
Interpretivism (Social Constructivism)
In contrast, Interpretivism suggests that the social world cannot be studied like the physical
world. Knowledge is obtained by exploring the subjective meanings that individuals attach to
their experiences.
The Interpretivist Method: The researcher is the primary "instrument." Knowledge is co-created
through the interaction between the researcher and the participant. This is the foundation of
qualitative inquiry.
Module 2: Quantitative Methods – The Science of Precision
Experimental Research Methods
The experimental method is the most robust way to obtain knowledge regarding cause-and-
effect relationships. It relies on the manipulation of the Independent Variable (IV) to observe
changes in the Dependent Variable (DV).
The Laboratory Experiment
Knowledge is obtained in a controlled environment where extraneous variables (nuisance
variables) are eliminated.
Standardization: Every participant experiences the exact same conditions.
Replicability: The method is documented so precisely that another researcher can repeat it to
see if the knowledge holds true across different contexts.
Field and Quasi-Experiments
Often, laboratory settings lack Ecological Validity (the extent to which results apply to the real
world).
Field Experiments: Conducted in natural settings (e.g., testing a new teaching method in a real
classroom).
Quasi-Experiments: Used when random assignment is impossible. For example, if a researcher
wants to obtain knowledge on the effects of smoking, they cannot ethically "assign" people to
smoke. They must compare existing groups.
Survey Research and Psychometric Instrumentation
Surveys are the primary method for obtaining knowledge from large populations. However, the
quality of the knowledge depends on the Instrument Design.
Operationalization
This is the process of turning an abstract concept (like "intelligence" or "brand loyalty") into a
measurable variable.
Nominal Scales: Categorical data (e.g., Gender, Nationality).
Ordinal Scales: Ranked data (e.g., Finishing position in a race).
Interval/Ratio Scales: Precise numerical data (e.g., Temperature, Height, Income).
Statistical Inference
Once data is collected, knowledge is synthesized using statistics.
Descriptive Statistics: Summarizing the data (Mean, Median, Mode, Standard Deviation).
Inferential Statistics: Determining if the findings from a sample can be generalized to the entire
population. This involves calculating p-values and Confidence Intervals.
Module 3: Qualitative Methods – The Pursuit of Depth
Ethnography: Immersive Knowledge
Ethnography is the "long-haul" method of obtaining knowledge. It requires the researcher to
live within a community for months or years.
Participant Observation
The researcher plays a dual role:
Observer: Taking field notes on behaviors, rituals, and interactions.
Participant: Engaging in the daily life of the group to build rapport and gain "insider
knowledge."
Grounded Theory: Building Knowledge from Scratch
Unlike quantitative research, which starts with a theory, Grounded Theory begins with the data.
Constant Comparative Analysis
As the researcher collects interviews or documents, they constantly compare new data with
previously collected data.
Theoretical Sampling: The researcher chooses new participants based on the gaps in the
emerging theory.
Saturation: Knowledge acquisition stops when no new information or themes are being
discovered.
Module 4 : Modern & Computational Methods
Digital Ethnography (Netnography)
In the digital age, knowledge is obtained by studying online communities. Researchers analyze
"digital traces"—comments, likes, shares, and forum posts—to understand human behavior in
virtual spaces.
Content and Discourse Analysis
Content Analysis: A systematic coding of text (e.g., analyzing 1,000 newspaper articles to see
how climate change is portrayed).
Discourse Analysis: Looking beyond the words to the "power structures." How does the
language used by a politician shape the public's reality?
Module 5: Sampling Theory, Logistics, and the Architecture of
Inclusion
Knowledge acquisition is only as valid as the sources from which it is derived. If a researcher
intends to obtain knowledge about "human behavior" but only studies undergraduate students
in Western universities (the "WEIRD" problem—Western, Educated, Industrialized, Rich, and
Democratic), the resulting knowledge is inherently skewed.
The Logic of Sampling
In research, a Population is the entire set of cases a researcher is interested in, while a Sample
is the subset actually studied. The method of obtaining knowledge from a sample to represent
a population is governed by Generalizability.
Probability Sampling (The Quantitative Rigor)
To obtain statistically representative knowledge, every member of a population must have a
known, non-zero chance of selection.
Simple Random Sampling (SRS): Utilizes random number generators. It minimizes systematic
bias but requires a complete list of the population (a "sampling frame"), which is often
unavailable.
Stratified Random Sampling: The population is divided into "strata" (e.g., income levels). A
random sample is then drawn from each stratum. This ensures that minority subgroups are not
"drowned out" by the majority, providing more granular knowledge.
Systematic Sampling: Selecting every n^{th} individual. It is simpler than SRS but can be
compromised if the population list has a hidden periodic pattern (periodicity).
Cluster Sampling: Used for large geographical areas. Instead of sampling individuals, the
researcher samples "clusters" (like city blocks or schools). While cost-effective, it often has a
higher "sampling error" than SRS.
Non-Probability Sampling (The Qualitative Focus)
In qualitative research, the goal is often Transferability rather than statistical generalizability.
Purposive Sampling: The researcher hand-picks participants who are "information-rich." For
example, if studying corporate leadership, one might specifically seek out CEOs who have led
companies through bankruptcy.
Snowball Sampling: Vital for "hidden populations" (e.g., undocumented immigrants or
underground subcultures). One participant refers the next.
Quota Sampling: Similar to stratified sampling but without the random element. It ensures
certain characteristics are represented but cannot claim statistical representativeness.
Power Analysis and Sample Size
A critical failure in many research projects is being "underpowered." If a sample is too small, the
researcher might fail to detect a real effect (Type II Error).
Effect Size: How large is the phenomenon we are looking for?
Alpha (\alpha): The threshold for "statistical significance" (usually 0.05).
Beta (\beta): The probability of making a Type II error.
Knowledge is obtained most reliably when a Power Analysis is conducted before data collection
begins to determine the minimum required sample size.
Module 6: Data Analysis Techniques – The Synthesis of Meaning
Once data is obtained, it must be processed. This is the stage where "raw information" is
converted into "scientific knowledge."
Quantitative Analysis: The Power of Inference
Quantitative data analysis is the process of using mathematical models to test the relationships
between variables.
Univariate and Bivariate Analysis
Descriptive Statistics: Frequency distributions, measures of central tendency (mean, median),
and dispersion (standard deviation).
T-Tests: Comparing the means of two groups (e.g., does Medication A perform better than a
Placebo?).
Correlation (Pearson’s r): Determining the strength and direction of a relationship between two
continuous variables.
Multivariate Analysis
To obtain knowledge in complex real-world scenarios, we must look at multiple variables
simultaneously.
Multiple Regression: Predicting a dependent variable based on several independent variables
(e.g., predicting "House Price" based on "Square Footage," "Location," and "Year Built").
ANOVA (Analysis of Variance): Comparing means across three or more groups.
Factor Analysis: Identifying underlying "latent variables" that explain patterns in large sets of
data (e.g., identifying "Introversion" as a factor behind several different social behaviors).
Qualitative Analysis: The Art of Interpretation
Qualitative data (interviews, images, videos) cannot be "calculated." It must be "coded."
Thematic Analysis
The most common method of qualitative knowledge acquisition. It involves:
Familiarization: Immersing oneself in the data.
Generating Initial Codes: Labeling specific segments of text.
Searching for Themes: Grouping codes into broader patterns of meaning.
Reviewing Themes: Ensuring the themes work in relation to the entire data set.
Discourse and Content Analysis
Manifest Content: The visible, surface-level content (e.g., how many times the word "freedom"
appears in a speech).
Latent Content: The underlying meaning and context (e.g., what "freedom" implies within that
specific political culture).
Computer-Assisted Qualitative Data Analysis Software (CAQDAS)
Modern qualitative researchers use tools like NVivo or [Link]. These do not "analyze" the data
for the researcher; rather, they provide a sophisticated filing system that allows the researcher
to link codes, visualize relationships, and manage thousands of pages of transcripts efficiently.
Module 7: Validity, Reliability, and Trustworthiness
No method of obtaining knowledge is useful if the results are not credible.
Internal Validity: The extent to which we can say the IV caused the change in the DV.
External Validity: The extent to which the results can be generalized to other settings.
Reliability: The consistency of the measure. If we did the study again tomorrow, would we get
the same result?
Credibility & Triangulation (Qualitative): Using multiple data sources (interviews + observation +
documents) to ensure the interpretation is robust.
Module 8: The Ethics of Knowledge Acquisition
Ethics are not just a set of rules; they are a methodological safeguard. Without ethical rigor, the
knowledge obtained is considered "tainted" and is often rejected by the scientific community.
The Aim of Ethics in Knowledge Production
Ethical norms promote the primary goals of research: truth, knowledge, and the avoidance of
error. For example, prohibitions against fabricating or falsifying data are ethical requirements
that directly protect the integrity of the knowledge being produced.
The "Guardrail" Principles
To obtain knowledge ethically, researchers must adhere to three core pillars (often cited from
the Belmont Report):
Respect for Persons: Acknowledging autonomy and protecting those with diminished autonomy
(e.g., children or prisoners). This is operationalized through Informed Consent.
Beneficence: The "Do No Harm" principle. Researchers must minimize risks and maximize
benefits.
Justice: Ensuring that the burdens and benefits of research are distributed fairly. You cannot
obtain knowledge from one vulnerable group only to apply the benefits solely to a privileged
group.
Digital Research Methods – The Silicon Frontier
Digital methods are no longer just "tools"; they are distinct epistemologies (ways of knowing).
They allow us to obtain knowledge from "natively digital" environments that traditional
methods cannot reach.
Data Scrapping and Big Data
Knowledge is obtained by harvesting massive datasets from the web (social media, forums,
archives).
Computational Social Science: Using algorithms to identify social trends in real-time.
Sentiment Analysis: Using AI to categorize the emotional tone of millions of tweets or reviews
to understand public opinion.
Digitally Mediated Traditional Methods
This involves "re-tooling" classic methods for the internet age:
Synchronous/Asynchronous Interviews: Using Zoom or WhatsApp to reach global participants.
Netnography: A specialized form of ethnography where the researcher immerses themselves in
online communities (e.g., Reddit threads or gaming guilds) to obtain cultural knowledge.
The Ethics-Digital Nexus
Digital methods create new ethical dilemmas. For example: Is a public tweet "private" or
"public" data? Obtaining knowledge in the digital age requires a constant balancing act
between the availability of data and the right to privacy
Module 9: Data Synthesis and the Systematic Literature Review (SLR)
Knowledge acquisition is not always about collecting "new" data (Primary Research). Often, the
most profound insights are obtained by looking at the totality of what has already been
discovered. This is the realm of Meta-Analysis and Systematic Reviews.
The Systematic vs. Narrative Review
To obtain knowledge that is defensible, a researcher must distinguish between a casual
summary and a systematic synthesis.
Narrative Review: A descriptive summary of prior research. It is prone to "cherry-picking" where
the researcher only cites studies that support their view.
Systematic Literature Review (SLR): A high-level overview of primary research on a focused
question that identifies, selects, assesses, and synthesizes all high-quality research evidence. It
follows a strict, pre-defined protocol to reduce bias.
Meta-Analysis: The Quantitative Synthesis
Meta-analysis is a statistical method for combining data from multiple studies. When individual
studies are too small to yield a definitive conclusion, a meta-analysis obtains "superior
knowledge" by calculating an Overall Effect Size.
Forest Plots: A graphical representation of the results of several studies. It shows the point
estimate of each study and its confidence interval, allowing the researcher to see at a glance if
the evidence leans in one direction.
Heterogeneity: Measuring how much the studies differ from one another (I^2 statistic). If
studies are too different, combining them may lead to "apples and oranges" errors.
Meta-Ethnography: The Qualitative Synthesis
Just as numbers can be combined, so can stories. Meta-ethnography is the method of obtaining
knowledge by "translating" the findings of multiple qualitative studies into one another. This
allows researchers to build higher-order theories that a single ethnography could not produce.
Module 10: Case Studies of Methodological Failure (The "Dark Side" of
Knowledge)
One of the most effective ways to understand how to obtain knowledge correctly is to analyze
when the methods were applied incorrectly or unethically.
The Replication Crisis
In the early 2010s, psychology and medicine faced a crisis: many foundational studies could not
be replicated. This highlighted the "methods" that produce False Knowledge:
P-Hacking: Manipulating data or selecting specific variables until a non-significant result
becomes significant (p < 0.05).
HARKing (Hypothesizing After Results are Known): Presenting a post-hoc discovery as if it were
the original hypothesis.
Historical Methodological Atrocities
Knowledge obtained through suffering is a stain on the scientific record.
The Tuskegee Syphilis Study: A failure of the "Experimental Method" where treatment was
withheld from participants to observe the natural progression of a disease. This led to the
mandatory creation of Institutional Review Boards (IRBs).
The Milgram Obedience Study: While it provided deep knowledge about human nature, its
methods were criticized for causing severe psychological distress to the "researchers"
(participants).
Module 11: Codification—Writing as a Method of Discovery
writing is not just the "final step"; it is a way of obtaining knowledge. Through the act of
Thematizing and Drafting, the researcher identifies gaps in their own logic.
The IMRaD Structure
The standard method of codifying knowledge in the sciences:
Introduction: Why does this knowledge matter?
Methods: How exactly was the knowledge obtained? (The most scrutinized section).
Results: What was the raw data?
Discussion: What does this knowledge mean for the world?
Peer Review: The Gatekeeper of Knowledge
Knowledge is not "official" until it has survived Peer Review. This is a method of External
Validation where anonymous experts attempt to find flaws in the researcher’s methodology.
References
Kuhn, T. S. (1962). The Structure of Scientific Revolutions. University of Chicago Press. (Essential
for discussing "Paradigms").
Popper, K. (1959). The Logic of Scientific Discovery. Routledge. (The primary source for
"Falsification" and the Null Hypothesis).
Berger, P. L., & Luckmann, T. (1966). The Social Construction of Reality. Doubleday. (The
foundation for Qualitative/Interpretivist methods).
Crotty, M. (1998). The Foundations of Social Research: Meaning and Perspective in the
Research Process. Sage.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and Quasi-Experimental Designs for
Research. Rand McNally. (The "bible" of experimental validity).
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum
Associates. (Necessary for your section on Sample Size/Power).
Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics. Sage. (The gold standard for
explaining complex multivariate analysis).
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, Phone, Mail, and Mixed-Mode
Surveys: The Tailored Design Method. Wiley.
Glaser, B. G., & Strauss, A. L. (1967). The Discovery of Grounded Theory: Strategies for
Qualitative Research. Aldine.
Creswell, J. W., & Poth, C. N. (2018). Qualitative Inquiry and Research Design: Choosing Among
Five Approaches. Sage.
Geertz, C. (1973). The Interpretation of Cultures. Basic Books. (The origin of "Thick
Description").
Charmaz, K. (2014). Constructing Grounded Theory. Sage.
Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative Data Analysis: A Methods
Sourcebook. Sage.
Creswell, J. W., & Plano Clark, V. L. (2017). Designing and Conducting Mixed Methods Research.
Sage.
Tashakkori, A., & Teddlie, C. (2010). Sage Handbook of Mixed Methods in Social & Behavioral
Research. Sage.
Bryman, A. (2006). "Integrating quantitative and qualitative research: how is it done?"
Qualitative Research, 6(1), 97–113.
The Belmont Report (1979). Ethical Principles and Guidelines for the Protection of Human
Subjects of Research.
Kozinets, R. V. (2015). Netnography: Redefined. Sage. (The primary source for online
ethnography).
Salganik, M. J. (2017). Bit by Bit: Social Research in the Digital Age. Princeton University Press.
(Focuses on Big Data and Ethics).
Higgins, J. P., & Green, S. (2011). Cochrane Handbook for Systematic Reviews of Interventions.
Wiley-Blackwell.
Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to Meta-
Analysis. Wiley.