Module 3
Module 3
Document analysis is the process of reviewing or evaluating documents both printed and
electronic in a methodical manner. The document analysis method, like many other qualitative
research methods, involves examining and interpreting data to uncover meaning, gain
understanding, and come to a conclusion.
Document analysis pertains to the process of interpreting documents for an assessment topic by
the researcher as a means of giving voice and meaning. In Document Analysis as a Qualitative
Research Method by Glenn A. Bowen, document analysis is described as, “... a systematic
procedure for reviewing or evaluating documents—both printed and electronic (computer-
based and Internet-transmitted) material. Like other analytical methods in qualitative
research, document analysis requires that data be examined and interpreted in order to
elicit meaning, gain understanding, and develop empirical knowledge.”
During the analysis of documents, the content is categorized into distinct themes, similar to the
way transcripts from interviews or focus groups are analyzed. The documents may also be
graded or scored using a rubric.
Document analysis is a social research method of great value, and it plays a crucial role in most
triangulation methods, combining various methods to study a particular phenomenon.
The qualitative researcher generally makes use of two or more resources, each using a different
data source and methodology, to achieve convergence and corroboration. An important purpose
of triangulating evidence is to establish credibility through a convergence of evidence.
Corroboration of findings across data sets reduces the possibility of bias, by examining data
gathered in different ways.
It is important to note that document analysis differs from content analysis as content analysis
refers to more than documents. As part of their definition for content analysis, Columbia
Mailman School of Public Health states that, “Sources of data could be from interviews, open-
ended questions, field research notes, conversations, or literally any occurrence of
communicative language (such as books, essays, discussions, newspaper headlines, speeches,
media, historical documents).
In order for a researcher to obtain reliable results from document analysis, a detailed planning
process must be undertaken. The following is an outline of an eight-step planning process that
should be employed in all textual analysis including document analysis techniques.
1. Identify the texts you want to analyze such as samples, population, participants, and
respondents.
2. You should consider how texts will be accessed, paying attention to any cultural or
linguistic barriers.
3. Acknowledge and resolve biases.
4. Acquire appropriate research skills.
5. Strategize for ensuring credibility.
6. Identify the data that is being sought.
7. Take into account ethical issues.
8. Keep a backup plan handy.
You can triangulate your claims about the phenomenon being studied
using document analysis by using multiple sources and other research
gathering methods.
Below are the advantages and disadvantages of document
analysis
Advantages
Disadvantages
It is likely that the documents researchers obtain are not complete or written objectively,
requiring researchers to adopt a critical approach and not assume their contents are
reliable or unbiased.
There may be a risk of information overload due to the number of documents involved.
Researchers often have difficulties determining what parts of each document are relevant
to the topic being studied.
It may be necessary to anonymize documents and compare them with other documents
Documenting the System
In one sense, every information systems development project is unique and will generate
its own unique documentation. In another sense, though, system development projects are
probably more alike than they are different.
Each project shares a similar systems development life cycle, which dictates that certain
activities be undertaken and that each of those activities be documented. Specific
documentation will vary depending on the life cycle you are following, and the format
and content of the documentation may be mandated by the organization you work for.
Start developing documentation elements early, as the information needed is captured.
We can simplify the situation by dividing the types of documentation into two basic
types.
User documentation.
SYSTEM DOCUMENTATION
Records detailed information about a system’s design specifications, its internal
workings, and its functionality. System documentation can be further divided
into internal and external documentation.
INTERNAL DOCUMENTATION
USER DOCUMENTATION
Is written or other visual information about how an application system works and how to
use it. Although not part of the code itself, external documentation can provide useful
information to the primary users of system documentation—maintenance programmers.
For example, data-flow diagrams provide a good overview of a system’s structure. In the
past, external documentation was typically discarded after implementation, primarily
because it was considered too costly to keep up to date but today’s integrated
development environment makes it possible to maintain and update external
documentation as long as desired.
These standards may include the outline for the project dictionary and specific pieces of
documentation within it. Standards for user documentation are not as explicit
User Documentation
Represents the content of a reference guide, just one type of user documentation. Other
types of user documentation include a quick reference guide, user’s guide, release
description, system administrator’s guide, and acceptance sign-off. Most online reference
guides allow you to search by topic area or by typing in the first few letters of your
keyword. Reference guides are great for specific information. But are not as good for the
broader picture of how to perform all the steps required for a given task. The quick
reference guide provides essential information about operating a system in a short,
concise format.
Where computer resources are shared and many users perform similar tasks on the same
machines (as with airline reservation or mail-order-catalog clerks), quick reference
guides are often printed on index cards or as small books and mounted on or near the
computer terminal. The purpose of a reference guide is to provide information on how
users can use computer systems to perform specific tasks.
The information in a user’s guide is typically ordered by how often tasks are performed
and how complex they are. Increasingly, software vendors are using Web sites to provide
additional user-guide content.
Web-based documentation allows the vendor to provide more up-to-date reference
material without issuing new software CDs. Because most software is reissued as new
features are added, a release description contains information about a new system release,
including a list of complete documentation for the new release, features and
enhancements, known problems and how they have been dealt with in the new release,
and information about installation.
A system administrator’s guide is intended primarily for a particular type of user—those
who will install and administer a new system—and contains information about the
network on which the system will run, software interfaces for peripherals such as
printers, troubleshooting, and setting up user accounts. Finally, the acceptance sign-off
allows users to test for proper system installation and then signify their acceptance of the
new system and its documentation with their signatures.
An in-depth interview
They are therefore an especially good choice for communities who have unique research goals
that do not easily fit into some of the common objectives described in this manual.
1. Developing a sampling strategy (Whose attitudes and beliefs matter to your research, and how
will you find these people?)
2. Writing an in-depth interview guide (An in-depth interview guide contains the questions that
will be asked during the interview.)
Focus groups are often used in marketing, library science, social science, and user research
disciplines. They can provide more nuanced and natural feedback than individual interviews and
are easier to organize than experiments or large-scale surveys.
Note: There are a few other types of interviews you can consider as well. The three most
common options are:
Structured interviews: The questions are predetermined in both topic and order.
Semi-structured interviews: A few questions are predetermined, but other questions
aren’t planned.
Unstructured interviews: None of the questions are predetermined.
However, if your questions are dichotomous or if you need to reach a large audience quickly,
a survey may be a better option. If your question hinges upon behavior but you are worried about
influencing responses, consider an observational study.
Example: Research topicYour university dining hall is considering adding vegan meals to its
daily menu. However, the university is hesitant to do so if it will lead to increased food waste. It
needs concrete proof that vegan meals will be successful.
If you want to determine whether the student body would regularly consume vegan food,
a survey would be a great way to gauge student preferences.
However, food is much more than just consumption and nourishment and can have emotional,
cultural, and other implications on individuals.
Perhaps literature already exists on your subject or a sufficiently similar topic that you can use as
a starting point. If the topic isn’t well studied, use your instincts to determine what you think is
most worthy of study.
Setting your scope will help you formulate intriguing hypotheses, set clear questions, and recruit
the right participants.
Example: Setting your scopeYou want to determine the scope of your research, so you consider
the following questions.
Are you interested in a particular sector of the population, such as vegans or non-vegans?
Are you interested in including vegetarians in your analysis?
Perhaps not all students eat at the dining hall. Will your study exclude those who don’t?
Are you only interested in students who have strong opinions on the subject?
A benefit of focus groups is that your hypotheses can be open-ended. You can be open to a wide
variety of opinions, which can lead to unexpected conclusions.
If you are discussing a controversial topic, be careful that your questions do not cause social
desirability bias. Here, your respondents may lie about their true beliefs to mask any socially
unacceptable or unpopular opinions. This and other demand characteristics can hurt your
analysis and lead to several types of reseach bias in your results, particularly if your participants
react in a different way once knowing they’re being observed. These include self-selection bias,
the Hawthorne effect, the Pygmalion effect, and recall bias.
Examples: Focus group questions There are a few types of questions you can use:
Engagement questions make your participants feel comfortable and at ease:
“What is your favorite food at the dining hall?”
Exploration questions drill down to the focus of your analysis:
“What pros and cons of offering vegan options do you see?”
Exit questions pick up on anything you may have previously missed in your discussion:
“Is there anything you’d like to mention about vegan options in the dining hall that we
haven’t discussed?”
If your hypotheses have behavioral aspects, consider asking someone else to be lead moderator
so that you are free to take a more observational role.
Depending on your topic, there are a few types of moderator roles that you can choose
from.
Note: In certain types of focus groups (such as the dueling-moderator style), you will need to
have two moderators actively participating. In this case, it may be wise to have a third person in
the room ensuring everything runs smoothly.
Beware of sampling bias and selection bias, which can occur when some members of the
population are more likely to be included than others.
Number of participants
In most cases, one focus group will not be sufficient to answer your research question. It is likely
that you will need to schedule three to four groups. A good rule of thumb is to stop when you’ve
reached a saturation point (i.e., when you aren’t receiving new responses to your questions).
Most focus groups have 6–10 participants. It’s a good idea to over-recruit just in case someone
doesn’t show up. As a rule of thumb, you shouldn’t have fewer than 6 or more than 12
participants, in order to get the most reliable results.
Lastly, it’s preferable for your participants not to know you or each other, as this can bias your
results.
As a general rule, make sure you are in a noise-free environment that minimizes distractions and
interruptions to your participants.
Participants should also sign a release form that states that they are comfortable with being
audio- or video-recorded. While verbal consent may be sufficient, it is best to ask participants to
sign a form.
A disadvantage of focus groups is that they are too small to provide true anonymity to
participants. Make sure that your participants know this prior to participating.
There are a few things you can do to commit to keeping information private. You can
secure confidentiality by removing all identifying information from your report or offer to
pseudonymize the data later. Data pseudonymization entails replacing any identifying
information about participants with pseudonymous or false identifiers.
Consider starting out with an icebreaker, which will allow participants to relax and settle into the
space a bit. Your icebreaker can be related to your study topic or not; it’s just an exercise to get
participants talking.
You can ask less talkative member’s questions directly to encourage them to participate or ask
participants questions by name to even the playing field. Feel free to ask participants to elaborate
on their answers or to give an example.
As a moderator, strive to remain neutral. Refrain from reacting to responses, and be aware of
your body language (e.g., nodding, raising eyebrows) and the possibility for observer bias.
Active listening skills, such as parroting back answers or asking for clarification, are good
methods to encourage participation and signal that you’re listening.
Many focus groups offer a monetary incentive for participants. Depending on your research
budget, this is a nice way to show appreciation for their time and commitment. To keep everyone
feeling fresh, consider offering snacks or drinks as well.
Step 8: Analyze your data and report your results
After concluding your focus group, you and your co-moderator should debrief, recording initial
impressions of the discussion as well as any highlights, issues, or immediate conclusions you’ve
drawn.
The next step is to transcribe and clean your data. Assign each participant a number or
pseudonym for organizational purposes. Transcribe the recordings and conduct content
analysis to look for themes or categories of responses. The categories you choose can then form
the basis for reporting your results.
Advantages
They are fairly straightforward to organize and results have strong face validity.
They are usually inexpensive, even if you compensate participant.
A focus group is much less time-consuming than a survey or experiment, and you get
immediate results.
Focus group results are often more comprehensible and intuitive than raw data.
Disadvantages
It can be difficult to assemble a truly representative sample. Focus groups are generally
not considered externally valid due to their small sample sizes.
Due to the small sample size, you cannot ensure the anonymity of respondents, which
may influence their desire to speak freely.
Depth of analysis can be a concern, as it can be challenging to get honest opinions on
controversial topics.
There is a lot of room for error in the data analysis and high potential for observer
dependency in drawing conclusions. You have to be careful not to cherry-pick responses
to fit a prior conclusion.
Content analysis
Content analysis is a research tool used to determine the presence of certain words, themes, or
concepts within some given qualitative data (i.e. text). Using content analysis, researchers can
quantify and analyze the presence, meanings, and relationships of such certain words, themes, or
concepts.
Content analysis can be used to quantify the occurrence of certain words, phrases, subjects or
concepts in a set of historical or contemporary texts.
You can analyze communication and social interaction without the direct involvement of
participants, so your presence as a researcher doesn’t influence the results.
When done well, content analysis follows a systematic procedure that can easily be replicated by
other researchers, yielding results with high reliability.
Highly flexible
You can conduct content analysis at any time, in any location, and at low cost – all you need is
access to the appropriate sources.
Reductive
Subjective
Content analysis almost always involves some level of subjective interpretation, which can affect
the reliability and validity of the results and conclusions, leading to various types of research
bias and cognitive bias.
Time intensive
Manually coding large volumes of text is extremely time-consuming, and it can be difficult to
automate effectively.
The medium (e.g. newspapers, speeches or websites) and genre (e.g. opinion pieces,
political campaign speeches, or marketing copy)
The inclusion and exclusion criteria (e.g. newspaper articles that mention a particular
event, speeches by a certain politician, or websites selling a specific type of product)
The parameters in terms of date range, location, etc.
If there are only a small amount of texts that meet your criteria, you might analyze all of them. If
there is a large volume of texts, you can select a sample.
To research media representations of younger and older politicians, you decide to analyze news
articles and opinion pieces in print newspapers between 2017–2019. Because this is a very large
volume of content, you choose three major national newspapers and sample only Monday and
Friday editions.
The unit(s) of meaning that will be coded. For example, are you going to record the
frequency of individual words and phrases, the characteristics of people who produced or
appear in the texts, the presence and positioning of images, or the treatment of themes
and concepts?
The set of categories that you will use for coding. Categories can be objective
characteristics (e.g. aged 30-40, lawyer, parent) or more conceptual
(e.g. trustworthy, corrupt, conservative, family oriented).
Your units of analysis are the politicians who appear in each article and the words and phrases
that are used to describe them. Based on your research question, you have to categorize based on
age and the concept of trustworthiness. To get more detailed data, you also code for other
categories such as their political party and the marital status of each politician mentioned.
Coding rules are especially important if multiple researchers are involved, but even if you’re
coding all of the text by yourself, recording the rules makes your method more transparent and
reliable.
In considering the category “younger politician,” you decide which titles will be coded with this
category (senator, governor, counselor, mayor). With “trustworthy”, you decide which specific
words or phrases related to trustworthiness (e.g. honest and reliable) will be coded in this
category.
Following your coding rules, you examine each newspaper article in your sample. You record
the characteristics of each politician mentioned, along with all words and phrases related to
trustworthiness that are used to describe them.
Let’s say the results reveal that words and phrases related to trustworthiness appeared in the
same sentence as an older politician more frequently than they did in the same sentence as a
younger politician. From these results, you conclude that national newspapers present older
politicians as more trustworthy than younger politicians, and infer that this might have an effect
on readers’ perceptions of younger people in politics.
Narrative Analysis
What is narrative analysis in qualitative research?
Researchers use narrative analysis to understand how research participants construct story and
narrative from their own personal experience. That means there is a dual layer of interpretation
in narrative analysis. First the research participants interpret their own lives through narrative.
Then the researcher interprets the construction of that narrative.
Personal narratives come in a variety of forms and can all be used in narrative research.
Topical stories
o A restricted story about one specific moment in time with a plot, characters, and
setting, but doesn’t encompass the entirety of a person’s life. Example: a
research participant’s answer to a single interview question
Personal narrative
o Personal narratives come from a long interview or a series of long narrative
interviews that give an extended account of someone’s life. Example: a
researcher conducting an in-depth interview, or a series of in-depth interviews
with an individual over an extended period of time.
Entire life story
o Constructed from a collection of interviews, observations, and documents about
a person’s life. Example: a historian putting together the biography of
someone’s life from past artifacts.
Inductively code the narrative blocks you find in your interviews. You should code
narrative blocks about similar “life events” with the same code.
For example, stories about how someone decided to have children could be coded
as “Narratives about deciding to have children”.
Read over all the narratives that you coded with the same “life event” code. As
you do so, note their similarities and differences. This is the beginning of your
analysis!
For every “life event” code, create and nest codes based on your story structure
framework of choice. For example:
Now break up your narrative blocks, by applying these story structure codes.
Now you can collate each life event by its story structure code. For example within
“narratives about deciding to have children'', you can focus on “Orientation”. In all
the stories about deciding to have children, you can compare and contrast how
different research participants oriented their stories. The similarities and
differences can be written down as you observe them. Differences can be further
coded to help with later analysis. For example, if it was common for your
participants to talk about their parent’s marital status, you may end up with the
following code structure.
As you break up your narrative blocks by story structure, do not lose sight of the
overarching narrative. Switch between reading your narrative blocks as a whole,
and diving into each individual story structure code. Pay attention to how story
structure codes relate across a life event.
For example, participants who talked about their parents’ divorce, may construct
meaning differently than those whose parents remained together. You may
discover this finding by comparing “Orientation” with “Evaluation”.
At the end of these steps, you will have fully explored each narrative block. You
will have a deep understanding of how your research participants self-narrate their
lives. You will have observed how your participants' stories relate, but also how
they diverge. And through the process, you may have a theory why these stories
diverge.
For each life-event take the structure you used (in our example Patterson’s Abstract,
Orientation, etc…) and write a core narrative that encapsulates the commonalities between
your participants. If you have found fundamental differences within your research base, you
can capture that nuance in a single core narrative. Alternatively, you can break a life event into
two core narratives and compare them. In our example above we may write one core narrative
from the perspective of participants whose parents divorced and another perspective of
participants whose parents stayed together.
Conversation Analysis, also known as CA, is the study of the structure and organization of
conversation, as well as the social rules that govern how people interact in a conversational
setting. It involves observing and understanding the patterns of communication, the roles of
participants, and the way language is used to create meaning. By analysing these elements,
researchers can uncover the hidden mechanics that drive everyday talk and explore how
interaction is structured and organized to achieve particular outcomes.
Conversation Analysis is a research method that examines the structure and organization of
talk during social interactions, with the aim of understanding how communication works and
the social rules that underpin it.
Conversation Analysis plays a vital role in linguistics as it provides insights into how language
works in real-life situations. By understanding the dynamics of conversations and the linguistic
techniques that speakers use to convey meaning, we can gain a deeper appreciation of the
complexities of human communication. Some specific ways Conversation Analysis contributes
to linguistics include:
Examining turn-taking, repair, and other practices within conversations that shed light on the
structure and function of language.
Studying how conversation shapes and is shaped by social context, revealing the impact of
culture, power dynamics, and other factors on language use.
Analyzing the interactions between moods, emotions, and language, which can offer valuable
insights into the expressive potential of words and grammar.
A popular way of viewing discourse is as language used in specific social contexts, and as such
language serves as a means of prompting some form of social change or meeting some form
of goal.
Ethnography, descriptive study of a particular human society or the process of making such
a study. Contemporary ethnography is based almost entirely on fieldwork and requires the
complete immersion of the anthropologist in the culture and everyday life of the people
who are the subject of his study.
There has been some confusion regarding the terms ethnography and ethnology. The latter, a
term more widely used in Europe, encompasses the analytical and comparative study
of cultures in general, which in American usage is the academic field known as cultural
anthropology (in British usage, social anthropology). Increasingly, however, the distinction
between the two is coming to be seen as existing more in theory than in fact. Ethnography, by
virtue of its inter subjective nature, is necessarily comparative. Given that the anthropologist in
the field necessarily retains certain cultural biases, his observations and descriptions must, to a
certain degree, be comparative. Thus the formulating of generalizations about culture and the
drawing of comparisons inevitably become components of ethnography.
Ethnography is a qualitative method for collecting data often used in the social and behavioral
sciences. Data are collected through observations and interviews, which are then used to draw
conclusions about how societies and individuals function. Ethnographers observe life as it
happens instead of trying to manipulate it in a lab. Because of the unpredictability of life,
ethnographers often find is challenging to nail down their projects in a protocol for the Board to
review. Nevertheless, the Board needs a good explanation of a study in order to approve it.
Helping the Board to understand the parameters of the study, the situations in which the
participants will be contacted and will participate, and the risks involved will allow them to
approve studies where some flexibility is needed.
STIMULATED RECALL
The term ' stimulated recall ' has been used to denote a variety of techniques. Typically, it
involves the use of audiotapes or videotapes of skilled behavior, which are used to aid a
participant's recall of his thought processes at the time of that behavior.
Visual interpretation with special emphasis upon the analysis aspects and its implications
for decision making
Visual perception is the ability to interpret information and surroundings from the effects of
visible light reaching the eye.
Visual image interpretation is very useful in various fields such as geography, geology,
agriculture, forestry, environment, ocean studies, wetlands,
Conservation of natural resources, urban and regional planning, defense and many other
purposes.