Understanding Quantitative Research Methods
Understanding Quantitative Research Methods
8
THE NATURE OF
QUANTITATIVE RESEARCH
The main steps in quantitative research 164 The connection between reliability and validity 175
CHAPTER OUTLINE
This chapter is concerned with the logic and key features of quantitative research. Broadly, quantitative
research covers approaches which attempt to measure and/or count social phenomena and the
relationships between them. This approach has long been the dominant one for conducting business
research and remains so, in spite of qualitative research becoming more influential since the 1980s. The
emphasis in this chapter is very much on what quantitative research typically entails, although at a later
point in the chapter some of the ways in which there are often departures from this ideal type are
outlined. This chapter explores the following areas:
• the main steps of quantitative research, which are presented as a linear succession of stages;
164 8 The nature of quantitative research
• the importance of concepts in quantitative research and • the main preoccupations of quantitative research,
the ways in which measures may be devised for concepts; which are described in terms of four features—
this includes a discussion of the important idea of an measurement, causality, generalization, and
indicator, which is devised as a way of measuring a replication;
concept for which there is no direct measure;
• some criticisms that are levelled at quantitative
• the procedures for checking the reliability and validity research.
of the measurement process;
Introduction
In Chapter 2, quantitative research was outlined as a not be taken to mean that quantification of aspects of
distinctive research strategy. In very broad terms, it was social life is all that distinguishes it from a qualitative
described as involving the collection of numerical data research strategy. The very fact that it has a distinctive
and as exhibiting a view of the relationship between the- epistemological and ontological position suggests that
ory and research as deductive, a predilection for a natural there is a good deal more to it than the mere presence
science approach (and for positivism in particular), and an of numbers. In this chapter, as well as outlining the
objectivist conception of social reality. A number of other main steps in quantitative research, we also examine
features of quantitative research were outlined, but in this some of the principal preoccupations of the strategy
chapter we will examine the strategy in much more detail. and how certain issues of concern among practitioners
It should be made clear that the description of this are addressed, such as questions about measurement
research strategy as ‘quantitative research’ should validity.
1. Elaborate theory
2. Devise hypothesis
6. Select research
subjects/respondents
7. Administer research
instruments/collect data
8. Process data
9. Analyse data
(Experimental researchers tend to call the people on by which researchers might go about selecting research
whom they conduct research ‘subjects’, whereas social sites and sampling respondents. In experimental research,
survey researchers typically call them ‘respondents’.) these two steps are likely to include the assignment of sub-
Thus, in social survey research an investigator must first jects into control and treatment groups.
be concerned to establish an appropriate setting for his or Step 7 involves the administration of the research
her research. Research in focus 8.1 illustrates the process instrument(s). In experimental research, this is likely
166 8 The nature of quantitative research
1. A bank/insurance company: included because these organizations are often at the forefront of supportive
work–life policies and are highly visible, therefore susceptible to institutional pressures to provide work–life
balance support (total of 1918 respondents).
2. A retail company: chains of shops were included because of the higher proportion of lower-skilled jobs and
female workers employed there (total of 1670 respondents).
3. An information technology (IT)/telecom company: included because of the high proportion of professional
workers and the highly competitive nature of careers in these organizations (total of 2628 respondents).
4. A public hospital: large hospitals in major cities were included as representative of public sector organizations
(total of 1651 respondents).
Because this was a non-random quota sample selected to represent various categories of organization (sampling
will be discussed in detail in Chapter 9), attempts were made in each country to select similar service sector
organizations in order to increase comparability. These sector comparisons acted as a control variable on the
sample. A questionnaire survey was developed by the researchers and translated into the language of each
country, before being back-translated for comparability. Employees in the selected organizations received a letter
in which they were asked to fill in the questionnaire, either on paper or online (see Chapter 11 for more about
questionnaires and online surveys). The response rates in different countries were variable, ranging from 17 per
cent (Hungary and the UK both being low) to 89 per cent (Bulgaria, Finland, and Sweden being relatively high).
These findings enabled the researchers to trace differences between countries in terms of the level of support
available (from the state, the workplace, and the family) for the development of work–life balance.
to mean pre-testing subjects, manipulating the independ- Step 8 simply refers to the fact that, once information
ent variable for the experimental group, and post-testing has been collected, it must be transformed into ‘data’. In
subjects. In cross-sectional research using social survey the context of quantitative research, this is likely to mean
research instruments, it will involve interviewing the that it must be prepared so that it can be quantified. With
sample members using a structured interview schedule some kinds of information this can be done in a relatively
(discussed in Chapter 10) or distributing a self-completion straightforward way—for example, for information
questionnaire (Chapter 11). In research using structured relating to such things as people’s ages, incomes, num-
observation (Chapter 13), this step will mean an observer ber of years spent at school, and so on. For other variables
(or possibly more than one) watching the setting and that are not readily measured in numbers, e.g. job sat-
the behaviour of people and then assigning categories to isfaction, quantification will entail coding the informa-
each element of behaviour. tion—that is, transforming it into numbers to facilitate
Concepts and their measurement 167
the quantitative analysis of the data, particularly if the convinced that the research conclusions are important
analysis is going to be carried out by computer. ‘Codes’ and that the findings are robust. Thus, a significant part
act as tags that are placed on data about people to allow of the research process involves convincing others of the
the information to be processed by the computer. This significance and validity of one’s findings.
consideration leads into Step 9—the analysis of the data. Once the findings have been published, they become
In this step, the researcher uses techniques of quantita- part of the stock of knowledge (or ‘theory’ in the loose
tive data analysis to reduce the amount of data collected, sense of the word) in their domain. Thus, there is a feed-
to test for relationships between variables, to develop back loop from Step 11 back up to Step 1. The presence
ways of presenting the results of the analysis to others, of both an element of deductivism (Step 2) and induc-
and so on. tivism (the feedback loop) is indicative of the positivist
The researcher must then interpret the results of the foundations of quantitative research (see Key concept
data analysis. It is at this stage that the ‘findings’ will 2.10). Similarly, the emphasis on the translation of
emerge (Step 10). The researcher will consider the con- concepts into measures (Step 4) is symptomatic of the
nections between the findings and the theorizing that principle of phenomenalism, which is also a feature of
acted as the impetus of the research. If there is a hypoth- positivism. It is to this important phase of translating
esis, is it supported or disproven? What are the implica- concepts into measures that we now turn. As we will see,
tions of the findings for the theoretical ideas that formed certain considerations follow on from the stress placed
the background to the research? on measurement in quantitative research. By and large,
Then the research must be written up (Step 11—cov- these considerations are to do with the validity and reli-
ered in Chapter 7 of this book). The research cannot take ability of the measures devised by social scientists. These
on significance beyond satisfying the researcher’s per- considerations will figure prominently in the following
sonal curiosity until it enters the public domain in some discussion.
way, by being written up as a paper to be presented at As we noted before presenting the model in Figure 8.1,
a conference, or as a report to the agency that funded this sequence of stages is a kind of ideal-typical account,
the research, or as a book or journal article for academic and in practice not all quantitative research will adhere
business researchers. In writing up the findings and to these steps. At the end of this chapter, the section ‘Is it
conclusions, the researcher is doing more than simply always like this?’ deals with some ways in which practice
relaying to others what has been found: readers must be may diverge from this model.
We use indicators to tap concepts that are less directly quantifiable. If we are interested in the causes of variation
in job satisfaction, we will need indicators that will stand for the concept of job satisfaction. These indicators will
allow job satisfaction to be measured and we can treat the resulting quantitative information as if it were a
measure. An indicator, then, is something that is devised or already exists and that is employed as though it were
a measure of a concept. It is viewed as an indirect measure of a concept such as job satisfaction. An IQ test is a
further example, in that it is a battery of indicators of the concept of intelligence.
We see here a second distinction: between direct and indirect indicators of concepts. Indicators may be direct or
indirect in their relationship to the concepts for which they stand. Thus, an indicator of marital status (‘married’ /
‘single’) has a much more direct relationship to its concept than an indicator (or set of indicators) relating to job
satisfaction. Sets of attitudes always need to be measured by batteries of indirect indicators. So too do many
forms of behaviour. When indicators are used that are not true quantities, they will need to be coded to be turned
into quantities. Directness and indirectness are not qualities inherent to indicators: a particular indicator may be
direct or indirect, depending on how it is applied. Data from a survey question on amount earned per month may
be a direct measure of personal income, but if we treat amount earned per month as an indicator of social class,
it becomes an indirect measure. The issue of indirectness raises the question of where an indirect measure
comes from—that is, how does a researcher devise an indicator of something like job satisfaction? Usually, it is
based on common-sense understandings of the forms the concept takes or on anecdotal or qualitative evidence
relating to that concept. Many phenomena will already have been measured in prior research; in such cases,
quantitative researchers often choose to use indicators which have been developed and validated in prior
published work, rather than attempting to develop new ones.
170 8 The nature of quantitative research
Respondents were also asked to judge the extent to which they thought their peers believed the action was ethical,
using the same scale. Finally, using the same type of Likert scale, they were asked to evaluate the frequency with
which they and their peers act in the way implied by the statement: 1 = infrequently, 5 = frequently. ‘Hence,
respondents make a judgement as to the extent to which they believe (or they think their colleagues believe) an
action is ethical: the higher the score, the higher the belief that the action is ethical’ (2001: 1283). The study
found that, across all national groups, managers saw their colleagues as less ethical than themselves. The findings
also supported the view that ethical attitudes vary according to cultural context.
In addition, a particular employee’s response to favourable job characteristics is affected by his or her ‘growth
need strength’—that is, his or her need for personal growth and development. It is expected that favourable work
outcomes will occur when workers experience jobs with positive core characteristics; this in turn will stimulate
critical psychological states.
In order to measure these factors, Hackman and Oldham devised the Job Diagnostic Survey (JDS), a lengthy
questionnaire that can be used to determine the Motivating Potential Score (MPS) of a particular job—that is, the
extent to which it possesses characteristics that are necessary to influence motivation. Below are the five
dimensions; in each case an example is given of an item that can be used to measure it:
1. Skill variety: ‘The job requires me to use a number of complex or high-level skills.’
2. Task identity: ‘The job provides me with the chance completely to finish the pieces of work I begin.’
3. Task significance: ‘This job is one where a lot of other people can be affected by how well the work gets done.’
4. Autonomy: ‘The job gives me considerable opportunity for independence and freedom in how I do the work.’
5. Feedback: ‘The job itself provides plenty of clues about whether or not I am performing well.’
Respondents are asked to indicate how far they think each statement is accurate, from 1 = very inaccurate to 7 =
very accurate. In Hackman and Oldham’s initial study, the JDS was administered to 658 individuals working in 62
different jobs across 7 organizations. Interpreting an individual’s MPS score involves comparison with norms for
specific job ‘families’, which were generated on the basis of this original sample. For example, professional/
technical jobs have an average MPS of 154, whereas clerical jobs normally have a score of 106. Understanding
the motivational potential of job content thus relies on interpretation of the MPS relative to that of other jobs and in
the context of specific job families. Workers who exhibit adequate knowledge, high growth need strength, and skill,
and who are satisfied with their job context, are expected to respond best to jobs with a high MPS.
Nonetheless, the use of single indicators of concepts increase was from an already high level. The increase in
is widespread. Boyd et al. (2012) have expressed con- the use of single indicators was particularly prominent
cern about the fact that comparing articles published in for measures of dependent variables, with an increase
Strategic Management Journal in 1998–2000 with those from 57.7 per cent of articles in the earlier period to
published in 2010, there has been an increase in the pro- 76.5 per cent in 2010. It would be a mistake, however,
portion of articles using single indicators. Moreover, this to believe that investigations that use a single indicator
172 8 The nature of quantitative research
of core concepts are somehow deficient. In any case, measures are reliable and whether or not they are valid
some studies employ both single- and multiple-indicator representations of the concepts they are supposed to be
measures of concepts. What is crucial is whether or not tapping. It is to this issue that we now turn.
Reliability of measures
Although the terms ‘reliability’ and ‘validity’ seem to be If the measure is stable, we should expect to find a high
almost synonyms, they have quite different meanings in correlation between Obs1 and Obs2. Correlation is a
relation to the evaluation of measures of concepts, as was measure of the strength of the relationship between two
seen in Chapter 3. We deal with reliability in this section variables. This topic will be covered in Chapter 15 in the
of the chapter and with validity in the next. As Key con- context of a discussion about quantitative data analy-
cept 8.5 suggests, reliability is fundamentally concerned sis. Let us imagine that we develop a multiple-indicator
with issues of consistency of measures. There are at least measure that is supposed to tap a concept that we might
three different meanings of the term ‘reliability’: stability, call ‘designerism’ (a preference for buying goods, and
internal reliability, and inter-rater reliability. These are out- especially clothing, with ‘designer’ labels). We would
lined in Key concept 8.5 and elaborated upon in the next administer the measure to a sample of respondents and
three subsections of this chapter. readminister it some time later. If the correlation is low,
the measure would appear to be unstable, implying that
Stability respondents’ answers cannot be relied upon as an indica-
tion of ‘designerism’.
The most obvious way of testing for the stability of a mea- However, there are a number of problems with this
sure is the test–retest method. This involves administering approach to evaluating reliability. First, respondents’
a test or measure on one occasion and then readminister- answers at T1 may influence how they reply at T2. This
ing it to the same sample on another occasion, i.e. may result in greater consistency between Obs1 and
T1 T2 Obs2 than is in fact the case. Secondly, events may
intervene between T1 and T2 that influence the degree
Obs1 Obs2
• Stability. This consideration entails asking whether or not a measure is stable over time, so that we can be
confident that the results relating to that measure for a sample of respondents do not fluctuate. This means
that, if we administer a measure to a group and then readminister it, there will be little variation over time in
the results obtained.
• Internal reliability. The key issue here is whether or not the indicators that make up the scale or index for a
concept are consistent among themselves—in other words, whether or not respondents’ scores on any one
indicator tend to be related to their scores on the other indicators associated with that concept.
• Inter-rater reliability. When a great deal of subjective judgement is involved in the recording of observations or
the translation of data into categories and where more than one rater is involved in such activities, there is the
possibility that there is a lack of consistency in their decisions. This can arise in a number of contexts: for
example, when answers to open-ended questions have to be categorized; where decisions have to be made
about how to categorize media items, as in content analysis (discussed in Chapter 13); or when observers
have to decide how to classify subjects’ behaviour, as in structured observation (Chapter 13).
Reliability of measures 173
of consistency. For example, if a long span of time is indicators would be allocated on a random or an odd–
involved, changes in the economy or in respondents’ per- even basis. The degree of correlation between scores
sonal financial circumstances could influence their views on the two halves would then be calculated. In other
about and predilection for designer goods. Of course, if words, the aim would be to establish whether respon-
we were measuring something which is relatively stable dents scoring high on one of the two groups also scored
over time, for example aspects of personality, then we high on the other group of indicators. The calculation
would not expect this problem to manifest itself. There of the correlation will yield a figure, known as a coef-
are no obvious solutions to these problems, other than ficient, that varies between 0 (no correlation and there-
by introducing a complex research design and so turning fore no internal consistency) and 1 (perfect correlation
the investigation of reliability into a major project in its and therefore complete internal consistency). It is usu-
own right. Perhaps for these reasons, many if not most ally accepted that a result of 0.8 and above implies an
reports of research findings do not appear to carry out acceptable level of internal reliability, although for
tests of stability. many purposes 0.7 and above is accepted. Do not worry
if these figures appear somewhat opaque. The meaning
of correlation will be explored in much greater detail
Internal reliability later on. The chief point to carry away with you at this
This meaning of reliability applies to multiple-indicator stage is that the correlation establishes how closely
measures such as those examined in Research in focus respondents’ scores on the two groups of indicators are
8.3 and 8.4. When you have a multiple-item measure in related.
which each respondent’s answers to each question are Nowadays, most researchers use a test of internal
aggregated to form an overall score, the possibility is reliability known as Cronbach’s alpha (see Key con-
raised that the indicators do not relate to the same con- cept 8.6). Its use has grown as a result of its incorpo-
cept; in other words, they lack coherence. We need to ration into computer software for quantitative data
be sure that all our designerism indicators are related analysis.
to each other. If they are not, some of the items may
actually be unrelated to designerism and therefore
Inter-rater reliability
indicative of something else. An example of a study
that assessed internal reliability is given in Research in The idea of inter-rater reliability is briefly outlined in
focus 8.8. Key concept 8.5. The issues involved are rather too
One way of testing internal reliability is the split-half advanced to be dealt with at this stage and will be
method. We can take the management ethics measure briefly touched on in later chapters. Cramer (1998:
developed by Terence Jackson (2001) as an example Chapter 14) provides a very detailed treatment of the
(see Research in focus 8.3). The twelve indicators would issues around inter-rater reliability and appropriate
be divided into two halves, with six in each group. The techniques.
Validity of measures
As noted in Chapter 3, the issue of measurement valid- test in order to establish the quality of some measures in
ity has to do with whether or not a measure of a con- the field of strategic management.
cept really measures that concept (see Key concept 8.7).
When people argue about whether or not a person’s IQ
Concurrent validity
score really measures or reflects that person’s level of
intelligence, they are raising questions about the mea- The researcher might seek also to gauge the concurrent
surement validity of the IQ test in relation to the concept validity of the measure. Here the researcher employs a
of intelligence. Similarly, one often hears people say that criterion on which cases (for example, people) are known
they do not believe that the UK’s Retail Price Index really to differ and that is relevant to the concept in question. A
reflects inflation and the rise in the cost of living. Again, new measure of job satisfaction can serve as an example.
in such comments a query is being raised about measure- A criterion might be absenteeism, because some people
ment validity. And whenever students or lecturers debate are more often absent from work (other than through
whether or not formal examinations provide an accurate illness) than others. In order to establish the concurrent
measure of academic ability, they too are raising ques- validity of a measure of job satisfaction, we might see if
tions about measurement validity. people who are satisfied with their jobs are less likely
Writers distinguish between a number of ways of test- than those who are not satisfied to be absent from work.
ing measurement validity, which really reflect different If a lack of correspondence was found, such as frequent
ways of gauging the validity of a measure of a concept. absentees not having lower levels of job satisfaction than
These different ways of testing validity will now be other employees, doubt might be cast on whether or
outlined. not our measure is really addressing job satisfaction. An
example of a study that measured concurrent validity is
given in Research in focus 8.8.
Face validity
At the very minimum, a researcher who develops a new
measure should establish that it has face validity—that is,
Predictive validity
that the measure apparently reflects the content of the Another possible test for the validity of a new measure is
concept in question. Face validity might be established by predictive validity, whereby the researcher uses a future
asking other people whether or not the measure seems criterion measure, rather than a contemporary one as
to be getting at the concept that is the focus of attention. in the case of concurrent validity. With predictive valid-
In other words, people, possibly those with experience ity, the researcher would take future levels of absentee-
or expertise in a field, might be asked to act as judges to ism as the criterion against which the validity of a new
determine whether or not, on the face of it, the measure measure of job satisfaction would be examined. The dif-
seems to reflect the concept concerned. Face validity is, ference from concurrent validity is that a future rather
therefore, an essentially intuitive process. See Research than a simultaneous criterion measure is employed.
in focus 14.7 for a discussion that uses the face validity Research in focus 8.8 provides an example of research
1. Human relations model: the extent of feelings of belonging and trust in the organization and the degree to
which there is training, good communication, and supervisory support.
2. Internal process model: the degree of emphasis on formal rules and on traditional ways of doing things.
3. Open systems model: the extent to which flexibility and innovativeness are valued.
4. Rational goal model: the degree to which clearly defined objectives and the norms and values associated with
efficiency, quality, and high performance are emphasized.
An Organizational Climate Measure, comprising 95 items in a 4-point Likert format (definitely false, mostly false,
mostly true, definitely true) was developed and administered to employees in 55 organizations, with 6869
completing a questionnaire—a response rate of 57 per cent. A factor analysis (see Key concept 8.10) was
conducted to explore the extent to which there were distinct groupings of items that tended to go together. This
procedure yielded 17 scales, such as autonomy, involvement, innovation and flexibility, and clarity of
organizational goals.
The internal reliability of the scales was assessed using Cronbach’s alpha, showing that all scales were at a level of
0.73 or above. This suggests that the measure’s constituent scales were internally reliable.
Concurrent validity was assessed following semi-structured interviews with each company’s managers in
connection with their organization’s practices. The interview data were coded to provide criteria against which the
validity of the scales could be gauged. In most cases, the scales were found to be concurrently valid. For example,
the researchers examined the correlation between a scale designed to measure the emphasis on tradition and the
degree to which practices associated with the ‘new manufacturing paradigm’ (Patterson et al. 2005: 397) were
adopted, as revealed by the interview data. The correlation was −0.42, implying that those firms that were
perceived as rooted in tradition tended to be less likely to adopt new manufacturing practices. Here the adoption
of new manufacturing practices was treated as a criterion to assess the extent to which the scale measuring
perceptions of tradition really was addressing tradition. If the correlation had been small or positive, the concurrent
validity of the scale would have been in doubt.
To assess predictive validity, the researchers asked a senior key informant at each company to complete a
questionnaire one year after the main survey had been conducted. The questionnaire was meant to address two of
the measure’s constituent scales, one of which was the innovation and flexibility scale. It asked the informants to
assess their companies in terms of their innovativeness in a number of areas. For example, the correlation
between the innovation and flexibility scale and informants’ assessment of their companies in terms of
innovativeness with respect to actual products achieved a correlation of 0.53. This implies that there was indeed a
correlation between perceptions of innovativeness and flexibility and a subsequent indicator of innovativeness.
answer is that it will be representative of the population the intrusion of the researcher’s values would appear to
from which it was selected. This is certainly the answer be much greater when examining the social world than
that sampling theory gives us. Strictly speaking, we can- when the natural scientist investigates the natural order.
not generalize beyond that population. This means that, Consequently, it is often regarded as important that the
if the members of the population from which a sample is researcher spells out clearly his or her procedures so that
taken are all inhabitants of a town, city, or region, or are they can be replicated by others, even if the research
all members of an organization, we can generalize only does not end up being replicated. The study by Schutte
to the inhabitants or members of that town, city, region, et al. (2000) described in Research in focus 8.9 relies on
or organization. But it is very tempting to see the findings replication of the Maslach Burnout Inventory—General
as having a more pervasive applicability, so that, even Survey, a psychological measure that has been used by
if the sample was selected from a single large organiza- the authors to test for emotional exhaustion, deperson-
tion such as IBM, the findings are relevant to all similar alization, and reduced personal accomplishment across
organizations. We should not make inferences beyond a range of occupational groups and nations.
the population from which the sample was selected, but It has been relatively straightforward and therefore
researchers frequently do so. The wish to be able to gen- quite common for researchers to replicate the Job Char-
eralize is often so deeply ingrained that the limits to the acteristics Model, developed by Hackman and Oldham
generalizability of findings are frequently forgotten or (1980, see Research in focus 8.4), in order to enhance
sidestepped. confidence in the theory and its findings. Several of
The concern with generalizability or external valid- these have attempted to improve the generalizability of
ity is particularly strong among quantitative researchers the model through its replication in different occupa-
using cross-sectional and longitudinal designs. There tional settings—for example, with teachers, university
is also concern about generalizability in experimental staff, nursery school teachers, and physical education
research, as the discussion of external validity in Chapter and sport administrators. However, some criticism has
3 suggests, but users of this research design usually give been levelled at the original research for failing to make
greater attention to internal validity issues. explicit how the respondent sample was selected, beyond
the fact that it involved a diverse variety of manual and
non-manual occupations in both manufacturing and ser-
Replication vice sectors; this lack of explicitness is seen to undermine
Natural scientists are often depicted as wishing to the potential generalizability of the investigation (Bry-
reduce to a bare minimum the contaminating influence man 1989a). A further criticism relates to the emphasis
of the scientist’s biases and values (Chalmers 2013). that the model places on particular characteristics of a
The results of a piece of research should be unaffected job, such as feedback from supervisors, which may be
by the researcher’s special characteristics or expecta- less of a feature in today’s working context than in the
tions. If biases and lack of objectivity were pervasive, late 1970s. A final criticism made of subsequent replica-
the claims of the natural sciences to provide a definitive tions of the initial study is that they fail to test the total
picture of the world would be seriously undermined. As model, focusing on the core job characteristics rather
a check upon the influence of these potentially damag- than incorporating the effects of the mediating psycho-
ing problems, scientists may seek to replicate—that is, logical states, which Hackman and Oldham suggest are
to reproduce—each other’s experiments. If replication the ‘causal core of the model’ (1976: 255).
failed, so that a scientist’s findings repeatedly could not A study by Johns et al. (1992) attempts to address this
be reproduced, serious questions would be raised about last criticism by specifically focusing on the mediating
the validity of his or her findings. Further, if a study can and moderating effects of psychological states on the
be replicated with consistent results in a number of dif- relationship between job characteristics and outcomes.
ferent contexts, this strengthens the case for generaliza- Basing their research on a random sample of 605 first-
tion from it (Bettis et al. 2016). Consequently, scientists and second-level managers in a large utility company
often attempt to be highly explicit about their procedures (response rate approximately 50 percent), the authors
so that an experiment is capable of replication. Like- used a slightly modified version of the JDS question-
wise, quantitative researchers in the social sciences often naire to determine the relationship between job char-
regard replication, or more precisely the ability to repli- acteristics, psychological states, and outcome variables.
cate, as an important ingredient of their activity. It is easy Their results provide some support for the mediating
to see why: the possibility of a lack of objectivity and of role of psychological states in determining outcomes
The main preoccupations of quantitative researchers 179
A study by Schutte et al. (2000) attempted to replicate these findings across a number of occupational groups
(managers, clerks, foremen, technicians, blue-collar workers) in three different nations—Finland, Sweden, and
the Netherlands. However, subsequent tests of the Maslach Burnout Inventory scale suggested a need for
revisions that would enable its use as a measure of burnout in occupational groups other than the human services,
such as nurses, teachers, and social workers, for whom the original scale was intended. Using this revised,
General Survey version, the researchers sought to investigate its factorial validity, or the extent to which the
dimensions of burnout could be measured using the same questionnaire items in relation to different occupational
and cultural groupings than the original study (see Key concept 8.10 for an explanation of factor analysis).
Following Hofstede (1984; see Chapter 2), employees were drawn from the same multinational corporation in
different countries, in order to minimize the possibility that findings would reflect ‘idiosyncracies’ associated with
one company or another. The final sample size of 9055 reflected a response rate to the questionnaire of 63
percent.
The inventory comprises three subscales, each measured in terms of a series of items. An example of each is
given below:
The individual responds according to a seven-point scale, from 0 = never, to 6 = daily. High scores on Ex and Cy
and low scores on PE are indicative of burnout. A number of statistical analyses were carried out; for example, the
reliability of the subscales was assessed using Cronbach’s alpha as an indicator of internal consistency, meeting
the criterion of 0.70 in virtually all the (sub)samples.
Furthermore, significant differences were found in the pattern of burnout among white- and blue-collar workers,
the former scoring higher on PE and lower on Cy. In interpreting these findings they argue that the higher
white-collar PE scores may have arisen because ‘working conditions are more favourable for managers than for
workers, offering more autonomy, higher job complexity, meaningful work, and more respect for co-workers’
(2000: 64).
Conversely: ‘The relatively high scores on Cy for blue-collar workers reflect indifference and a more distant attitude
towards their jobs. This might be explained by the culture on the shopfloor where distrust, resentment, and
scepticism towards management and the organization traditionally prevail’ (2000: 64).
Finally, Schutte et al. note that there were significant differences across national samples, the Dutch employees
having scores that were consistently lower than those of their Swedish or Finnish colleagues. The authors conclude
180 8 The nature of quantitative research
that the Maslach Burnout Inventory—General Survey is a suitable instrument for measuring burnout in
occupational groups other than human services and in nations other than those in North America. Although
alternative measurement scales exist, the majority of quantitative studies of burnout continue to rely on the
Maslach Burnout Inventory—General Survey and the number of studies carried out is expanding rapidly. A recent
meta-analysis (Key concept 14.8) of quantitative research on burnout identified 86 primary studies conducted
since 2000, 48 of which had been published since 2006. This demonstrates the ongoing popularity of the
measurement tool, especially in European and English-speaking countries (Reichl et al. 2014).
based on core job characteristics—however, not always was dependent on the culture of the country in which
in the way that is specified by the model. In particular, it operates. Studies conducted in China, Egypt, France,
some personal characteristics, such as educational level, Germany, India, and Japan (e.g. Shenoy 1981) sought to
were found to affect psychological states in a reverse test the proposition that some of the characteristic dif-
manner to that which was expected—those with less ferences in organizational structure originally identified
education responded more favourably to elevated psy- by the Aston researchers remained constant across these
chological states. diverse national contexts.
Another significant interest in replication stems However, replication is not a common strategy in
from the original Aston studies (see Research in focus research in the social sciences (Lucas et al. 2013).
3.5), which stimulated a plethora of replications over Standard replications do not form the basis for attrac-
a period of more than 30 years following publication tive articles, so far as many academic journal editors
of the first generation of research in the early 1960s. are concerned. Consequently, replications of research
Most clearly associated with replication were the appear in print far less frequently than might be sup-
‘fourth-generation’ Aston researchers, who undertook posed. A further reason for the low incidence of pub-
studies that: lished replications is that it is difficult to ensure in
business research that the conditions in a replication
• used a more homogenous sample drawn from a single
are precisely the same as those that pertained in an
industry, such as electrical engineering companies,
original study. So long as there is some ambiguity about
‘to further substantiate the predictive power of the
the degree to which the conditions relating to a replica-
Aston findings’ (Grinyer and Yasai-Ardekani 1980:
tion are the same as those in the initial study, any dif-
405); or
ferences in findings may be attributable to the design
• extended the original findings to other forms of organ- of the replication rather than to some deficiency in the
ization, such as churches (e.g. Hinings et al. 1976) or original study.
educational colleges (Holdaway et al. 1975). Nonetheless, it is often regarded as crucial that the
Later proponents of the ‘Aston approach’ made inter- methods taken in generating a set of findings are made
national comparisons of firms in different countries explicit, so that it is possible to replicate a piece of
in order to test the hypothesis that the relationship research. Thus, it is replicability that is often regarded as
between the context and the structure of an organization an important quality of quantitative research.
second reason why the gap can emerge is that, to a very • sensitivity to the environment;
large extent, when writing about and teaching research • unconventional behaviour;
methods we are essentially providing an account of good
• personal risk;
practice. The fact of the matter is that these practices are
often not followed in the published research that stu- • sensitivity to organizational members’ needs;
dents are likely to encounter in the substantive courses • action orientation away from the maintenance of the
that they will be taking. This failure to follow the pro- status quo.
cedures associated with good practice is not necessarily The point to note is that these six dimensions were not
due to incompetence on the part of business researchers specified at the outset: the link between conceptualiza-
(though in some cases it can be!), but is much more likely tion and measurement was an inductive one. This is not
to be associated with matters of time, cost, and feasibil- an unusual situation so far as research is concerned (Bry-
ity—in other words, the pragmatic concerns that cannot man 1988a: 26–8).
be avoided when one does business research.
estimates is necessarily unstable and invalid, but that or probability samples. However, quite a lot of research
we simply do not know. is based on non-probability samples—that is, samples
The reasons why the procedures for determining sta- that have not been selected in terms of the principles
bility and validity are not as commonly used as might be of probability sampling to be discussed in Chapter 9.
supposed are almost certainly the cost and time that are Sometimes the use of non-probability samples will be
likely to be involved. Researchers tend to be concerned due to the impossibility or extreme difficulty of obtain-
with substantive issues and are less than enthusiastic ing probability samples. Yet another reason is that the
about engaging in the kind of development work that time and cost involved in securing a probability sample
would be required for a thoroughgoing determination are too great relative to the level of resources available.
of measurement quality. These remarks on the lack of And a third reason is that sometimes the opportunity
assessment of the quality of measurement should not be to study a certain group presents itself and represents
taken as a justification for readers to neglect this phase in too good an opportunity to miss. Again, such consider-
their work. Our aim is merely to draw attention to some ations should not be viewed as a justification and hence
of the ways in which practices described in this book are a set of reasons for ignoring the principles of sampling
not always followed and to suggest some reasons why examined in the next chapter, because not following the
they are not followed. principles of probability sampling carries implications
for the kind of statistical analysis that can be employed
(see Chapter 15). Instead, our purpose, as before, is to
Sampling
draw attention to the ways in which gaps between rec-
A similar point can be made in relation to sampling, ommendations about good practice and actual research
covered in Chapter 9. As we will see, good practice is practice can arise.
strongly associated with the use of random samples
!
KEY POINTS
● Quantitative research can be characterized as a linear series of steps moving from theory to
conclusions, but the process described in Figure 8.1 is an ideal type from which there may be many
departures.
● The measurement process in quantitative research entails the search for indicators.
● Establishing the reliability and validity of measures is important for assessing their quality.
184 8 The nature of quantitative research
● Quantitative research can be characterized as exhibiting certain preoccupations, the most central of
which are: measurement; causality; generalization; and replication.
● Quantitative research has been subjected to many criticisms by qualitative researchers. These
criticisms tend to revolve around the view that a natural science model is inappropriate for studying
the social world.
ONLINE RESOURCES
[Link]/uk/brm5e/
Visit the Interactive Research Guide that accompanies this book to complete an exercise focused on
the nature of quantitative research.
144 >part II The Design of Business Research
>snapshot
What Does Cyberspace Offer for Performance Review Research?
Many successful leaders understand that performance feedback networking can be leveraged for performance review? Enterprise
is important. They know how meaningful it was to them in their Rent-a-Car encourages its employees to add a widget about
personal and career growth. As a result, many successful orga- company jobs to their personal Facebook pages, and employ-
nizations have 360-degree formal feedback systems. Employ- ees get paid if the widgets result in a hire.
ees have traditionally received this feedback through periodic Rypple is a company stepping into the social-networking-for-
surveys completed by subordinates, peers, and supervisors. performance-reviews space, taking a page from Facebook and
An Accenture study, however, shows many middle manag- Twitter, to make performance appraisal research more useful.
ers value informal feedback, because the traditional formal re- What’s a Rypple? Think of it as a Tweet with a purpose. With
view process generates less specific feedback than desired and Rypple you can ask a question like, “What can I do to make
is not timely in its delivery. So with Generation Y moving into YOU more effective in your role?” or “What can I do to help us
management roles, can human resources (HR) leverage its love be more effective in reaching our division’s goals?” Using con-
of the Web as a way to enhance informal performance review? tacts from existing sources like Outlook, Yahoo, Hotmail, Gmail,
Employees comfortable with the Web are already using it or Facebook, you select prospects to receive a brief message
to vent publicly about their job on sites like [Link] and requesting feedback. The message contains a link to a short on-
[Link]. Others create Google discussion groups or a line form where the contact types in his or her response (called
Web forum to discuss what they like and what they don’t like a rypple) to the single question. Feedback is aggregated, quickly
about their company, their industry, and even their boss. Some returned, and semi-anonymous (restricted to those contacts to
companies are using these anonymous tirades to identify and whom you sent your message). Rypple indicates 50 percent of
address workplace issues. those asked for feedback will provide it.
Social networks have long been used in the hiring process. Daniel Portillo, the senior director of personnel at Mozilla,
According to Kenexa, a human resource company that studies makers of the Firefox browser, tried it. “It’s impossible to de-
human behavior and team dynamics in the workplace, and of- velop if you’re not getting constructive criticism.” He discovered
fers software, business processes and consulting, “more than “people are direct, but not malicious.”
30 percent of the employees being hired in private organiza- [Link]; [Link]; [Link];
tions come through employee referrals—the highest from any [Link]; [Link]
one particular source.” Is it a logical extension, then, to see if
qualitative data are too subjective and susceptible to human error and bias in data collection and in-
terpretation. They believe such research provides an unstable foundation for expensive and critical
business decisions. The fact that results cannot be generalized from a qualitative study to a larger
population is considered a fundamental weakness.
Increasingly, however, managers are returning to these techniques as quantitative techniques fall
short of providing the insights needed to make those ever-more-expensive business decisions. Manag-
ers deal with the issue of trustworthiness of qualitative data through exacting methodology:5
• Carefully using literature searches to build probing questions.
• Thoroughly justifying the methodology or combination of methodologies chosen.
• Executing the chosen methodology in its natural setting (field study) rather than a highly
controlled setting (laboratory).
• Choosing sample participants for relevance to the breadth of the issue rather than how well they
represent the target population.
• Developing and including questions that reveal the exceptions to a rule or theory.
• Carefully structuring the data analysis.
• Comparing data across multiple sources and different contexts.
• Conducting peer-researcher debriefing on results for added clarity, additional insights, and
reduced bias.
Job Analysis • Does the current assignment of tasks generate the most productivity?
• Does the advancement through different job levels incorporate the
necessary training to foster the strongest performance?
Advertising Concept • What images should we use to connect with our target customers’
Development motivations?
Productivity Enhancement • What actions could we take to boost worker productivity without gen-
erating worker discontent?
New Product Development • What would our current market think of a proposed product idea?
• We need new products, but what should they be to take advantage
of our existing customer-perceived strengths?
• Which products will create the greatest synergy with our existing
products in terms of ROI and distribution partner growth?
Benefits Management • Should our compensation plan be more flexible and customizable?
• How do employees perceive wellness-prevention programs as com-
pared to corrective health programs in terms of value?
Retail Design • How do consumers prefer to shop in our store? Do they shop with a
defined purpose, or are they affected by other motives?
Process Understanding • What steps are involved in cleaning a wood floor? How is our product
perceived or involved in this process?
Market Segmentation • Why does one demographic or lifestyle group use our product more
than another?
• Who are our customers and how do they use our product to support
their lifestyle?
• What is the influence of culture on product choice?
Union Representation • How do various departments perceive the current effort to unionize
our plant? Where and what are the elements of discontent?
Sales Analysis • Why have once-loyal customers stopped buying our service?
The Distinction
To understand the distinctions between qualitative and quantitative methodologies, let’s define the
latter. Quantitative research attempts precise measurement of something. In business research,
quantitative methodologies usually measure consumer behavior, knowledge, opinions, or attitudes.
Such methodologies answer questions related to how much, how often, how many, when, and who.
Although the survey is not the only methodology of the quantitative researcher, it is considered a
dominant one.
The purpose of qualitative research is based on “researcher immersion in the phenomenon to be
studied, gathering data which provide a detailed description of events, situations and interaction be-
tween people and things, [thus] providing depth and detail.”6 Quantitative research is often used for
theory testing (Will a $1-off instant coupon or a $1.50 mail-in rebate generate more sales for Kellogg’s
Special K?), requiring that the researcher maintain a distance from the research to avoid biasing the
results. Qualitative research—sometimes labeled interpretive research because it seeks to develop
understanding through detailed description—often builds theory but rarely tests it.
Besides the purpose of the research, this process sets up several key distinctions between qualita-
tive and quantitative research, elaborated in Exhibit 7-2, including level of researcher involvement;
Qualitative Quantitative
Research Purpose • In-depth understanding; theory building • Describe or predict; build and test theory
Research Design • May evolve or adjust during the course of the • Determined before commencing the project
project
• Uses single method or mixed methods
• Often uses multiple methods simultaneously or
• Consistency is critical
sequentially
• Involves either a cross-sectional or a longitudinal
• Consistency is not expected
approach
• Involves longitudinal approach
Data Analysis • Human analysis following computer or human • Computerized analysis—statistical and mathemat-
coding; primarily nonquantitative ical methods dominate
• Forces researcher to see the contextual • Analysis may be ongoing during the project
framework of the phenomenon being
• Maintains clear distinction between facts and
measured—distinction between facts and
judgments
judgments less clear
• Always ongoing during the project
Insights and Meaning • Deeper level of understanding is the norm; de- • Limited by the opportunity to probe respondents
termined by type and quantity of free-response and the quality of the original data collection
questions instrument
• Researcher participation in data collection allows • Insights follow data collection and data entry, with
insights to form and be tested during the process limited ability to reinterview participants
Research Sponsor • May participate by observing research in real • Rarely has either direct or indirect contact with
Involvement time or via taped interviews participant
Feedback Turnaround • Smaller sample sizes make data collection faster • Larger sample sizes lengthen data collection;
for shorter possible turnaround Internet methodologies are shortening turnaround
but inappropriate for many studies
• Insights are developed as the research
progresses, shortening data analysis • Insight development follows data collection and
entry, lengthening research process; interviewing
software permits some tallying of responses as
data collection progresses
Data Security • More absolute given use of restricted access • Act of research in progress is often known by
facilities and smaller sample sizes competitors; insights may be gleaned by competi-
tors for some visible, field-based studies
Source: This exhibit was developed from material extracted from Judith Langer, The Mirrored Window: Focus Groups from a Moderator’s
Point of View (Ithaca, NY: Paramount Market Publishing, 2001); Hy Mariampolski, Qualitative Market Research: A Comprehensive Guide
(Thousand Oaks, CA: Sage Publications, 2001); David Carson, Audrey Gilmore, Chad Perry, and Kjell Gronhaug, Qualitative Marketing
Research (Thousand Oaks, CA: Sage Publications, 2001); and Norman K. Denzin and Ynonna S. Lincoln, editors, The SAGE Handbook
of Qualitative Research, 4th ed. (Thousand Oaks, CA: Sage Publications, April 27, 2011).
sampling methodology and size; data collection processes, including participant preparation and
researcher and research sponsor involvement; data type and preparation; data analysis and timing;
processes for reaching insights and meaning; time frame of insight discovery; and the level of data
security.7
Unlike the case with quantitative data, both the researcher and research sponsor often have more sig-
nificant involvement in collecting and interpreting qualitative data. The researcher may serve as a par-
ticipant or a catalyst, as a participant observer, or as a group interview moderator. The research sponsor
may observe (in some cases via Webcast of interviews directly to the sponsor’s desktop computer),
influence interview questions, and add interpretations and insights during the process. By contrast, with
large quantitative studies, the researcher who interprets the data and draws conclusions from it is rarely
the data collector and often has no contact at all with the participant.
Since researchers are immersed in the participant’s world, any knowledge they gain can be used to
adjust the data extracted from the next participant. In quantitative research, identical data are desired
from all participants, so evolution of methodology is not acceptable.
Quantitative data often consist of participant responses that are coded, categorized, and reduced to
numbers so that these data may be manipulated for statistical analysis. One objective is the quantitative
tally of events or opinions, called frequency of response. Qualitative data are all about texts. Detailed
descriptions of events, situations, and interactions, either verbal or visual, constitute the data. Data
may be contained within transcriptions of interviews or video focus groups, as well as in notes taken
during those interactions. But by definition they generate reams of words that need to be coded and
analyzed by humans for meaning. While computer software is increasingly used for the coding process
in qualitative research, at the heart of the qualitative process is the researcher—and his or her experi-
ence—framing and interpreting the data.8
Qualitative studies with their smaller sample sizes offer an opportunity for faster turnaround of
findings. While speed should never be the primary reason for choosing a methodology, qualitative data
may be especially useful to support a low-risk decision that must be made quickly.
Multimillion-dollar strategies may lose their power if the competitor reacts too quickly. Data secu-
rity is therefore of increasing concern. Both group and individual interviewing, the mainstay techniques
of qualitative research, can be conducted in highly secure environments. In comparison, once a quan-
titative survey or field observation or experiment is started, it is quickly common knowledge among a
research sponsor’s competitors. Although the data might not be known, the area of inquiry often can be
determined. For example, in a test market—an experimental quantitative design—a research sponsor’s
competitors can often observe and extract insights right along with the sponsor.
Research
Proposal
Research Design
Strategy
(type, purpose, time frame, scope, environment)
Discussion Guide
Development & Pretesting
Debriefing of Moderators,
Observers, & Participants
Research Reporting
Management
Decision
>picprofile
When Anderson Analytics wanted to help its research participants delve into their deepest thoughts on a research topic,
they used projective techniques that employed a colorful cast of characters. Participants choose one from the cast that most
closely represents them or another they are trying to describe. They then attributed attitudes, feelings, emotions, and percep-
tions to the character. “The added bonus of the characters is that some of the characters elicit similar responses [across
research projects], so we have some idea on benchmarking,” shared Anderson Analytics managing partner Tom Anderson.
“For instance the heavier male character with the guitar is often thought of as an outsider, ‘poser’ wanting desperately to fit in,
generally not well liked.” [Link]
• Having the participants bring visual stimuli (e.g., family photos of areas or rooms in their homes
that they hate to clean or have trouble decorating, or a favorite item of clothing).
• Having the participants prepare a visual collage (e.g., taking pictures over several weeks, with
a one-time-use camera, of their children’s favorite outfits for different purposes or situations or
cutting pictures out of magazines that reflect how they feel when using a particular product or
brand).
• Having the participants keep detailed diaries of behavior and perceptions (e.g., a record of their
step-by-step experience preparing a meal using a particular product).
• Having the participants draw a picture of an experience (e.g., what they felt like when they last
shopped in a particular store).
• Having the participants write a dialog of a hypothetical experience (e.g., how a conversa-
tion between the participant and a sales associate would progress when a complaint was not
resolved).9
Pretasking is rarely used in observation studies and is considered a major source of error in quantitative
studies.
In quantitative research, unless a researcher is collecting his or her own data, interviewers or data
collectors are rarely involved in the data interpretation or analysis stages. Although data collectors
contribute to the accuracy of data preparation, their input is rarely, if ever, sought in the development
of data interpretations. In qualitative studies, due to the higher level of involvement of both the spon-
sor and the interviewer/data collector, these parties in the process are often debriefed or interviewed,
with their insight adding richness to the interpretation of the data. Exhibit 7-4 provides an example of
research question formation for a qualitative project.
1
Discover
Management
Dilemma
1a Exploration
Literature Search and Expert Interviews
Sales in many of our established • What new product categories show evidence
product categories are flat. We need of long-term strength?
to increase revenues.
• Which product categories match our expertise
in manufacturing? in customer profile? in
distribution?
• In which categories do our current competitors
lack competency? Have superior competency?
2
Define
Management
Question
2a
Qualitative Research
• What new product categories pose
the best opportunities for sales? Convergent Interviewing Focus Groups with
• To what degree are we positioned in • Industry analysts • Current customers
the minds of our customers to take
advantage of these opportunities? • Futurists Using
• Engineers • Component sort
• Imaginary universe
3
Define
Research
Question(s)
Sampling
One general sampling guideline exists for qualitative research: Keep sampling as long as your breadth
and depth of knowledge of the issue under study are expanding; stop when you gain no new knowledge
or insights. That said, sample sizes for qualitative research vary by technique but are generally small.
A study might include just two or three focus groups or a few dozen individual depth interviews. How-
ever unusual, one AT&T study, conducted to develop its 800 Reasons ad campaign for using AT&T
long-distance service, used thousands of structured interviews in dozens of cities over several weeks.
These interviews provided numerous reasons why businesses used the AT&T 800 service, and each of
these “reasons” became the focus of a television and/or magazine ad in the multi-ad campaign.10
Qualitative research involves nonprobability sampling—where little attempt is made to generate a
representative sample. Several types of nonprobability sampling are common:
• Purposive sampling. Researchers choose participants arbitrarily for their unique characteristics
or their experiences, attitudes, or perceptions; as conceptual or theoretical categories of partici-
pants develop during the interviewing process, researchers seek new participants to challenge
emerging patterns.
• Snowball sampling. Participants refer researchers to others who have characteristics, experi-
ences, or attitudes similar to or different from their own.
• Convenience sampling. Researchers select any readily available individuals as participants.
Interviews
The interview is the primary data collection technique for gathering data in qualitative methodologies.
Interviews vary based on the number of people involved during the interview, the level of structure,
the proximity of the interviewer to the participant, and the number of interviews conducted during the
research.
An interview can be conducted individually (individual depth interview, or IDI) or in groups.
Exhibit 7-5 compares the individual and the group interview as a research methodology. Both have a
distinct place in qualitative research.
Interviewing requires a trained interviewer (often called a moderator for group interviews) or the
skills gained from experience. These skills include making respondents comfortable, probing for detail
without making the respondent feel harassed, remaining neutral while encouraging the participant to
talk openly, listening carefully, following a participant’s train of thought, and extracting insights from
hours of detailed descriptive dialogue. Skilled interviewers learn to use their personal similarities with
Research Objective
• Explore life of individual in depth • Orient the researcher to a field of inquiry and the language of the
field
• Create case histories through repeated interviews over time
• Test a survey
• Explore a range of attitudes, opinions, and behaviors
• Observe a process of consensus and disagreement
• Add contextual detail to quantitative findings
Topic Concerns
• Detailed individual experiences, choices, biographies • Issues of public interest or common concern
• Sensitive issues that might provoke anxiety • Issues where little is known or of a hypothetical nature
Participants
• Time-pressed participants or those difficult to recruit (e.g., • Participants whose backgrounds are similar or not so dissimilar
elite or high-status participants) as to generate conflict or discomfort
• Participants with sufficient language skills (e.g., those older • Participants who can articulate their ideas
than seven)
• Participants who offer a range of positions on issues
• Participants whose distinctions would inhibit participation
or differences from their interviewee to mine for information; similarities are used to convey sympathy
and understanding, while differences are used to demonstrate eagerness to understand and empathize.
In quantitative research we are more interested in the data collector’s following a prescribed proce-
dure, whereas in qualitative research the individual conducting the interview needs a fuller understand-
ing of the dilemma and how the insights will be used. So a skilled interviewer must be a “quick-study,”
someone who can grasp an understanding of an issue without necessarily having prior experience with
the product or service or being a technical expert.
The researcher chooses either an unstructured interview (no specific questions or order of topics to
be discussed, with each interview customized to each participant; generally starts with a participant nar-
rative) or a semistructured interview (generally starts with a few specific questions and then follows the
individual’s tangents of thought with interviewer probes) or a structured interview (often uses a detailed
interview guide similar to a questionnaire to guide the question order and the specific way the questions
are asked, but the questions generally remain open-ended). Structured interviews permit more direct com-
parability of responses; question variability has been eliminated and thus answer variability is assumed to
be real. Also, in the structured interview, the interviewer’s neutrality has been maintained.
Most qualitative research relies on the unstructured or semistructured interview. The unstructured
and semistructured interviews used in qualitative research are distinct from the structured interview in
several ways. They:
• Rely on developing a dialog between interviewer and participant.
• Require more interviewer creativity.
• Use the skill of the interviewer to extract more and a greater variety of data.
• Use interviewer experience and skill to achieve greater clarity and elaboration of answers.
Many interviews are conducted face-to-face, with the obvious benefit of being able to observe and
record nonverbal as well as verbal behavior. An interview, however, can be conducted by phone or
online. Phone and online interviews offer the opportunity to conduct more interviews within the same
time frame and draw participants from a wider geographic area. These approaches also save the travel
expenses of moving trained interviewers to participants, as well as the travel fees associated with
bringing participants to a neutral site. Using interviewers who are fresher and more comfortable in con-
ducting an interview—often from their home or office—should increase the quality of the interview.
Also, depending on the group from which participants are drawn, there may be insufficient numbers to
conduct group interviews in any one market, forcing the use of phone or online techniques.
Interviewer Responsibilities
The interviewer needs to be able to extract information from a willing participant who often is not
consciously aware that he or she possesses the information desired. The actual interviewer is usually
responsible for generating the interview or discussion guide, the list of topics to be discussed (unstruc-
tured interview) or the questions to be asked (semistructured) and in what order (structured). In build-
ing this guide, many interviewers employ a hierarchical questioning structure, depicted in Exhibit 7-6.
Broader questions start the interview, designed to put participants at ease and give them a sense that
they have a lot to contribute, followed by increasingly more specific questions to draw out detail.
The interviewer is often responsible for generating the screening questions used to recruit partici-
pants for the qualitative research. This preinterview uses a device similar to a questionnaire, called
a recruitment screener. Exhibit 7-7 provides the various elements necessary for a comprehensive
recruitment screener. Each question is designed to reassure the researcher that the person who has the
necessary information and experiences, as well as the social and language skills to relate the desired in-
formation, is invited to participate. Data gathered during the recruitment process are incorporated into
the data analysis phase of the research, as recruitment data provide additional context for participants’
expressions.
In general, then, the interviewer is a consultant with wide-ranging responsibilities:11
• Recommends the topics and questions.
• Controls the interview, but also plans—and may manage—the locations and facilities for the study.
Broad Issue
What do participants consider entertaining?
Source: This graphic was adapted from one developed by Judith Langer and published in The Mirrored Window: Focus Group from a Moderator’s Point
of View (Ithaca, NY: Paramount Market Publishing, 2001), [Link].
Projective Techniques
Because researchers are often looking for hidden or suppressed meanings, projective techniques can
be used within the interview structures. Some of these techniques include:12
• Word or picture association Participants are asked to match images, experiences, emotions,
products and services, even people and places, to whatever is
being studied. “Tell me what you think of when you think of
Kellogg’s Special K cereal.”
• Sentence completion Participants are asked to complete a sentence. “Complete this
sentence: People who buy over the Internet . . .”
• Cartoons or empty balloons Participants are asked to write the dialog for a cartoonlike pic-
ture. “What will the customer comment when she sees the sales-
person approaching her in the new-car showroom.”
• Thematic Apperception Test Participants are confronted with a picture (usually a photograph
or drawing) and asked to describe how the person in the picture
feels and thinks.
• Component sorts Participants are presented with flash cards containing compo-
nent features and asked to create new combinations.
• Sensory sorts Participants are presented with scents, textures, and sounds,
usually verbalized on cards, and asked to arrange them by one
or more criteria.
• Laddering or benefit chain Participants are asked to link functional features to their physi-
cal and psychological benefits, both real and ideal.
• Imagination exercises Participants are asked to relate the properties of one thing/per-
son/brand to another. “If Crest toothpaste were a college, what
type of college would it be?”
• Imaginary universe Participants are asked to assume that the brand and its users
populate an entire universe; they then describe the features of
this new world.
• Visitor from another planet Participants are asked to assume that they are aliens and are con-
fronting the product for the first time; they then describe their
reactions, questions, and attitudes about purchase or retrial.
• Personification Participants are asked to imagine inanimate objects with the traits,
characteristics and features, and personalities of humans. “If
brand X were a person, what type of person would brand X be?”
• Authority figure Participants are asked to imagine that the brand or product is
an authority figure and to describe the attributes of the figure.
• Ambiguities and paradoxes Participants are asked to imagine a brand as something else
(e.g., a Tide dog food or Marlboro cereal), describing its at-
tributes and position.
Paper-based exercises often draw out less verbal members of a group. Projective techniques can
dissipate tension caused by sensitive topics or can be useful when a change of focus in the interview
is imminent. A well-trained interviewer is required if the research demands that one or more of these
techniques be included within an individual depth interview or group interview. These techniques are
also time-consuming to apply, lengthening the time frame of the individual or group interview. They
also lengthen the data analysis time.
>snapshot
IBM’s High-Touch Strategy Is Research-Driven
When Samuel Palmisano became chairman and chief executive figure out how IBM might help customers solve their pesky prob-
of IBM, industry analysts didn’t expect this 30-year IBM loyal- lems. And what resulted from all those customer interviews? A
ist to rock the boat. But he started a research program that re- reorganization of the $89 billion company into 12 industry groups
sulted in a very aggressive reorganization. The IBM strategy isn’t (e.g., banking, insurance, automobiles, utilities, consumer pack-
quite so novel—create a strong connection between IBM and aged goods, telecommunications, life sciences, etc.) rather than
its customer—as is the extensive research behind it. Palmisano its previous three divisions (software, services, and research).
wanted his employees to talk to customers about their most trou- The shift is under way to make IBM an executive-level consulting
bling business problems. Rather than send the sales force to do firm rather than a technology services company. The reorganiza-
that job, IBM formed teams: the sales executive in charge of the tion has IBM’s labs, which used to focus on making machines
corporate account, a representative from the services division, calculate faster and more efficiently, refocusing on modeling pat-
a person from the software unit, and someone from the IBM re- terns of human behavior to help solve business problems.
search labs. These teams became known as “four in a box.” But [Link]
what each team was asked to do was think outside the box:
Individual depth interviews are usually recorded (audio and/or video) and transcribed to provide
the researcher with the rich detail that the methodology is used for. Interviewers are also them-
selves debriefed to get their personal reactions to participant attitudes, insights, and the quality
of the interview. Individual depth interviews use extensive amounts of interviewer time, in both
conducting interviews and evaluating them, as well as facility time when premises are occupied
for interviews. And while some respondents feel more comfortable discussing sensitive topics or
sharing their own observations, behaviors, and attitudes with a single person, others are more forth-
coming in group situations.
Group Interviews
A group interview is a data collection method using a single interviewer with more than one research
participant. Group interviews can be described by the group’s size or its composition.
Group interviews vary widely in size: dyads (two people), triads (three people), minigroups (two to
six people), small groups (focus groups—6 to 10 people—unarguably the most well known of group
interview techniques), or supergroups (up to 20 people). The smaller groups are usually used when
the overall population from which the participants are drawn is small, when the topic or concept list
is extensive or technical, or when the research calls for greater intimacy. Dyads also are used when
the special nature of a friendship or other relationship (e.g., spouses, superior–subordinate, siblings)
is needed to stimulate frank discussion on a sensitive topic. Dyads and triads are also used frequently
with young children who have lower levels of articulation or more limited attention spans and are thus
more difficult to control in large groups. A supergroup is used when a wide range of ideas is needed in
a short period of time and when the researcher is willing to sacrifice a significant amount of participant
interaction for speed.
In terms of composition, groups can be heterogeneous (consisting of different individuals; variety
of opinions, backgrounds, actions) or homogeneous (consisting of similar individuals; commonal-
ity of opinions, backgrounds, actions). Groups also can comprise experts (individuals exceptionally
knowledgeable about the issues to be discussed) or nonexperts (those who have at least some desired
information but at an unknown level).
Driven by the belief that the data extracted will be richer because of the interaction, group inter-
views are one of the few research techniques in which the participants are encouraged to interact.
Oral History (narrative ) Ask participants to relate their personal ex- To develop products, for example, books.
periences and feelings related to historical [September 11, 2001: Stories from 55 Broad Street
events or past behavior. by Eddie T. Deerfield and Thomas T. Noland
Jr. (editors); An Album of Memories: Personal Histo-
ries from the Greatest Generation by Tom Brokaw.]
Cultural Interviews Ask a participant to relate his or her experi- To determine product positioning or advertising
ences with a culture or subculture, including creation.
the knowledge passed on by prior genera- (E.g., how people use baking soda leads to
tions and the knowledge participants have positioning the product as not just a baking
or plan to pass on to future generations. ingredient but also a deodorizer, toothpaste
substitute, etc.)
Life Histories Extract from a single participant memories and To determine positioning for company prior to
experiences from childhood to the present an I.D. or name change.
day regarding a product or service category, (E.g., Frosted Flakes and Tony the Tiger—ad
brand, or firm. Participants are encouraged spots where adults feel they must appear in
to share how the significant people in their disguise because they eat a “child’s cereal.”)
lives talked about or were involved with the
organization, how their attitudes or prefer-
ences have changed over their lives with
respect to the organization, and how their
perceptions and preferences have been
altered by their various life experiences.
Critical Incident Technique The participant describes: To evaluate manufacturing processes, personal
sales and telemarketing sales programs,
• What led up to the incident.
compensation or incentive programs, or
• Exactly what he or she did or did not do that other management-related incidents.
was especially effective or ineffective.
• The outcome or result of this action and
why this action was effective or what more
effective action might have been expected.
Convergent Interviewing Experts serve as participants in a sequential To develop appropriate questions for all types
(convergent and series of IDIs; researcher refines the ques- of research (in exploratory research).
divergent interviewing ) tions with each interview in order to con-
verge on the central issues or themes in a
topic area.
Sequential Interviewing Approach the participant with questions To determine store design, advertising devel-
(chronologic interviewing ) formed around an anticipated series of opment, and product design; it is used to
activities that did or might have happened, extract details related to shopping behavior,
in order to have the participant recall the advertising consumption behavior, and
detail of his or her own experience. product use behavior.
Grounded Theory Using a structured interview, each subsequent To determine product design or redesign and
interview is adjusted based on the findings advertising and promotion development.
and interpretations from each previous
interview, with the purpose to develop general
concepts or theories with which to analyze
the data.
Source: This exhibit was developed from Hy Mariampolski, Qualitative Market Research: A Comprehensive Guide (Thousand Oaks, CA: Sage
Publications, 2001), p. 53; David Carson, Audrey Gilmore, Chad Perry, and Kjell Gronhaug, Qualitative Marketing Research (Thousand Oaks, CA:
Sage Publications, 2001), pp. 84–89 and 152–157; Anselm Strauss and Julia Corbin, Basics of Qualitative Research: Techniques and Procedure for
Producing Grounded Theory (Thousand Oaks, CA: Sage Publications, 1998); and Norman K. Denzin and Ynonna S. Lincoln, editors, The SAGE
Handbook of Qualitative Research, 4th ed. (Thousand Oaks, CA: Sage Publications, April 27, 2011).
However, given time constraints, group interviews permit spending only limited time extracting detail
from each participant.15 This problem is magnified when a group interview is structured to cover nu-
merous questions or topics.
Another drawback of the group interview is the increased difficulty recruiting, arranging, and
coordinating group discussions. But this aggravation—which can be subcontracted to a specialist
research supplier—is deemed a small price to pay for the insights that often are revealed by group
interaction.
Interviewers are tested by the challenge of managing the group’s conversation while avoiding
interjecting themselves into the group’s process. It is also the moderator’s job to control the extrovert
or dominant personality and ensure meaningful contributions from all others, including the most intro-
verted or private thinkers. When control is not maintained, some members’ opinions may be suppressed
and valuable insights lost. Sometimes an individual will be more honest with a neutral interviewer than
with a group of peers. One example is a group of small-business owners being unwilling to divulge
competitive strengths and weaknesses. A skilled researcher can anticipate which topics are more likely
to obtain good results with an individual or a group interview.
A group interview’s structure and process include moderator interaction with the group and probing
of the group to clarify responses. As a result, the moderator may create bias in the results by sending
verbal and nonverbal signals that some responses are more favorable than others. The moderator might
also direct discussion down paths that are least likely to help the client. Only training, and subsequent
experience, can overcome these potential weaknesses of group interviews.
The skilled researcher helps the sponsor determine an appropriate number of group interviews to
conduct. The number of groups is determined by
• The scope of the issue(s) being studied: The broader the issue(s), the more groups needed.
• The number of distinct market segments of interest: The larger the number and the greater the
distinctions, the more groups needed.
• The number of new ideas or insights desired: The larger the number, the more groups needed.
• The level of detail of information: The greater the level of detail, the more groups needed.
• The level of geographic or ethnic distinctions in attitudes or behavior: The greater these influ-
ences, the more groups needed.
• The homogeneity of the groups: The less homogeneity, the more groups needed.
The general rule is: Keep conducting group interviews until no new insights are gained. Often a limited
number of groups will suffice, or sometimes the number might grow to 8 or even 12.
It is often preferable, depending on the topic, to run separate group interviews for different subsets
of the target population. For example, a study on nutritional advice may begin with separate consumer
and physician groups to determine the best ways to provide the advice. This type of homogeneous
grouping tends to promote more intense discussion and freer interaction.16
Researchers caution against forming groups solely on demographic descriptors, favoring “natu-
ral”’ groups (like families, co-workers, church members, etc.) where the participants share an affin-
ity base.17 For customer groups, however, consideration should be given to such factors as gender,
ethnicity, employment status, and education, because culture is a primary determinant of perception.
In a recent exploratory study of discount shoppers, the attitudes about the economy and personal
finances expressed by East Coast respondents and West Coast respondents diverged widely. The re-
search sponsor was able to use information from group interviews to build a strategy tailored to each
geographic area.18
Regardless of group composition, it is the moderator who sets the tone of the group. Homoge-
nous groups often discover their similarities early and get along well. But with heterogeneous groups,
the moderator must provide the ice-breaker activities that get the participants interacting with each
other. As with individual depth interviews, the moderator is responsible for developing the recruitment
screener and the group discussion guide. Exhibit 7-9 summarizes the facilitators and inhibitors of indi-
vidual participation in group interviews.
A closer look at one of the best known of group interviews, the focus group, may clarify these
distinctions.
>snapshot
Problems within Focus Groups
Focus Groups
The term focus group was first coined by R. K. Merton in his 1956 book, The Focused Interview. The
focus group is a panel of people (typically made up of 6 to 10 participants), led by a trained moderator,
who meet for 90 minutes to two hours. The facilitator or moderator uses group dynamics principles to
focus or guide the group in an exchange of ideas, feelings, and experiences on a specific topic. You’ll
find a sample focus group discussion guide in Appendix B.
Focus groups are often unique in research due to the research sponsor’s involvement in the process.
Most facilities permit the sponsor to observe the group and its dynamics in real time, drawing his or
her own insights from the conversations and nonverbal signals he or she observes. Many facilities also
allow the client to supply the moderator with new topics or questions that are generated by those ob-
serving in real time. This option is generally not available in an individual depth interview, other group
interviews, or survey research.
Focus groups typically last about two hours but may run from one to three hours. Facilities usu-
ally provide for the group to be isolated from distractions. Thus, the famous, or infamous, mirrored
window allows those who are interested to observe the group while they avoid interfering with the
group dynamics. Some facilities allow for product preparation and testing, as well as other creative
exercises.
Positive/Facilitators
Recognition/Ego Enhancement Moderator’s expressed appreciation for participant contributions that contribute to
issue understanding; participant’s open agreement with other participant comments.
Personal Contribution Participant’s desire to be, and perception that his or her contributions are, helpful.
Validation Participant’s need to have his or her feelings, attitudes, or ideas validated.
Personal Growth Participant’s desire to increase knowledge or understanding through new perspectives;
participant’s desire for new experiences.
Socialization Participant’s desire to meet new people and make new friends in a “safe” environment.
Negative/Inhibitors
Political Correctness Participant’s withholding comments for fear that his or her contributions might be
perceived as disrespectful of another’s knowledge or opinions.
Ego Defense Participant’s withholding a comment for fear that it will make him or her appear
unintelligent or that the opinion will be unpopular with the group.
Dominating/Monopolizing Participant’s attempting to take leadership or the spotlight, thus blocking contributions
of others.
Fewer and lengthier focus groups are becoming common. As sessions become longer, activities are
needed to bring out deeper feelings, knowledge, and motivations. Besides the creativity sessions that
employ projective techniques or involve the participants in writing or drawing sessions, or creating
visual compilations, other common activities within focus groups include:19
• Free association. “What words or phrases come to mind when you think of X?”
• Picture sort. Participants sort brand labels or carefully selected images related to brand personal-
ity on participant-selected criteria.
• Photo sort. Photographs of people are given to the group members, who are then asked: “Which
of these people would . . . ?” or “Which of these people would not . . . ?”
• Role play. Two or more members of the group are asked to respond to questions from the van-
tage point of their personal or assigned role.
>picprofile
Where do great new product ideas come from? If you’re Hallmark, they come from a very consumer-focused research effort.
Monica Alderson, product management director for consumer solutions shares that Hallmark is always looking for new ways
to fulfill its brand promise: helping people remain emotionally connected. Qualitative and quantitative research is designed to
reveal connection dilemmas. One such dilemma was grandparents indicating “help me be there even when I can’t be there.” As
part of its new consumer-insights organization structure, each month 50 Hallmark senior managers listen to research insights
and product proposals that are based on these insights. This was the starting point for recordable storybooks, a collection of
books not only read for grandchildren, but books read by parents for children, and even books read by children to their military
parents serving abroad. [Link]
Focus groups are often used as an exploratory technique but may be a primary methodology. In two
such cases, a small college used focus groups to develop a plan to attract more freshmen applications,
and a blood center used a focus group to improve blood donations.20 Focus groups are especially valu-
able in the following scenarios:21
Groups best enable the exploration of surprise information and new ideas. Agendas can be modified
as the research team moves on to the next focus group. Even within an existing focus group, an adept
facilitator can build on the ideas and insights of previous groups, getting to a greater depth of under-
standing. However, because they are qualitative devices, with limited sampling accuracy, results from
focus groups should not be considered a replacement for quantitative analyses.
>snapshot
FocusVision’s VideoMarker
In the opening vignette, Sara Arens was involved in conducting and analyzing focus groups for
a frozen-food manufacturer. Sara’s partner Jason is involved with assessing the CompleteCare ser-
vice program for MindWriter. For the latter project Jason and Sara could use focus groups involving
employees (of the call center and service departments) to determine suggestions for improvements and
provide an analysis of proposed improvements. MindWriter may want focus groups with CompleteCare
customers (both dissatisfied and satisfied customers but restricted to separate groups) to reveal the
scope of attitudes and experiences not documented within complaints.
Telephone Focus Groups In traditional focus groups, participants meet face-to-face, usually in
specialized facilities that enable respondents to interact in a comfortable setting while being observed
by a sponsoring client. However, often there is a need to reach people that face-to-face groups cannot
attract. With modern telephone conferencing facilities, telephone focus groups can be particularly
effective in the following situations:
• When it is difficult to recruit desired participants—members of elite groups and hard-to-find respon-
dents such as experts, professionals, physician specialists, high-level executives, and store owners.
• When target group members are rare, “low incidence,” or widely dispersed geographically—
directors of a medical clinic, celebrities, early adopters, and rural practitioners.
• When issues are so sensitive that anonymity is needed but respondents must be from a wide
geographic area—people suffering from a contagious disease, people using nonmainstream
products, high-income individuals, competitors.
• When you want to conduct only a couple of focus groups but want nationwide representation.
Telephone focus groups are usually shorter than traditional groups, averaging about one hour. Par-
ticipants could be in their own offices or homes or be brought to a central location with the necessary
equipment. Telephone focus groups are usually less expensive than face-to-face focus groups—by up
to 40 percent.
In contrast to face-to-face groups, heterogeneous telephone groups can be productive. People in tra-
ditional superior-subordinate roles can be mixed as long as they are not from the same city. A telephone
focus group is less likely to be effective under the following conditions:
• When participants need to handle a product.
• When an object of discussion cannot be sent through the mail in advance.
• When sessions will run long.
• When the participants are groups of young children.
>snapshot
Mystery Shopping at Office Depot
You can’t use research to improve your company if you are reenacting the same scenario with a twist—he followed cus-
asking the wrong questions. That’s the lesson learned by CEO tomers out to the parking lot and asked them why they hadn’t
Kevin Peters when he was comparing declining sales to stellar made a purchase if their hands were empty. “Our mystery-
mystery shopping reports on customer service. shopping scores were correct. You know what was flawed?
Mystery shopping is a qualitative technique that uses ethnog- Our scoring system,” discovered Peters. “We were asking: Are
raphy to evaluate the in-store customer experience. The shop- the floors clean? Are the shelves full of inventory? Are the store
ping experience is guided by a checklist that can contain a list windows clean? Have the bathrooms been cleaned recently?
of questions to answer or shopping scenarios to enact, or both. It turns out that customers don’t really care about any of that.
Once the mystery shopper has completed the task, he or she Those factors don’t drive purchases, and that’s why our sales
writes up a report. The technique has been used for decades by were declining.”
bricks-and-mortar retailers. Peters discoveries lead to numerous changes to Office Depot—
But it wasn’t working as it should have for Office Depot, not store size, layout, service mix, and employee training. And we are
because the technique is flawed but because the questions/ positive he also changed the tasking of the mystery shopper.
scenarios were flawed. [Link]fi[Link]
Peters set out find out what was wrong by becoming a mys-
tery shopper himself in more than 70 stores, covering 15 states,
focus group sessions using content analysis. This analytical process provides the research sponsor
with a qualitative picture of the respondents’ concerns, ideas, attitudes, and feelings. The preliminary
profile of the content of a group interview is often done with computer software in content analysis (for
example, N6, mentioned in the opening vignette). Such software searches for common phrasing and
words, context, and patterns of expression on digitized transcripts.
they offer similar results for predictable reasons (literal replication) or contrary results for predict-
able reasons (theoretical replication). While theoretical sampling seems to be common, a minimum of
4 cases with a maximum of 15 seems to be favored.
In the case study, interview participants are invited to tell the story of their experience, with those
chosen representing different levels within the same organization or different perspectives of the same
situation or process to permit depth of perspective. The flexibility of the case study approach and the
emphasis on understanding the context of the subject being studied allow for a richness of understand-
ing sometimes labeled thick description.
During analysis, a single case analysis is always performed before any cross-case analysis is con-
ducted. The emphasis is on what differences occur, why, and with what effect. Prescriptive inferences
about best practices are concluded after completing case studies on several organizations or situations
and are speculative in nature.
Students are quite familiar with studying cases as a means of learning business principles. In Search
of Excellence, a book by Tom Peters and Robert Waterman, was developed using case study methodol-
ogy.23 Other similar studies profiled in books written on Procter & Gamble and Disney have also used
this methodology. In the business arena, such case studies have examined changes in new product
development, sales processes, hiring practices, and training programs.
Action Research
Managers conduct research in order to gain insights to make decisions in specific scenarios. Action
research is designed to address complex, practical problems about which little is known—thus no
known heuristics exist. So the scenario is studied; a corrective action is determined, planned, and
implemented; the results of the action are observed and recorded; and the action is assessed as ef-
fective or not. The process is repeated until a desired outcome is reached, but along the way much
is learned about the processes and about the prescriptive actions being studied. Action researchers
investigate the effects of applied solutions. Whatever theories are developed are validated through
practical application.24
Suppose a restaurant that had never received a customer complaint earns its first challenge by a
disgruntled diner. If no general rule existed about how to treat unhappy patrons, the organization could
study the situation and come up with alternative actions. It might:
• Ignore the problem. (Its lack of experience would prevent it from knowing that negative word of
mouth—negative buzz—would be the likely result.)
• Do whatever is necessary to replace the unsatisfactory meal within the shortest period of time.
• Accept the current circumstance as uncorrectable, apologize to the customer, and remedy the situ-
ation by picking up the table’s full dining tab and offering the customer a free meal to get him or
her back in the restaurant another day.
In action research, one of those alternatives would be chosen and implemented, and then the results
recorded. Was the customer happy when he or she left? Did the customer return to dine another evening
or never return again? Over the next three months, what was the customer’s full revenue value? If the
customer didn’t return, the next time a disgruntled customer voiced dissatisfaction, a different action
would be chosen, implemented, and then assessed in comparison to the first option’s results.
when a quantitative study follows a qualitative one and provides validation for the qualitative findings.
Four strategies for combining methodologies are common in business research:25
1. Qualitative and quantitative studies can be conducted simultaneously.
2. A qualitative study can be ongoing while multiple waves of quantitative studies are done, mea-
suring changes in behavior and attitudes over time.
3. A qualitative study can precede a quantitative study, and a second qualitative study then might
follow the quantitative study, seeking more clarification.
4. A quantitative study can precede a qualitative study.
An example of the first strategy would be the combination of a public opinion poll at the time focus
groups are being held to discover ways to sway a particular public’s opinion. For the second strategy,
we might collect life histories while multiple waves of questionnaires are measuring the response to
differing promotional tactics. For the third, we could perform a qualitative study to identify peoples’
behaviors and perceptions with respect to furniture shopping processes and interior decorating; then we
could use that information to develop a quantitative study to measure the actual frequency of behaviors
and attitudes. And, fourth, we might survey people’s behavior and attitudes toward a brand and find we
need some IDIs to explain findings that are unclear.
Many researchers recognize that qualitative research compensates for the weaknesses of quantita-
tive research and vice versa. These forward thinkers believe that the methodologies complement rather
than rival each other.
>summary
1 Qualitative research includes an array of interpretive tech- testing; sales analysis; sales development; package design;
niques that seek to describe, decode, translate, and other- brand development and assessment, especially understand-
wise come to terms with the meaning, not the frequency, ing brand value; positioning; retail design; and understanding
of certain more or less naturally occurring phenomena in various processes, including consumers’ decision-making
the social world. Qualitative research methodologies differ processes. In data analysis, qualitative research uses content
from quantitative methodologies based on the focus of the analysis of written or recorded materials drawn from personal
research; its purpose; researcher involvement; sampling expressions by participants, behavioral observations, and
design; sample size; research design, including participant debriefing of observers, as well as the study of artifacts and
pretasking; data source, type, and preparation; methods trace evidence from the physical environment.
of data analysis; level of insights and meaning extracted; 4 Qualitative methodologies used in decision making evolved
research sponsor involvement; speed of the research; and from techniques used in anthropology, sociology, psychology,
data security. A qualitative methodology may be used alone linguistics, communication, economics, and semiotics. Com-
to address organizational problems or in combination with mon among these strategies are the individual depth interview
other qualitative or quantitative methodologies. (IDI) and the group interview, as well as observation, ethnogra-
2 While qualitative research is being used increasingly be- phy, action research, and grounded theory. Within group inter-
cause of the methodologies’ ability to generate deeper views, the focus group is the most widely used methodology.
understanding, it still is perceived by many senior-level ex- Qualitative research often uses projective techniques,
ecutives as a stepchild of quantitative data collection. This is designed to encourage the participant to reveal in detail
primarily due to qualitative research’s use of nonprobability deeply suppressed attitudes, opinions, feelings, and experi-
sampling, the smaller sample sizes involved, and the non- ences. Among these techniques are word or picture asso-
projectability of the results to a broader, target population. ciation, sentence completion, cartoons or empty balloons,
3 Qualitative research is designed to tell the researcher how the Thematic Apperception Test, imagination exercises, and
(process) and why (meaning) things happen as they do. In sorting exercises. Participant preparation and the actual
business planning and decision making, qualitative method- qualitative sessions themselves often include various cre-
ologies are used in market segmentation; advertising creative ativity sessions and exercises.
development; new product development, especially concept
>keyterms
action research 166 interview 152 qualitative research 144
case study (case history) 165 semistructured 153 quantitative research 146
>discussionquestions
Terms in Review Making Research Decisions
1 How does qualitative research differ from quantitative 5 Assume you are a manufacturer of small kitchen electrics,
research? like Hamilton Beach/Proctor Silex, and you want to de-
2 How do data from qualitative research differ from data in termine if some innovative designs with unusual shapes
quantitative research? and colors developed for the European market could be
successfully marketed in the U.S. market. What qualitative
3 Why do senior executives feel more comfortable relying on
research would you recommend, and why?
quantitative data than qualitative data? How might a quali-
tative research company lessen the senior-level executive’s 6 NCR Corporation, known as a world leader in ATMs,
skepticism? point-of-sale (POS) retail checkout scanners, and check-
in kiosks at airports, announced in June 2009 that it
4 Distinguish between structured, semistructured, and un-
would move its world headquarters from Dayton (OH)
structured interviews.
to Duluth (GA), a suburb of Atlanta, after more than 125 From Concept to Practice
years. An employer of 1,200 mostly high-salaried, profes- 8 Use Exhibit 7-7 to develop the recruitment screener for the
sional workers in Dayton, NCR was enticed to move by research you described in your answer to question 5.
Georgia’s offer of more than $56.9 million in tax credits; 9 Conduct a focus group among students in your class on
its fast-growing, educated 25- to 34-year-old population one of the following topics:
cohort; international offices for 10 European state govern-
a Our department’s problems offering requirements
ments; and the busiest international airport (Atlanta) in the
and electives essential for meeting your graduation
world.
expectations.
a What qualitative research might NCR have done to
b Entertainment sponsored by your university to bring the
reach this decision?
community on campus.
b NCR will use its move to Georgia to downsize its world
headquarters workforce. What qualitative research From the Headlines
could help NCR determine which of its 1,200 employees 10 Pepsi launched a new global branding campaign based
will be offered positions in Duluth? on the concept of live in the moment called “Live For
Bringing Research to Life Now.” It did extensive research prior to the campaign’s
7 What dilemma does HealthPlus face, and why has the launch. What research should be done to determine if the
company turned to focus groups for insights? campaign is resonating with worldwide audiences?
>cases*
Lexus SC 430
Starbucks, Bank One, and Visa Launch Starbucks
Card Duetto Visa
NCRCC: Teeing Up a New Strategic
Direction
USTA: Come Out Swinging
* You will find a description of each case in the Case Index section of this textbook. Check the Case Index to determine
whether a case provides data, the research instrument, video, or other supplementary material. Written cases are
downloadable from the text website ([Link]/cooper12e). All video material and video cases are available
from the Online Learning Center. The film reel icon indicates a video case or video material relevant to the case.
17
THE NATURE OF
QUALITATIVE RESEARCH
Introduction 356 The critique of qualitative research 374
Qualitative research is too subjective 374
The main steps in qualitative research 357
Qualitative research is difficult to replicate 374
Theory and research 360 Problems of generalization 374
CHAPTER OUTLINE
Qualitative research is a research strategy that usually emphasizes words rather than numbers in the
collection and analysis of data. As a research strategy it is in general inductive, constructionist, and
interpretive, though qualitative researchers do not always subscribe to all of these intellectual positions.
This chapter is concerned with outlining the main features of qualitative business research. The chapter
explores:
• the main steps in qualitative research—which are more complex than in quantitative research;
• the nature of concepts in qualitative research and their differences from concepts in quantitative
research;
356 17 The nature of qualitative research
• how far reliability and validity are appropriate criteria – flexibility and lack of structure
for qualitative researchers and whether alternative – concepts and theory as outcomes of the research
criteria that are more tailored to the research strategy process;
are needed;
• some common criticisms of qualitative research;
• the main preoccupations of qualitative researchers—
five areas are identified:
• the main contrasts between qualitative and
quantitative research;
– seeing through the eyes of research participants
• the stance of feminist researchers on qualitative
– description and context research.
– process
Introduction
We began Chapter 8 by noting that quantitative research research since the 1970s, stipulating what it is and
had been outlined in Chapter 2 as a distinctive research is not as a distinct research strategy is by no means
strategy. Much the same kind of general point can be straightforward. They propose that one of the reasons
made in relation to qualitative research. In Chapter 2 for this uncertainty is because as a term, ‘qualitative
it was suggested that qualitative research differs from research’ is sometimes taken to imply an approach to
quantitative research in several ways. Most obviously, study in which quantitative data are not collected or
qualitative research tends to be concerned with words generated. Consequently, qualitative research ends up
rather than numbers, but four further features are par- being addressed in terms of what quantitative research
ticularly noteworthy: is not. Many writers on qualitative research are critical
of such a view, because the distinctiveness of qualitative
• an inductive view of the relationship between theory
research does not reside solely in the absence of num-
and research, whereby the former is generated out of
bers. It is also important to note that when we describe
the latter;
qualitative research in this chapter, we are making gen-
• an epistemological position described as interpretivist, eralizations just as we did when describing quantative
meaning that, in contrast to the adoption of a natural research. There are, of course, always divergences from
scientific model in quantitative research, the stress is such generalizations, a point which we return to later
on the understanding of the social world through an in this chapter.
examination of the interpretation of that world by its Silverman (1993) is critical of accounts of qualitative
participants (see Chapter 2); research that do not acknowledge the variety of forms
• an ontological position described as constructionist, that the research strategy can take. Other writers, such
which implies that social properties are outcomes of as Denzin and Lincoln (2005), have argued that qualita-
the interactions between individuals, rather than phe- tive research has evolved over time into a series of dis-
nomena ‘out there’ and separate from those involved tinct phases or ‘moments’. In other words, these writers
in their construction (see Chapter 2); are critical of attempts to specify the nature of qualita-
tive research as a general approach. In writing about
• an emphasis on naturalism, as the practice of seeking to
the characteristics of qualitative research we therefore
understand social reality in its own terms by providing
need to be sensitive to the different orientations of
rich descriptions of people and interactions in settings
qualitative researchers. Yet it is also clear that the label
that arise without the researcher attempting to influ-
‘qualitative research’ is commonly used in business and
ence them for the purposes of data collection. Natural-
management studies. This can be seen from the popu-
ism is taken to imply that people attribute meaning to
larity of specialist journals, such as Qualitative Research
behaviour and are active creators of their social world,
in Organizations and Management, and the number of
rather than passive subjects.
texts and handbooks, such as the SAGE Handbook of
As Bryman and Burgess (1999) observe, although Qualitative Business and Management Research Methods
there has been a proliferation of writings on qualitative (Cassell et al. 2018).
The main steps in qualitative research 357
Several reasons might be proposed for the unease between these approaches. Researchers employing eth-
among some writers about specifying the nature of quali- nography or participant observation frequently conduct
tative research. First, qualitative research subsumes sev- qualitative interviews; they also often collect and anal-
eral diverse research methods that differ from each other yse texts and documents as well. Thus, there is consider-
considerably. The following are the main research meth- able variability in the collection of data among studies
ods associated with qualitative research. that are deemed to be qualitative. Of course, quantita-
tive research also subsumes several different methods
• Ethnography/participant observation. While some cau-
of data collection (these were covered in Part Two), but
tion is advisable in treating ethnography and partici-
the methods associated with qualitative research imply
pant observation as synonyms, they refer to similar
somewhat greater variability.
approaches to data collection in which the researcher
A second reason why there is resistance to specifying
is immersed in a social setting for some time in order to
the nature of qualitative research is that the connection
observe and listen with a view to gaining an apprecia-
between theory and research is more ambiguous than in
tion of the culture of a social group. These methods,
quantitative research. With the latter research strategy,
discussed in Chapter 19, were used in Dalton’s (1959)
theoretical issues typically drive the formulation of a
study of managerial work in the USA and by Alcadipani
research question, which in turn drives the collection and
and Tonelli in their exploration of life on the shopfloor
analysis of data. Findings then feed back into the rele-
of a newspaper printing factory in the north of Eng-
vant theory. In qualitative research, theory is supposed
land (Alcadipani and Tonelli 2014) (see Chapter 19).
to be an outcome of an investigation rather than some-
• Qualitative interviewing, covered in Chapter 20. This thing that precedes it. However, some writers, includ-
broad term encompasses a wide range of interviewing ing Silverman (1993: 24), argue that such a depiction
styles (see Key concept 10.2 for an introduction). of qualitative research is ‘out of tune with the greater
• Focus groups, discussed in Chapter 21 (see Key concept sophistication of contemporary field research design,
10.2 for an introduction). born out of accumulated knowledge of interaction and
greater concern with issues of reliability and valid-
• Language-based approaches to the collection of qualita-
tive data, such as discourse and conversation analysis ity’. Nonetheless, qualitative research is more usually
(covered in Chapter 22). regarded as denoting an approach in which theory and
categorization emerge out of the collection and analysis
• The collection and qualitative analysis of texts and docu-
of data. The more general point being made is that such
ments (covered in Chapter 23).
a difference within qualitative research may account for
Each of these approaches to data collection will be exam- the unease about depicting research strategy in terms of
ined in Part Three. As will be seen, there are overlaps a set of stages.
FIGURE 17.1
An outline of the main steps of qualitative research
tity where they will be mothers and professionals. This pants, their choice of semi-structured interview
led the researchers towards the development of their methods enabling the exploration of women’s work
research goal which was to ‘study women’s experi- experience while pregnant. Interviews were between
ences of the liminal period of pregnancy as they 60 and 90 minutes’ duration and were taped and tran-
develop their new maternal identity and begin recon- scribed verbatim.
structing their professional identity in light of impend-
• Step 4. Interpretation of data. Ladge et al. describe their
ing motherhood’ (Ladge et al. 2012: 1453). A set of study as based on a grounded theory approach. The
general questions including ‘How do women manage process of analysis began by developing a set of codes
their work identity while pregnant?’ guided the that emerged inductively from the interviews. The
research, ‘but as we moved through the data, we were three researchers worked together to develop shared
open to making adjustments to these questions … agreement on these codes, each coding a subset of the
based on our own interpretations of the data and the transcripts independently and then meeting up to
interpretations of respondents’ (Ladge et al. 2012: compare and consolidate, returning to the literature
1455). and then recoding. Following techniques developed by
• Step 2. Selecting relevant site(s) and subjects. The first Strauss and Corbin (1990), they went through several
stage of the project involved a pilot study of ten inter- cycles of this process. Eventually, ‘after coding 29
views with women who were either pregnant with interviews, we felt we had reached the point of theo-
their first child or within six months of having given retical saturation because no new codes were being
birth to their first child. Interviewees had a minimum generated’ (Ladge et al. 2012: 1456).
of three years’ professional experience and were
• Step 5. Conceptual and theoretical work. Consistent
planning on returning to work after their maternity with their grounded theory approach, Ladge et al.
leave. describe their goal as to expand knowledge about lim-
• Step 3. Collection of relevant data. The researchers jus- inal periods and to build new theory about identity
tify their choice of qualitative research methods as a transitions. The researchers therefore develop a theo-
response to calls from work–life scholars for more retical model (in the form of a detailed flow diagram)
research that explores the lived experience of partici- to illustrate the experiences of identity transitions in
The main steps in qualitative research 359
One factor that may affect the degree of explicitness with which research questions are stated is the outlet in
which the research is published. Ashforth et al. (2007) published this article in the Academy of Management
Journal, which publishes mainly empirical articles deriving from quantitative research. It may be that Ashforth et
al. chose this format for presenting their research questions so that it would exhibit some of the characteristics of
research questions or hypotheses in quantitative research that tend to be stated explicitly. Another article in the
same issue of that journal also states its research questions very explicitly, though not in the same way.
Thus two research questions guided this article: (1) What conditions trigger organizational stakeholders and
leaders to engage in sensemaking activities? and (2) What conditions enable sensegiving on the part of
stakeholders and leaders motivated to engage in sensemaking activities?
(Maitlis and Lawrence 2007: 59)
The researchers investigated these two research questions by collecting qualitative data from semi-structured
interviews, observation, and examination of documents related to three British symphony orchestras. Since the
early 2010s there has been increasing expectation upon qualitative business researchers to articulate a research
question in this way when presenting their findings.
liminal periods. In this model, pregnancy is labelled as on a precise segment of working women … Thus, we
a ‘triggering event’ that evokes identity uncertainty. decided to focus our attention on women who had at
The emphasis in this model is on explaining the pro- least three years’ professional experience’. The women
cess of identity transition as it unfolds in the liminal in this second sample held a variety of professional
period. occupations, including manager, lawyer, and college
professor. Through analysis of the interview tran-
• Step 5a. Tighter specification of the research question(s).
Having done the pilot study, Ladge et al. refined their scripts from the pilot study, the researchers returned
definition of the population being studied, their theo- to the literature on identity transitions ‘and recog-
retical frame, and the questions that comprised the nized that pregnancy represents a liminal space. Thus,
interview protocol. The extent of these changes illus- we modified our full study to focus exclusively on preg-
trates the extent to which qualitative researchers are nant women, excluding those who had given birth’
flexible in their approach to study, changing direction (Ladge et al. 2012: 1453–4). They then interviewed a
in the course of the investigation, a point which we will further 25 women (Step 5b) based on these refined
return to later in this chapter. They explain: ‘we sampling criteria. Such a research strategy is fre-
learned from the pilot study that we needed to focus quently referred to as iterative: the stages of data col-
360 17 The nature of qualitative research
In order to develop the idea of emotional labour, Hochschild looked to the world of work. She chose to focus on
flight attendants, as an occupational group that was likely to engage in emotional labour. Several sources of data
362 17 The nature of qualitative research
on emotional labour among flight attendants were used. She gained access to Delta Airlines, a large American
airline. Data collection involved
• observing training sessions for attendants and having many conversations with trainees and experienced
attendants;
• interviewing other personnel, such as section managers and advertising agents;
• examining Delta advertisements spanning 30 years;
• observing the flight attendant recruitment process at Pan American Airways, since she had not been allowed to
do this at Delta;
• conducting ‘open-ended interviews lasting three to five hours each with thirty flight attendants in the San
Francisco Bay Area’ (1983: 15).
As a contrasting occupational group that is also involved in emotional labour, she also interviewed five
debt-collectors.
From this it can be seen that Hochschild’s concept of emotional labour began as a somewhat imprecise idea
which emerged out of a concern with emotion work and gradually developed. The concept has been picked up by
numerous other business and management researchers. For example, Leidner (1993) has explored, through
ethnographic studies of a McDonald’s restaurant and an insurance company, the ways in which organizations
seek to ‘routinize’ the display of emotional labour.
• The researcher provides each research participant with an account of what they have said to the researcher in
an interview and conversations, or of what the researcher observed by watching that person in an observational
study. For example, Marshall (1995) wanted to tell the stories of a small group of women managers who had
left or were leaving senior organization positions, from these women’s points of view. To achieve this, she met
364 17 The nature of qualitative research
with each manager for one-and-a-half to two hours and asked the woman to tell her story. Marshall stated that
she would be happy to discuss her own views and experiences if relevant. Once the story had been
transcribed, she wrote an initial draft of the story and invited the manager to read it.
• The researcher feeds back to a group of people or an organization his or her impressions and findings in
relation to that group or organization. In Marshall’s (1995) research, after reading the story, each of the
managers met Marshall again, or exchanged letters and phone calls, in order to develop the story to their
mutual satisfaction. Most of the women were generally happy with the drafts but wanted minor amendments.
Marshall revised the stories, taking their comments into account. She states that, ultimately, the woman
manager had the right of veto over what appeared in ‘her’ chapter of the book that Marshall wrote.
Later, all participants were invited to a one-day collaborative enquiry workshop, in which they jointly reviewed their
experiences of employment and discussed issues of mutual interest.
In each case, the goal is to seek confirmation that the researcher’s findings and impressions are congruent with
the views of those on whom the research was conducted and to seek out areas where there is a lack of
correspondence and the reasons for it. However, the idea is not without practical difficulties.
• Respondent validation may provoke defensive reactions and even censorship on the part of research
participants. Marshall was prepared to accept this as a consequence of her collaborative approach. Hence one
participant decided that her story made her too identifiable and vulnerable. Her reasons for this centred on the
difficulties of establishing a positive, accepted identity as a manager because she self-identified as gay.
Marshall therefore agreed to write a brief account of ‘Ruth’s’ experience.
• Research participants cannot validate the scientific legitimacy of a researcher’s analysis. Even if participants
are prepared to corroborate the researcher’s account, the researcher still has to develop concepts and theories
that make a contribution to knowledge. Marshall was therefore careful to differentiate between data—over
which participants had a right of veto (i.e. the women’s stories)—and other material over which she wished to
retain control, to put her own views and pursue her ‘more academic concerns’ (1995: 336).
Respondent validation can provide a means of confirming the validity of individual accounts. It can also help to
redress power imbalances between researcher and researched by providing participants with a degree of
involvement in and authority over the research findings. However, it is important to distinguish between seeking
validation from individuals and seeking validation from organizations, or—as is more likely—powerful individuals
within organizations, such as senior managers. The latter option, by giving powerful groups within the organization
control over the research, can introduce problems of censorship.
process of cross-checking findings deriving from both quantitative and qualitative research (Deacon et al. 1998).
For example, Kanter (1977) draws attention to the triangulation of methods that characterized her approach,
stating, ‘I used each source of data, and each informant, as a check against the others’ (1977: 337). She suggests
that ‘a combination of methods . . . emerges as the most valid and reliable way to develop understanding of such a
complex social reality as the corporation’ (1977: 337).
In addition to allowing the cross-checking of qualitative data, the combined use of quantitative and qualitative
methods may allow access to different levels of reality. However, triangulation is just one way of thinking about the
integration of these two research strategies, as will be discussed in depth in Chapter 27.
Transferability Confirmability
As qualitative research typically entails the intensive Confirmability is concerned with ensuring that, while
study of a small group, or of individuals sharing certain recognizing that complete objectivity is impossible in
characteristics (that is, depth rather than the breadth business research, the researcher can be shown to have
that is a preoccupation in quantitative research), quali- acted in good faith; in other words, it should be appar-
tative findings tend to be orientated to the contextual ent that he or she has not overtly or manifestly allowed
uniqueness and significance of the aspect of the social personal values or theoretical inclinations to sway the
world being studied. As Guba and Lincoln put it, whether conduct of the research and findings deriving from it.
or not findings ‘hold in some other context, or even in Guba and Lincoln propose that establishing confirmabil-
the same context at some other time, is an empirical ity should be one of the objectives of auditors.
issue’ (Lincoln and Guba 1985: 316). Instead, qualita-
tive researchers are encouraged to produce what Geertz
Overview of the issue of criteria
(1973) calls thick description—that is, rich accounts of
the details of a culture. Guba and Lincoln argue that a Qualitative researchers who apply the criteria of reli-
thick description provides others with what they refer to ability and validity with little or no adaptation broadly
as a database for making judgements about the possible position themselves as realists—that is, as saying that
transferability of findings to other milieux. social reality exists independently of those who are
engaged with it. Johnson et al. (2006) refer to this kind
Dependability of business research as ‘positivist-qualitative’, because
As a parallel to reliability in quantitative research, and it involves the use of non-quantitative methods but is
in order to demonstrate that qualitative research is trust- informed by largely positivistic assumptions, including
worthy, Guba and Lincoln propose the idea of depend- the idea that ‘there is a world out there to be discovered
ability. This involves adoption of an ‘auditing’ approach and explored in an objective manner’ (Johnson et al.,
which ensures that complete records are kept of all 2006: 138). Lincoln and Guba reject this view, arguing
phases of the research process—problem formulation, instead that qualitative researchers’ concepts and theo-
selection of research participants, fieldwork notes, inter- ries are representations and that there may, therefore, be
view transcripts, data analysis decisions—in an acces- other equally credible representations of the same phe-
sible manner. Peers then act as auditors, possibly during nomena. In addition to the four criteria discussed above,
the course of the research and certainly at the end, to Lincoln and Guba propose a fifth criterion of authenticity,
establish how far proper procedures are being and have which raises issues concerning the wider social and polit-
been followed. This would include assessing the degree ical impact of research. Authenticity places responsibility
to which theoretical inferences can be justified. Audit- on the researcher to fairly represent different viewpoints
ing has not become a popular approach to enhancing within a social setting, so as to enable research partici-
the dependability of qualitative business research, partly pants to arrive at a better understanding of their situa-
because of problems associated with it. One is that it is tions and empower them to engage in action to change
very demanding for the auditors, bearing in mind that their circumstances. According to Johnson et al. (2006),
qualitative research frequently generates extremely this criteriology is consistent with critical theory and is
large datasets: this may be a major reason why it has not aligned with participatory action research, which aims to
become a pervasive approach to validation. engender emancipatory change.
366 17 The nature of qualitative research
Although qualitative researchers have sought to for- puts pressure on business researchers to try to conform
mulate quality criteria appropriate to their approach, to them, even if this is inconsistent with the principles
this has not had as much impact in business research as of qualitative research, introduced at the start of this
might be expected. Pratt (2008) has shown that qualita- chapter, that may guide their study. According to John-
tive business researchers believe their work continues to son et al. (2006), the most important thing for qualita-
be judged by criteria of validity and reliability that are tive researchers is to make sure that the quality criteria
more suited to quantitative research. Cornelissen et al. they use are logically consistent with their philosophical
(2012) argue that the dominance of criteria informed by assumptions.
a positivist epistemology, such as validity and reliability,
Many qualitative studies provide a detailed account of as a manifestation of the naturalism that pervades much
what goes on in the setting being investigated. Very often qualitative research.
qualitative studies seem to be full of apparently trivial
details. However, these details are frequently important
Emphasis on process
for the qualitative researcher because of their signifi-
cance for research participants and because they provide Qualitative research tends to view social life in terms of
an account of the context where the behaviour takes processes. This tendency reveals itself in a number of
place. It is with this point in mind that Geertz (1973) rec- ways. One of the main ways is that there is often a con-
ommends the thick description of social settings, events, cern to show how events and patterns unfold over time.
and often individuals. On the surface, some of this detail As a result, qualitative evidence often conveys a strong
may appear irrelevant, and, indeed, there is a risk of the sense of change and flux. As Pettigrew (1997: 338)
researcher becoming too embroiled in descriptive detail. explains, process is ‘a sequence of individual and collec-
Lofland and Lofland (1995: 164–5), for example, warn tive events, actions, and activities unfolding over time in
against what they call ‘descriptive excess’ in qualitative context’. This includes understanding how the history of
research, whereby the amount of detail inhibits the anal- an organization shapes the present reality and how the
ysis of data. ‘interchange between agents and contexts occurs over
One of the main reasons why qualitative researchers time and is cumulative’ (Pettigrew 1997: 339).
are keen to provide considerable descriptive detail is that Qualitative research based on ethnographic methods
they typically emphasize the importance of the contex- is particularly associated with this emphasis on process.
tual understanding of social behaviour. This means that It is the element of participant observation, a key feature
behaviour and values must be understood in the situa- of ethnography, that is especially instrumental in gener-
tions where they arise. This recommendation implies ating this feature. Ethnographers are typically immersed
that we cannot understand the behaviour of members of in a social setting for a long time—sometimes years, as in
a social group other than in terms of the specific envi- Michel’s (2011) study of Wall Street bankers (Research
ronment in which they operate. In this way, behaviour in focus 19.2). Consequently, ethnographers are able to
that may appear odd or irrational can make perfect observe the ways in which events develop over time or
sense when we understand the context within which the ways in which the different elements of a social sys-
that behaviour takes place. The emphasis on context tem (values, beliefs, behaviour, and so on) interconnect.
in qualitative research goes back to many of the clas- Such findings can inject a sense of process by seeing social
sic studies in social anthropology, which demonstrated life in terms of streams of interdependent events and ele-
how a particular practice, such as the magical ritual that ments (see Research in focus 17.6 for an example).
may accompany the sowing of seeds, made little sense This is not to say, however, that ethnographers are
unless we understand the belief systems of that society. the only qualitative researchers who inject a sense of
It is often precisely this detail that provides the mapping process into our understanding of social life. This can
of context in terms of which behaviour is understood. also be achieved through semi-structured and unstruc-
The propensity for description can also be interpreted tured interviewing, by asking participants to reflect on the
Plates 17.1–17.3 show three photographs taken by respondents. Plate 17.1 is a photograph of a cup of tea from a
vending machine. When the respondent was asked why he had taken this particular picture, he raised issues
concerning his dissatisfaction with the amount of money that had been spent on the office at the expense of other
things that were more important to employees. Plate 17.2 shows a meeting room that was photographed by a
respondent who found it to be an escape and a contrast from the normal work environment. However, Warren
argues that in her study the use of photographs did not primarily entail analysis of their content. Instead the
photographs formed part of a data-generating triangle involving the image, respondent, and researcher, focusing
on the reasons why they were taken. Plate 17.3 provides a good illustration of this, since the blurred nature of this
photograph of the office space means it would be difficult to distinguish the content at all without the account
provided by the respondent, who explains that they were trying to capture the ‘busyness’ and ‘colour’ that defined
the atmosphere of the workplace. Warren also notes that photographs such as this one show how intangible
emotional concepts that are hard to communicate through language can be conveyed through images.
PLATE 17.1
‘Cup of tea from vending machine’
The photographs were then discussed in the context of an interview conversation with the respondent in a form of
qualitative photo-elicitation. Warren suggests the photographs added to the richness of data collected and were
used by respondents to give an emotional sense of the work environment.
The main preoccupations of qualitative researchers 371
PLATE 17.2
‘Thinktank: aestheticized meeting room’
PLATE 17.3
‘Blurred view of office space’
Pink (2001) draws attention to two different ways in which visual images have been conceptualized in social research.
She calls these realist and reflexive approaches. The latter approach to the visual is frequently collaborative, in the
sense that research participants may be involved in decisions about what photographs should be taken and then how
they should be interpreted. Further, there is recognition of the fluidity of the meaning of images, implying that they can
never be fixed and will always be viewed by different people in different ways. For example, in Bell’s (2012) study of
the closure of a Jaguar car manufacturing plant (Research in focus 17.8), she analysed the positionality of the person
who took the photograph or produced the image, as well as the content of the photograph itself.
372 17 The nature of qualitative research
Meyer et al. (2013) provide an overview of how visuals have been integrated into qualitative organizational
research and identify five ideal-typical approaches:
• Archaeological: based on analysis of visual artefacts in which socially constructed meaning is embodied;
Davison’s (2009) study of iconography in a UK bank (Research in focus 23.6) provides an example.
• Practice: involving the study of visual artefacts in situ, including how they are used by social actors in various
processes of organizing; an example is Bell’s (2012) study of visual expression of change and loss surrounding
the closure of a car manufacturing plant (Research in focus 17.8).
• Strategic: this builds on psychological, linguistic, or semiotic theory and involves the use of visual methods to
elicit desired responses from audiences; an example is Bell and Clarke’s (2014) study of undergraduate
student perceptions of management researchers (see Chapter 6).
• Dialogical: this type of research uses visuals as a form of communication between the researcher and the field,
such as through the use of projective techniques, pictorial, and photo-elicitation (Key concept 10.8).
• Documenting: this involves the use of visual artifacts as a form of field notes to document the research process;
examples include Buchanan’s (1998) study of the hospital patient trail discussed below.
However, Meyer et al. (2013) suggest there is still some argues that using photographs in conjunction with other
way to go before the inclusion of visual data in empirical methods of data collection helps the organizational
analyses becomes the norm rather than the exception. The researcher to:
Researcher Development pages on the website of the Inter-
national Network for Visual Studies in Organizations, in • develop a richer understanding of organizational pro-
Visio ([Link] contain information cesses;
about visual methods and the theory that informs them.
• capture data not disclosed in interview;
Photographs produced as part of fieldwork may be
analysed by the researcher alongside other types of • reveal to staff aspects of work in other sections of the
organization with which they have little or no regular
documents containing written words, such as interview
contact;
transcripts, as in the study of business process re-engi-
neering in a UK hospital by Buchanan (2001). Buchanan • offer a novel channel for respondent validation of data;
used photographs taken by himself as a way of gaining • involve staff in debate concerning the implications of
insight into the ‘patient trail’, the temporal and spatial research findings for organization process redesign
process experienced by patients. Buchanan (2001: 151) and improvement.
The main preoccupations of qualitative researchers 373
PLATE 17.4
‘An empty staff break area on the last day of production’
PLATE 17.5
‘After the last car has left the track’
Visual organizational research has great potential. visual is almost always accompanied by the non-visual—
However, Pink (2004) reminds us that visual research words—which is the medium of expression for both the
methods are never purely visual. There are two aspects research participants and the researchers themselves.
to this point. First, visual research methods are usually Further consideration of the use of visual methods in
accompanied by other (often traditional) research meth- ethnographic research and in the qualitative analysis of
ods such as interviewing and observation. Second, the documents will be provided in Chapters 19 and 23.
Numbers Words
Point of view of researcher Points of view of participants
Researcher is distant Researcher is close
Theory testing Theory emergent
Static Process
Structured Unstructured
Generalization Contextual understanding
Hard, reliable data Rich, deep data
Macro Micro
Behaviour Meaning
Artificial settings Natural settings
involved with the people they study. The qualitative to be generalizable to the relevant population, the
researcher seeks close involvement with the people qualitative researcher seeks an understanding of
being investigated, so that he or she can approach behaviour, values, beliefs, and so on in terms of the
genuine understanding of the world from their per- context in which the research is conducted.
spective.
• Hard, reliable data versus rich, deep data. Quantitative
• Theory and concepts tested in research versus theory and data are often depicted as ‘hard’ in the sense of being
concepts emergent from data. Quantitative researchers robust and unambiguous, owing to the precision
typically bring a set of concepts to bear on the research offered by measurement. Qualitative researchers
instruments being employed, so that theoretical work claim, by contrast, that their contextual approach and
precedes the collection of data, whereas in qualitative their—often prolonged—involvement in a setting
research concepts and theoretical elaboration tend to engender rich data.
emerge out of data collection.
• Macro versus micro. Quantitative researchers are
• Static versus process. Quantitative research is fre- often depicted as involved in uncovering large-scale
quently depicted as presenting a static image of social social trends and connections between variables,
reality with its emphasis on relationships between whereas qualitative researchers are seen as con-
variables. Change and connections between events cerned with small-scale aspects of social reality, such
over time tend not to surface, other than in a mecha- as interaction.
nistic fashion. Qualitative research is often depicted as
• Behaviour versus meaning. It is sometimes suggested
attuned to the unfolding of events over time and to the that the quantitative researcher is concerned with
interconnections between the actions of participants people’s behaviour and the qualitative researcher with
of social settings. the meaning of action.
• Structured versus unstructured. Quantitative research
• Artificial settings versus natural settings. Whereas
is typically highly structured, so that the investigator is quantitative researchers conduct research in a con-
able to examine the precise concepts and issues that trived context, qualitative researchers investigate
are the focus of the study; in qualitative research the people in natural environments.
approach is invariably unstructured, so that the pos-
sibility of getting at actors’ meanings and of concepts However, as we will see in Chapter 26, while these con-
emerging out of data collection is enhanced. trasts depict reasonably well the differences between
• Generalization versus contextual understanding. quantitative and qualitative research, they should not be
Whereas quantitative researchers want their findings viewed as constituting hard and fast distinctions.
378 17 The nature of qualitative research
Researcher–participant relationships
A further difference between quantitative and qualitative • It is intended to contribute both to academic theory
research arises from the way that qualitative research- and practical action.
ers relate to research participants. Qualitative research-
ers tend to take greater account of the power relations Eden and Huxham (1996) define the characteristics
that exist between the researcher himself or herself and of action research in terms of outcomes and processes.
the people who are the subject of study. This has led to Good and effective action research should have the fol-
the development of several qualitative approaches that lowing outcomes.
enable research participants to play a more active part
in designing the research and to influence the outcomes
of the process. Action research, feminist, collaborative,
• It should have implications that relate to situations
other than the one that is studied.
and participative forms of enquiry all fall into this cat-
egory. We will consider the main features of each of these • As well as being usable in everyday life, action research
approaches and explore the implications that they have should also be concerned with theory.
for researcher–participant relationships. • It should lead to the generation of emergent or
grounded theory, which emanates from the data in
gradual incremental steps.
Action research
There is no single type of action research, but business • Action researchers must recognize that their findings
researchers generally characterize it as an approach to will have practical implications and they should be
study in which there is an explicit commitment ‘towards clear about what they expect participants to take away
achieving social or organizational change at various from the project.
levels through intense contact between researcher and • The collection of data is likely to be involved in the
community members researched’ (Burns et al. 2014: formulation of the diagnosis of a problem and in the
133). A common theme concerns the need for research evaluation of a problem. Data collection methods
to be useful to research participants. Action research is can include keeping a diary of subjective impres-
therefore based on close ‘involvement with members sions, a collection of documents relating to a situa-
of an organization’ over a matter that is of ‘genuine tion, observation notes of meetings, questionnaire
concern to them’ (Eden and Huxham 1996: 75). The surveys, interviews, audio or video recordings of
action researcher works closely with the research com- meetings, and written descriptions of meetings or
munity to co-produce knowledge that is of mutual interviews (which may be given to participants for
benefit. Action research is defined by Argyris et al. them to validate or amend). In action research, the
(1985) as follows: investigator becomes part of the field of study, and,
as with participant observation, this has its own
• Experiments are on real problems within an organiza-
attendant problems. In their action research study of
tion and are designed to assist in their solution.
an outpatient health centre, Ramirez and Bartunek
• This involves an iterative process of problem identifi- (1989) found themselves caught up in a conflict
cation, planning, action, and evaluation. about organizational roles and loyalties. Some mem-
• Action research leads eventually to re-education, bers of the organization began to spread rumours
changing patterns of thinking, and action. This intended to discredit the action researcher (who was
depends on working closely with research participants an internal consultant), suggesting that she was
(sometimes referred to in action research as ‘clients’) using the project to further her career within the
in identifying new courses of action. organization.
380 17 The nature of qualitative research
Their study was a case study of Ghanaian cocoa farmers, focusing on gender equality issues. The researchers ran
participant workshops with a translator, a cooperative supplier, and 48 cocoa farmers in four villages in Ghana.
The researchers used participant-produced drawings and group discussion as the main sources of data. One of
the benefits of this method was that it helped to overcome difficulties associated with studying groups that have
low levels of literacy. The image data and focus group discussions were analysed thematically in NVivo (the use of
NVivo will be covered in Chapter 25).
One of the drawing exercises involved asking participants to draw a ‘gender tree’ in the form of a simple image of a
tree with roots and branches (see Plate 17.6 for an example). On one side of the tree participants were asked to
represent women’s work/expenditure or ownership, using a series of pictorial symbols to indicate the type of
activity (Plate 17.7), and on the other men’s work/expenditure or ownership. In the middle they were asked to
indicate shared work/expenditure or ownership. In facilitated, same-sex focus groups (focus groups are covered in
Chapter 21), participants were subsequently asked questions about whether the tree was ‘balanced’. Crucially, the
participant-produced drawings provided a basis for discussion through which the farmers and suppliers were able
to explore the reasons for women’s marginalization from cocoa farming, as a consequence of unequal distribution
of domestic work, and to think about how these inequalities could be addressed in future.
Burns et al. (2014) use the term ‘participatory organi- interactions with researchers. Their particular study
zational research’ to refer to a specific type of action- focused on the treatment of older people living in care
oriented research that is concerned with enabling ‘less homes. Key to their use of this method was the organiza-
powerful members of organizations, those who may tion of panel group meetings where residents met with
normally go unheard, to gain a voice’ (2014: 134). P. other stakeholders to engage in open discussion. The
Park (1999) describes participatory research as focused creation of spaces for people to engage openly with one
on disempowered groups who can be helped through another enabled issues to be raised that might otherwise
research that addresses problems related to their wel- have gone unexplored. For an example of participatory
fare in an organized way. The researcher should ideally action research using visual methods, see Research in
be someone who is familiar with the community and focus 17.10.
committed to working towards improving their condi- Action research is criticized, in a similar way to
tions. This, he argues, is what differentiates participa- other qualitative methods, for its lack of repeatability
tory research from other types of action research which and consequent lack of rigour and for concentrating
is concerned only with solving problems of an organi- too much on organizational action at the expense of
zational, job-related nature. Burns et al. (2014) suggest research findings. In their defence, action researchers
that participatory organizational research is especially claim that involvement with practitioners concerning
important in studies that involve vulnerable groups who issues that are important to them provides a richness
might otherwise be at a power disadvantage in their of insight that cannot be gained in other ways. It is also
Researcher–participant relationships 381
PLATE 17.6
Gender tree and summary explanations, drawn by female participant in Western Region, Ghana
Expenditure Expenditure
The woman makes Income is spent
desisions on and jointly on school fees,
buys medicine, funeral attendance,
fertilisers, and transport, housing,
pesticides, and land. But the man
clothing, has overall control of
hairdressing, and the finances and
accessories. purchases the food.
Ownership/
control Work
the woman is The man does most of
the cooperative the cocoa work,
member and owns including the selling
part of the land. of the selling of the
She has also cocoa beans
received a
loan, which she
spent on land and
school fees
(circled).
Work
The woman does all the household
chores, as well as rearing fowl and selling
cassava, pineapple, aubergine, and onions.
She is in charge of drying cocoa, and
fetching water for the farm.
claimed that theory generated from action research is Feminism and qualitative research
‘grounded in action’ (Eden and Huxham 1996), thereby
overcoming some of the difficulties of relying on talk as A further dimension to this discussion is that, in the view
a source of data, instead of action or overt behaviour. of some writers, qualitative research is aligned with
Action research should not be confused with evalu- feminist philosophical principles, whereas quantitative
ation research (see Key concept 3.9), which usually research is not. Feminist research has an important role
denotes the study of the impact of an intervention, to play in business research, which is often designed and
such as a new social policy or a new innovation in conducted from implicitly male or masculine perspec-
organizations. tives (see Thinking deeply 17.11).
382 17 The nature of qualitative research
PLATE 17.7
Example of symbols co-created between researchers and local staff
Unpaid Work: Cooking; childcare; sweeping; cooperative membership; carrying water; carrying
firewood; washing & drying clothes; cooperative committee membership position.
Researcher–participant relationships 383
Quantitative research is frequently viewed as incom- By contrast, qualitative research is viewed by many femi-
patible with feminism for the following reasons: nists as either more compatible with feminism’s central
ideas or as more capable of being adapted to its purpose
because it allows:
• Mies (1993) argues that quantitative research sup-
presses the voices of women either by ignoring them or • women’s voices to be heard;
by researching women in a value-neutral way, when in • exploitation to be reduced by giving as well as by
fact the goal of feminist research should be to conduct receiving in the course of fieldwork (for an example of
research specifically for women. personal connections made during the course of field-
• The criterion of validity, which is commonly associated work, see Research in focus 17.12);
with quantitative research, turns women, when they • women to be researched without attempts being made
are the focus of research, into objects. This means that to control them through the researcher’s application of
women are subjected to exploitation, in that knowl- technical procedures; and consequently,
edge and experience are extracted from them with
• the emancipatory goals of feminism to be furthered.
nothing in return, even when the research is conducted
by women (Mies 1993). How qualitative research contributes towards these
goals will be addressed in Chapters 19, 20, and 21, by
• The emphasis on controlling variables adds to this, if
looking at feminist approaches to ethnography, qualita-
the idea of control is viewed as a masculine approach
tive interviewing, and focus groups. However, business
to study.
research has a tendency to ignore or marginalize gen-
• The use of predetermined categories in quantitative der in terms of the way that research topics are defined.
research emphasizes what is already known and con- Mirchandani (1999) observes that research on women’s
sequently perpetuates ‘the silencing of women’s own experiences of entrepreneurship focuses on identifying
voices’ (Maynard 1998: 128). similarities and differences between female and male
• The quest for universal laws may be inconsistent with business-owners, and on providing explanations of these
feminism’s emphasis on the situated nature of social differences. She argues that, although this is useful in
reality, which is seen as embedded in social identities compensating for the exclusion of women in earlier stud-
(based on gender, ethnicity, sexual orientation, class, ies, it does not explain why entrepreneurship is defined
etc.) that are unique to individuals (Miner-Rubino and understood only in terms of the behaviour of men.
et al. 2007). Mirchandani argues that the construction of the category
384 17 The nature of qualitative research
of ‘the female entrepreneur’ prioritizes gender over other research practice rather than about feminist methods
important aspects of identity, such as social stratification, (Maynard 1998: 128).
business ownership, organizational structure, and indus-
try, that need to be explored in relation to female and
male business-owners. Postcolonial and indigenous research
However, some feminist researchers are positive
A further way in which researcher–participant relation-
towards quantitative research. Some of their arguments
ships have been challenged in recent years is through
follow:
postcolonialist critique of practices of social scientific
• The worst discrimination against women might not knowledge production, which are based on a conception
have been recognized so clearly if not for the collection of research which developed in the countries of Europe
and analysis of statistics revealing exclusion (Maynard and North America that was subsequently exported to
1994; Oakley 1998). Factual evidence of this kind the global South. This relies on the assertion that ‘social
allows the case for equal opportunities legislation to be science can have only one, universal, body of concepts
made much more clearly, for example. and methods, the one created in the global North’ (Con-
nell 2007: ix). Writers such as Connell challenge this by
• Miner-Rubino et al. (2007) suggest that knowledge
about the distribution of attitudes and behaviours in a exposing the hidden biases contained within theories
sample can be used to establish the most appropriate produced from within the global North which claim uni-
course of action for social change. versal relevance based on the assumption that ‘all soci-
eties are knowable, and they are knowable in the same
• As Jayaratne and Stewart (1991) and Maynard (1994,
way and from the same point of view’ (Connell 2007:
1998) note, research that combines quantitative and
44). Such an approach is suggested to be inherently
qualitative methods is not incompatible with the femi-
colonizing, involving the abandonment of local cultural
nist cause.
knowledge and the imposition of discourses of scientific
• There has also been a recognition of the fact that qual- research that are claimed to be neutral but that involve
itative research is not ipso facto feminist in orienta- the assertion of imperialist neocolonial power relations
tion. If, for example, ethnography (see Chapter 19) of oppression and domination. This can be seen from
required a feminist sensitivity, we would expect sub- the ways in which scientific research has been used as
jects such as social anthropology, which have been a tool of colonialist exploitation: for example, Prasad
virtually founded on the approach, to be almost inher- (2003) points out that ethnography (see Chapter 19)
ently feminist, which is definitely not the case (Rein- was used in the nineteenth century and the early twen-
harz 1992: 47–8). The answer to the question ‘What tieth by imperialist European powers of Britain, France,
are the best approaches to feminist research?’ seems and the Netherlands, to gather data about Asian and Afri-
to lie in the application of methods rather than in can cultures which enabled their subjugation and expla-
something that is inherent in them. Consequently, nation, ‘by carving out identities of the Western self and
some writers have preferred to write about feminist
Key points 385
the non-Western Other, and by delineating relationships them to find their own academic voice and identity; the
between them through a series of hierarchical opposi- focus is thus on the ethics of research and the implications
tional categories’ (Prasad 2003: 155). She argues that for communities of research. These ideas are potentially
the concept of the ethnographic imagination, based on highly significant in understanding globalization and its
discourses of primitivism, orientalism, and tropicaliza- effects in fields such as international and comparative
tion, which the colonial project entailed, can still be seen management and business. For example, Jack and West-
in many recent ethnographic accounts of fieldwork which wood (2006) use ideas from postcolonialism to argue
celebrate risky adventures in ‘foreign’ lands. that researchers in these fields, even those committed to
These critiques have opened up spaces for the con- qualitative methods, have been slow to acknowledge the
struction of alternative approaches to knowledge produc- political nature of research in reflecting the interests and
tion, in the form of indigenous research methodologies, a values of the researcher. They propose an alternative, in
term which invites exploration of methods that enable the form of a postcolonial epistemology which enables
the voices of colonized peoples to be heard, in addition the universalizing tendencies of Western knowledge sys-
to non-human interests related to ecosystems (Tuhi- tems, which construct and legitimate the dominance of
wai Smith 1999). Informed by feminist approaches to the West as a source of knowledge about international
research, indigenous methodologies seek to disrupt business, to be resisted. Research in focus 17.13 provides
established relationships between (mostly non-indige- an example of how these ideas have also been applied in
nous) researchers and indigenous peoples and enable the field of leadership.
!
KEY POINTS
● There is disagreement over what precisely qualitative research is.
● Qualitative research does not lend itself to the delineation of a clear set of linear steps.
● It tends to be a more open-ended research strategy than is typically the case with quantitative research.
● Theories and concepts are viewed as outcomes of the research process.
● Visual materials, such as photographs and video, have attracted considerable interest among
qualitative business researchers in recent years, not just as adjuncts to data collection but as objects
of interest in their own right.
386 17 The nature of qualitative research
● There is considerable unease about the simple application of the reliability and validity criteria
associated with quantitative research to qualitative research. Indeed, some writers prefer to use
alternative criteria that have parallels with reliability and validity.
● Most qualitative researchers reveal a preference for seeing the social world from the perspective of
research participants.
● Several writers have depicted qualitative research as having a far greater affinity with a feminist
standpoint than quantitative research.
● Action research, feminism, and indigenous methods of enquiry have changed the relationship
between researchers and research participants.
Researcher–participant relationships
● What is action research?
● What is participatory organizational research and how has it been used by business researchers?
● What is the relationship between feminism and qualitative research and how might this be important
in the study of business and management?
● What are the distinguishing features of indigenous and postcolonial methodologies and how can they
be applied in business research?
ONLINE RESOURCES
[Link]/uk/brm5e/
Visit the Interactive Research Guide that accompanies this book to complete an exercise relating to
the nature of qualitative research.