Research Methods
Research Methods
Nigussie Dechassa
Gemechu Keneni
Seyoum Bediye
Nigussie Alemayehu
ISBN: 978-99944-66-71-9
Correct Citation
Nigussie Dechassa, Gemechu Keneni, Seyoum Bediye, and
Nigussie Alemayehu. 2022. Research Methods A
Handbook for Agricultural Researchers. Ethiopian Institute
of Agricultural Research, Addis Abeba, Ethiopia.
[iv]
I. FOREWORD
[i]
knowledge and build their research skills through hands-on
practical activities while working as researchers through trial and
error. Hence, for an inexperienced and novice researcher, it would
take quite a long time before honing their skills and gaining the
deepening their knowledge needed to conduct sound research and
write quality scientific papers, which for many, would be
achievable perhaps only after they are past their prime work life.
Consequently, to a larger extent, at the beginning of their careers,
junior researchers often take a leap in the dark without being well
guided or versed in research knowledge and skills. As a result,
most of the research they conduct is likely to be methodologically
flawed, resulting in compromised qualities of the technologies
developed and information/knowledge generated. In this
connection, junior researchers also face acute challenges in
identifying appropriate research problems, developing relevant
proposals, conceptualizing the process of data collection,
analyzing data, interpreting research results, and writing research
papers articulated for various target audiences.
To tackle these problems, it is, thus, essential to equip junior
researchers coming into the research system with refreshing
necessary tools and means by which they could build their
knowledge and research skills. Therefore, apart from providing
training and mentoring tailored to their needs, availing source
documents on research methods like this Handbook, is
instrumental in building their capacity.
At this juncture, while taking, the opportunity to thank the
Agricultural Transformation Institute (ATI) for financially
supporting the Ethiopian Institute of Agricultural Research
(EIAR) to produce this important document, I extend my sincere
[ii]
appreciations to the ENARESS Team for accomplishing the task. I
strongly believe that not only junior agricultural researchers but
also other researchers in Ethiopia and elsewhere with similar lines
of interest will find this Handbook an invaluable resource for
expanding and deepening their knowledge and skills on planning
and conducting sound agricultural research and for writing quality
research papers.
[iii]
II. PREFACE
[iv]
The Handbook is primarily intended for young graduates, who are
laden with the energy and enthusiasm, but lack the necessary
experience and skills to make agricultural research their
professional career. It is also intended to serve others engaged in
the field agriculture such as technical workers, trainers, teachers,
and students who require organized information on how to plan
and conduct research; collect, analyze, and interpret data; and
how to write quality research reports targeting various audiences.
However, this Handbook does not pretend to be an exhaustive
source of knowledge on experimental designs, methods of data
analyses, and writing scientific papers. It is rather framed to be a
repository of research methods whereby junior and novice
researchers would be inspired to further equip themselves with
the necessary knowledge and skills to embark on conducting
quality research by referring to relevant standard textbooks for
deeper understanding of the subject matter.
Nonetheless, it is hoped that the Handbook will also serve
agricultural researchers and students requiring a quick reference
to turn to when faced with the challenges and gaps on the basics
of conducting sound researches, collecting and analyzing data,
and generating information thereof as well as writing research
reports presentable to various target audiences at various levels of
knowledge.
I, on behalf of the authors, would like to put on record the
relentless support provided by the management of the Ethiopian
Institute of Agricultural Research (EIAR) to run the ENARESS
(Enabling Next-generation Agricultural Researchers through
Engaging Seasoned Scientists- Phase II) Project in general and to
produce the Handbook in particular. I also extend, with the same
[v]
breadth and depth, my words of thanks to the Agricultural
Transformation Institute (ATI) for financing this Capacity
Building Project as well as technically fortifying all the way
through the course of its implementation. Dr Getachew Belay
generously lent us a helping hand with reviewing the draft
Handbook critically and his input was instrumental in giving the
document its present shape. ENARESS, thus, extends its sincere
appreciation to him.
[vi]
SECTION I. GENERAL
1. Introduction
[7]
Research may be stimulated by several purposes. The first
stimulating factor to do research could be inquisitiveness for
discovery or interest to discover something new. In fact, most of
the advances in science are attributed to the inquisitiveness to find
something new. The second incentive could be the desire to gain
reputation in science, which stimulates researchers to define and
redefine theories, principles, and other concepts to enhance their
status and gain acceptance and prestige. The third motivating
factor for doing research could be the desire to gain in-depth
knowledge, i.e. the interest to deepen and broaden one’s
knowledge. A person who undertakes research on a subject gets
an opportunity to study that subject in depth. The fourth
motivating factor could be related to the desire to provide services
to society by addressing or solving problems afflicting the
society. In agricultural research, the motives include tackling food
insecurity and climate change. Likewise, need for publications
towards a successful career building in an academic or research
institution and obtaining a higher degree by students may also
require publishing research papers which stimulates them to do
research.
[8]
1.2. Characteristics of good research
[14]
1.4. Research and scientific method
[16]
The scientific method often consists of the following main steps:
making observations or gathering information; developing a
hypothesis to predict results; designing an experiment; conducting
the experiment and collecting data; evaluation and conclusion;
and accepting, modifying, or rejecting the hypothesis.
[17]
the logic behind them. In this connection, it is important to
understand that researchers should know not only how to develop
certain indices or tests, how to calculate the mean, the mode, the
median or the standard deviation or Chi-square, how to apply
particular research techniques, etc., but they should also know
which of these methods or techniques are relevant, which are not
relevant, and what those techniques mean and why.
[19]
(b) Statistical techniques used for establishing relationships
between the data and the unknowns
(c) Methods which are used to evaluate the accuracy of the
results obtained.
[20]
SECTION II. BACKGROUND TO
RESEAECH METHODS
[21]
2.1. Formulating the research problem
[25]
exploratory or formulative research, which does not aim at testing
the hypothesis.
[26]
If the purpose of the research study is exploration, it is
appropriate to formulate a flexible research design, which
provides an opportunity for considering many different aspects of
a problem. However, if the purpose happens to be an accurate
description of a situation or of an association between variables, a
suitable design will be one that minimizes bias and maximizes the
reliability of the collected data.
There are several research designs, which include, experimental
and non-experimental hypothesis testing. Experimental designs
can be either informal designs (such as before-and-after without
control, after-only with control, before-and-after with control) or
formal designs (such as completely randomized design,
randomized block design, Latin square design, simple and
complex factorial designs, etc.), out of which the researcher must
select one for his own project. Planning the research design that is
appropriate for a particular research problem requires
consideration of the following points: (i) the means of obtaining
the information; (ii) availability and skills of the researcher and
his staff (if any); (iii) explanation of the way in which selected
means of obtaining information will be organized and the
reasoning leading to the selection; (iv) the time available for
research; and (v) the cost factor relating to research, i.e., the
finance available for the purpose.
[27]
a population in an inquiry, no element of chance would exist and
the highest accuracy would be obtained. However, census inquiry
is not possible in practice under many circumstances. Besides, an
inquiry of all items of a population will involve a lot of time,
money, and energy. Hence, only a few items are selected for a
study. The items so selected constitute what is technically called a
sample. The researcher must select a sampling design. A
sampling design is a definite plan determined before any data are
actually collected for obtaining a sample from a given population.
Samples can be either probability samples or non-probability
samples. With probability samples, each element has a known
probability of being selected in the sample but the non-probability
samples do not allow this possibility. Probability samples are
those based on simple random sampling, systematic sampling,
stratified sampling, cluster/area sampling whereas non-probability
samples are those based on convenience sampling, judgement
sampling and quota sampling techniques.
2.6. Conducting research
[29]
2.9. Testing hypothesis
[30]
findings on the basis of some theory. This is known as
interpretation. Interpretations may lead to new questions and
further research.
3. Types of Research
Research is often categorized as basic research, applied research,
descriptive research, analytical research, quantitative or
qualitative research, conceptual or empirical research,
experimental or non-experimental research, retrospective or
prospective research, and cross-sectional or longitudinal research.
[31]
First, based on the application of the results, research is broadly
divided into two, i.e., basic research and applied research.
3.1. Basic research
[32]
3.2. Applied research
[33]
the process of transferring knowledge gained through research
into operational programmes such as farmer training materials,
teacher-training materials, and student learning materials, etc.
Descriptive versus analytical research
[34]
Descriptive or exploratory research can be done in both natural
sciences and social sciences. In natural sciences including
agriculture, this type of research is used for describing nature
such as anatomy of an organism by observation through the naked
eye, or through microscope. In biology, systematic or taxonomic
studies are also descriptive studies that involve naming and
classifying organisms.
Analytical research
Analytical research is the type of research done to determine why
the state of affairs is the way it is or how this may have happened.
Analytical research is often used to designate associations
between variables and analyse them for possible cause and effect
relationships. In analytical research, a researcher uses already
[35]
available or generated data or information and analyses it
critically to address the problem or to provide answers.
[37]
subjective rather than being objective. Qualitative research or its
design is customarily used under any condition that little is known
about a particular phenomenon or concept. After the concepts,
ideas, and themes are identified and known about a phenomenon,
through qualitative research, it is usual to investigate the
phenomenon further using a quantitative approach.
Conceptual research
Conceptual research is often applied to certain abstract ideas,
concepts, or theories. It is a type of research in which the
investigator usually divides a theory or a concept into several
components for understanding it better. Conceptual analysis of
the information is the usual method but other methods of analysis
could be combined with this method of analysis for better results.
Conceptual research is most frequently used in social sciences
(e.g. philosophy). Philosophers and thinkers often use it to
advance new concepts or theories to reinterpret current ones.
Empirical research
Under empirical research, data are collected through observation
and experiments. The researcher formulates a hypothesis based on
the facts he or she observes, which can be falsified or verified
through research by observation (survey) or by conducting
[38]
experiments. Under this type of research, the researcher generates
data to prove or disprove the hypothesis, using a suitable design
and by manipulating the materials in question. Empirical research
is often applied when it is required to know if certain variables
affect some other variables. Data generated through empirical
research are considered the most powerful basis for accepting or
rejecting a hypothesis. Empirical studies are the most common
methods of research in scientific studies because observation and
experimentation provide direct evidence for accepting or rejecting
hypotheses.
Experimental research vs. non-experimental research
Experimental research
Quantitative research designs, which are used for measuring the
relations between independent variable and dependent variables,
could be either experimental or non-experimental. An
experimental research is the type of research in which the
independent variable is directly manipulated by the researcher by
keeping other variables constant as much as it could be. In this
type of research, a cause and effect relationship is established by
excluding all other factors that might be responsible for a
particular outcome.
[39]
study is conducted beginning from the cause and proceeds to the
effects, it is called experimental research. In this case, the
independent variable can be observed, introduced, controlled, or
manipulated by the investigator.
Non-experimental research
Non-experimental research is the type of experiment used to
describe, differentiate, or examine associations between or among
variables, groups, or situations. Thus, if a quantitative study
begins from the effects to trace the cause, it is non-experimental
research. In this case, unlike in experimental research, it is not
possible to observe, introduce, control or manipulate the
independent variable since the postulated cause has already
occurred. In this type of research, manipulating variables,
assigning treatments randomly, and comparing groups are
normally absent. Thus, with a hindsight the researcher relates the
outcomes to the causes.
However, there are certain studies that have both the prospective
and retrospective components. In this case, past and future trends
are studied together.
Semi-experiment or quasi-experiment
A semi-experiment or quasi-experiment is the type of experiment
in which part of the research is experimental but the other part of
it is non-experimental.
4. Variables in Research
[41]
In general, variables that are studied during a research process can
be of two different types. These are measurable and non-
measurable. Height, weight, length, income, number of family
members, number of pods per plant, number of grains per panicle,
yields of crops per unit area of land, number of insects per plant,
area under disease, milk yield per cow per day, lactation milk
yield, age at first calving, calving interval, prices of different
commodities at different markets at a particular point of time,
etc., are a few examples of measurable variables. The above
measurable characteristics/variables are known as quantitative
characters/variables.
[42]
Therefore, a variable is a character, condition, or concept that can
be measured and can take different values. Crop yields, plant
height, leaf area index, plant canopy width, crop quality, carcass
weight, etc. are variables because they can take different values.
In social and health science research, gender, age, agreement,
educational level, attitude, programme, treatment, medicines,
diets, blood pressure, body weight, etc. are some of the variables.
Sex could be considered as a variable while its values, say male
or female for particular person, could be considered as a variate.
[43]
experimental research, the independent variable, also known as
experimental variable or predictor variable, is the one
manipulated by the investigator. However, the dependent variable
or outcome variable is measured for response due to the
independent variable, which may be a treatment, programme, or
cause.
[44]
as gender, age, education level, body weight, race, ethnicity, etc.
cannot be manipulated. Such variables are called status variables
or attribute variables because they mirror the characteristics or
status of the study population. These attributes are already fixed
and cannot be changed. Researchers cannot manipulate status
variables. However, researchers can treat status variables as
independent variables and investigate their effects employing
appropriate research designs.
[45]
Quantitative and qualitative variables
Quantitative variables are variables that can be measured and
quantified directly whereas qualitative variables are variables that
cannot be measured directly. Examples of quantitative variables
include such characters as height, weight, length, etc. Examples
of qualitative variables or characters include creed, colour,
religion, ideology, gender etc. Such qualitative variables are also
called categorical variables. However, there are cases when some
qualitative variables can be considered as quantitative variables.
For instance, seed dormancy is a qualitative character but if a
researcher takes into account the number of days taken for
germination after breakage of the dormancy, this character may
turn out to be a quantitative character.
[47]
Continuous variables are often further divided into interval and
ratio variables. An interval variable is similar to an ordinal
variable indicated above. However, the intervals are spaced
equally (ordinal variables have no absolute values and the
intervals are not equally spaced). In variables such as this one, the
intervals can be measured numerically along a range. For
instance, the difference between 6°C and 7°C is same as the
difference between 15°C and 16°C. The interval is the same, and
hence, the difference between the characters is also the same.
Dependent variable
A dependent variable is a type of variable whose values are
dependent on the values taken by the other variables and their
relationship. Generally, in relational studies, a variable is
influenced by other related variables. In a production function
analysis, there exists a functional relationship between the output
and the factors of production. Here, the output is considered as
dependent variable which depends on the factors of production
like land, labour, capital, and management. In socioeconomic
studies, the adoption index (dependent variable) with respect to
the adoption of a particular technology may depend on a number
of socioeconomic factors like age (x1), caste (x2), education (x3),
family type (x4), social status (x5), economic conditions (x6), area
under cultivation (x7), and the size of holding (x8). Thus, one can
write y = 𝑓(𝑥1, 𝑥2, 𝑥3, 𝑥4, 𝑥5, 𝑥6, 𝑥7, 𝑥8). In this example, y is
the dependent variable and x1 ... x8 are the independent variables.
One can use a functional relationship to predict the values of a
dependent variable for a given set of values of the variables x 1 ...
x8. As such, y is also known as predicted variable and x 1 ... x8 are
known as predictor variables.
[48]
Independent variable
In any relational analysis, variables which help to predict the
dependent variable using the functional relationship are known as
independent variables. In the above example, x1 ... x8 are said to
have no association among themselves and are termed as
independent variables. These variables independently help in
predicting the dependent variable. Generally, in regression
analysis, predictor variables are synonymous with independent
variables.
Explanatory variables
Independent variables are sometimes known as explanatory
variables, i.e. any variable which explains the response of the
dependent/predicted variable. In a simple regression analysis,
there are only one predictor and one response variable. In a
multiple regression analysis, generally, there is one response or
predicted variable with more than one
predictor/explanatory/independent variables. In the case of system
of simultaneous equations model, there may be more than one
response variable and more than one
predictor/independent/explanatory variable. Moreover, the
response variable(s) in one equation may be the explanatory
variable in the other equation.
Stimulus variable
The idea of stimulus and response variables is familiar in
agriculture, socioeconomic, and clinical studies. A stimulus is a
type of treatment applied to the respondents to record their
response. In clinical studies generally, the doses, concentrations,
different chemicals, etc., form a stimulus, whereas the response
may be in the form of quantitative response. When a stimulus is
[49]
applied to a record response, the response may be either-or type,
or it may be measurable. In an either-or type of response, a
respondent will either respond or not respond after being applied
with the stimulus. The different concentrations of a particular
chemical in controlling a particular pest of a particular crop may
kill the pest or may not; the response is either to kill or not to kill.
On the other hand, applications of insulin at a particular dose can
help in reducing the blood sugar level, a measurable response.
[51]
grades and vice versa. Similarly, in a study of constraint analysis,
farmers may be asked to indicate the importance of the following
constraints in accordance with their perception by using codes
from 1 to 8: 1 for weather, 2 for finance, 3 for irrigation, 4 for
marketing, 5 for price of input, 6 for price of output, 7 for non-
availability of good quality seed, and 8 for non-availability of
appropriate technology. The farmers, based on the way they
perceive, have to arrange the above eight constraints from 1 to 8,
with 1 being allotted to the most important constraint and 8 being
allotted to the least important constraint.
Multiple response variables
In multiple response variables, a variable can assume more than
one value. In a social, economic, market research, etc., it becomes
very difficult for respondents to select a particular option against
the other alternatives; rather, they opt for combinations of
absence. A typical example is the use of modern-day high-tech
mobile phones. If a respondent is asked to indicate the purposes
of using mobile phones in his/her daily life, the respondent could
score more than one category out of the following options: 1 for
talking to people at distant places, 2 for using GPS for daily life
activities, 3 for using its camera to take pictures, 4 for listening to
music, 5 for using it to add, subtract, and multiply numbers in
their daily life, etc. To some users, talking to people at different
places along with listening to music may be of equal and top
priority. To others, it may be the talking to people at distant
places along with the use for adding, subtracting, and multiplying
numbers that is of equal or top priority. Thus, in both cases, the
user has no preference to select one at top most priority rather
than the other ones. As such, there are multiple responses to a
given query.
[52]
Target variable
A target variable is almost synonymous with that of a dependent
variable in a classical regression analysis. The main objective is
to target a variable (predicted variable) whose value(s) is required
to be predicted taking the values of the other variables and also
the relational form.
Weight variable
A weight variable specifies the weightage to be given to different
data sets/subsets. A weight variable may be continuous or discrete
in nature. In a given data set, if “0” is assigned to any row of data,
then that particular row could be ignored. On the other hand, a
weightage given to rows 1, 2, 3, etc., means the rows concerned
have different importance.
Extraneous variables
Extraneous variables are variables that cannot be controlled but
could have a significant influence on the results of the research.
Extraneous variables fit the category of neither dependent nor
independent variable. For instance, take two variables, irrigation
and yield. Yield is affected not only by irrigation but also by
many other factors. For example, when there is a yield increase in
response to applying a fertilizer, only part the response can be
explained by the effect of the fertilizer applied. Likewise, the
relationship between the performances of milking cows may be
influenced by factors like age, conditions of shelter, weather
condition, etc. Thus, factors like age, conditions of shelter, and
weather conditions are extraneous factors/variables in a relational
study of the milk yield of cows. Overall, the values of these
variables are not directly obtained from the system under study,
but these variables may affect the dependent/response/predicted
[53]
variables. Thus, unexplained variability may occur due to
variability in other factors and not all the other factors or
variables that influence yield can be categorized as dependent or
independent variables.
[54]
study. This is an ideal situation; however, guaranteeing such an
ideal situation is difficult in most cases. This is because the
influence of not all extraneous variables can be excluded.
However, the researcher can limit the influence of external
variables to the minimum by using the principles of
experimentation and including a ‘control’ treatment.
[56]
Likewise, observation is a common method of research in
physical sciences such as astronomy, geology, oceanography,
meteorology, etc. Using the data collected by observing a natural
phenomenon, a researcher can test a hypothesis. In social
sciences, it sometimes happens that researchers set on research on
humans or animals by observing them in their natural
environment and collect data on their activities and responses. In
natural sciences also, it is common to observe animal or groups of
animals, plant or plant communities, or some physical phenomena
to collect data. Observation is also the main method of research in
ecology even though experimental methods can also be used in
ecological research.
[57]
including the philosophy of persons and groups at any remote
point of time.
[58]
research method used to study any group of people for describing
their socio-cultural activities, patterns, diversity, etc. at home and
abroad. The method involves the collection of data on many
variables, which cannot be statistically but descriptively narrated
and documented.
The most common approach to conduct ethnographic studies is
participant observation, in which case the researcher happens to
live with the people he/she studies, chronicles and extensive field
notes. The researcher participates in the routine activities of the
people being studied, restructures their relations and events in the
field notes taken on the spot or as soon as possible after they
happened.
[59]
single instance of some physical phenomenon. Case studies are
also valuable when researchers are unable to conduct
experimental studies. Case studies often provide in-depth
information about a phenomenon and give way to a broader study
later.
Case studies are often used in both natural and social sciences. A
case can be anything that a researcher wants to investigate, which
includes a person, a group, an event, a decision, a process, a
policy, period, institution, or any other system that can be studied
historically. The case may be a plant, a group, process, a disease,
a community, or any other similar unit. A case study is
appropriate to discover intensively the background, status, and
environmental interactions of a given social unit, individual,
group, institution, or community. Case studies are common to
identify the social, natural, and background factors that might
have caused something to an individual or a group.
As common features, case studies need to focus on a selected
case; provides an in-depth understanding of an issue; and data can
be collected in many different ways such as observations,
interviews, and secondary data review.
Case studies, despite their importance, have also limitations. First,
case studies are mostly descriptive in approach, and not analytical
or explanatory. Secondly, case studies involve a lone case or just
a few cases only because of which they may not fully represent
the target population. Thirdly, since case studies are based on
information obtained from different people or other sources, there
could be a higher chance of excluding important details. Fourthly,
since retrospective data of past occurrences are collected in case
[60]
studies, the problem is connected with memory that may constrain
accuracy of information.
[61]
5.6. Modelling method
[62]
Similarly, several empirical models have been developed for
estimating water consumptive use of crops from routinely
measured meteorological data. Many of them have been
determined and tested locally in Ethiopia. It is possible to select a
suitable empirical formula such as Penman–Monteith to calculate
the reference crop evapotranspiration (ETo), and using the crop-
coefficient, crop evapotranspiration (ETc) can be estimated.
Fitting models is common in research areas including agriculture,
and others.
[63]
problem is diagnosed first, remedial action is immediately
planned, implemented, and effects monitored.
[64]
5.8. Participatory learning and action research
method
[67]
5.9.1. Prototypes and pilot studies
Prototypes and pilot studies are two special forms of scientific
discovery through research. When designing a new apparatus or
equipment, a prototype is made. Making a prototype is a common
method in technology or applied science as a bridge between
theory and practical application. There are two types of prototype.
These are laboratory prototype and pilot plant. A prototype is
necessary when a company or institution substantially modifies an
existing equipment design. It is also useful when a researcher
assembles equipment based on published work and sketchy
details.
Similarly, when beginning a novel type of experiment, a pilot
study is conducted. A pilot study is the procedural analogue to a
prototype. Pilot studies can give valuable information on whether
a detailed experiment will succeed and how one should cope with
uncontrollable variables.
5.9.2. Directed research/targeted research
When research is done in response to a request from someone or
an organization to explore and address a specific problem, it is
called directed research or targeted research.
5.9.3. Clinical research
Clinical research deals with questions to the normal functioning
of the animal body and investigating diseases using animal
subjects such as new treatments, new medicines, new techniques
by using existing treatments, screening techniques, and new
diagnostic techniques. Clinical trials are conducted based on
specific plans, which are usually called a protocol. The protocol
clarifies what the types of diseased animals are to be enrolled for
[68]
the study, schedules of tests and procedures, drugs, dosages,
length of study, and measurable outcomes.
5.9.4. On-farm research
On-farm research is a type of research conducted to evaluate,
refine, or develop farmer-oriented need based-research under
existing biophysical and socio-economic conditions of
particularly resource-poor farmers. On-farm research is usually
meant to take promising results of a given research from the
experimental field or laboratory to the farmers’ fields.
5.9.5. Farmers’ participatory research
Farmer participatory research (FPR) is a kind of agricultural
research system that ensures participation of farmers by including
indigenous knowledge in the research process. Thus, participatory
research is a type of research done on a population together with
the population (stakeholders). It involves engaging the target
population to choose research questions, design the study, and
address ethical concerns.
[70]
Preference ranking
Preference ranking is similar to problem ranking, but in this
technique, participants assess different options they are given
using their own criteria. Scores can be assigned for identifying the
preferences. For example, the problems of access to fertilizer and
availability of fertilizer can be compared on a 5-point scale, by
giving 5 for the most important and 1 for the least important. You
can use a blackboard or flipchart, and draw a priority-setting
background in a tabular format. Criteria are listed in columns and
possible actions in rows. Then, the group has to evaluate possible
actions and list them in the left column of the table. In this case,
the researcher distributes the scoring cards among the members so
that each member gets one set of cards for each of the scoring
criteria. The number of cards in each criterion set must be equal
to the number of actions being ranked. For instance, if there are
four actions, then each criterion set should contain a number from
1 to 4. To assess the ‘feasibility’ of a specific action, the
participant must display the appropriate card. After all criteria are
evaluated, the scores are jotted down in the table. The individual
scores are added and the sum is indicated in the right column of
the table.
[71]
Preference score index
One common method of measuring and analyzing attitudes of
participant farmers towards the technology is to make a farm walk
and calculation of the preference score index by comparing each
test treatment with the standard or local check. Farmers positive
and negative votes at a specific time are collected from all over
the locations and the preference score index are calculated from
the mean preference scores by the total number of farmers as
follows:
[73]
Table 3. Preference ranking six faba bean varieties by six participant farmers
Variety 1 3 2 3 3 3 3 2.83
Variety 2 2 3 1 2 1 2 1.83
Variety 3 6 5 6 5 6 5 5.50
Variety 4 1 1 2 1 2 1 1.33
Variety 5 5 6 5 6 5 6 5.50
Numan 4 4 4 4 4 4 4.00
Or else, the ranking average values given by all farmers for each
treatment could be calculated based weights that are given in
reverse order where the highly preferred item with a rank of 1 has
the highest weight (of 6 in the above example) and the least
preferred item has the lowest weight (of 1 in the above example).
Weight count depends on the total number of treatments and, in
our example where we have six treatments, for instance, the
weight of each of them based on their preferences will be 6 for
the rank of 1, 5 for the rank of 2, 4 for the rank of 3, 3 for the rank
of 4, 2 for the rank of 5 and 1 for the rank of 6. The ranking
average is calculated as follows:
[74]
Pair-wise ranking
First, the treatments are listed in the matrix table across the first
column and across the top row as given below (Table 4).
Comparisons are made in all possible pairs taking two treatments
at a time, comparing with each other by participant’s group
through discussion and the better of the two treatments is marked
by writing its name in the cell. The names of both treatments are
written, if in case, they have equal performance and choosing
between the two becomes difficult. Compare the first treatment
with the second, the first treatment with the third, and keep on
comparing them until all the treatments are compared in all
possible pairs. Finally, make count of the number of times each
and every treatment was selected to be better. The treatments
which are named more numbers of times are considered to be the
best and, accordingly, Var 4 with a score of 5 points followed by
Var 1 with a score of 4 points could be considered as varieties of
better choice, whereas Var 3 as a variety of not chosen and Var 5
with a score of unity could be considered as varieties of least
preference (Table 5).
100 = 5X + 4X +3X + 2X + 0X
100 = 14X
X = 100/14
X = 7.143
Then the proportional preference of the Vars could be presented
as:
Matrix ranking
Matrix ranking is an important PRA tool to investigate
preferences of farmers for a particular technology over others,
with respect to crop or animal based technologies. It is done to
know about the preferences of households for different activities,
resources or items and reasons or criteria for preferences. The
preferences and criteria for the same are also studied in the
process.
[76]
In matrix ranking or matrix scoring, a group of options is
evaluated by applying different criteria and assigning scores to
each criterion. It uses a matrix with options along the horizontal
axis and the elicited criteria along the vertical axis. This technique
enables the facilitators to find out the reasons for the preferences
and priorities in various practices such as crops, cultivars, tree
species, soil and water conservation measures, irrigation methods,
fertilizers, plant protection measures, improved heifers, and other
technologies.
Matrix scoring can reveal interesting differences among group
members. The researcher starts discussing on a particular
technology. For example, if it is improved varieties of maize, list
all the maize varieties that the framers grow. Then, list the
reasons for preferring the given varieties in short phrases. Then,
draw up a table of matrix by placing the reasons in rows and
technologies in columns. Then, the researcher enquires ask the
farmers to rank the varieties of their choice for each season.
Indicate the variety that is best suited for the first season, second
season, and so on, until all the varieties are covered. If five
technologies are considered for ranking, the best one for the
specific reason is to be given a score of 5, the next best 4, the next
3, the next 2, and the last 1. Calculate the total score for each
technology over all the reasons mentioned. Repeat the process for
all participants. Based on the total score, the researcher makes
inferences on adoption of technologies and uses these inferences
for future planning strategies.
Direct matrix ranking
Draw up a matrix table where treatments are put across the top
row, and selection criteria are put down the side of the first
[77]
column as shown in Table 5 below. Then select participant
farmers (an individual or group), let them establish commonly
agreed up on selection criteria and allow them to the field to rank
the treatments based on their own selection criteria. In this
process, details of why a given treatment is rated as good or bad
need to be properly noted and the rankings should be directly
recorded onto the matrix. Participant farmers (both males and
females) should also be given opportunity to select their best
choice for overall performances and, in this process, it is
advisable to keep men and women participants separate in order
to avoid dominance of the former and generate better information.
The use of mixed groups, where male and female farmers should
make arguments and come up with common preferences, may
also need to be considered in certain cases particularly when they
share similar selection criteria.
Table 5. Direct matrix ranking of six faba bean varieties for different selection criteria by a group
of participant farmers
Pod load 3 2 6 1 5 4
Pod size 3 1 6 2 4 5
Seed size 4 1 5 2 6 3
Diseases resistance 3 2 5 1 4 4
Overall performance 3 2 6 1 5 4
[78]
Wealth ranking
A participatory exercise where key informants rank households in
the community according to their evaluation of each household’s
resources is called wealth ranking. Wealth ranking can provide
important insights into the social values of community members.
The ranking obtained from such an exercise is a weighted average
of the household’s resources. In this case, higher weights are
implicitly given to resources considered socially more important
by the key informant. Therefore, data from wealth ranking may
not correspond with a ranking of households based on a survey of
assets. Wealth rankings are often carried out actually as wealth
categorizations using pre-defined wealth categories, such as
wealth terciles (3 categories) that might be defined as “poor”,
“intermediate”, and “rich”. The specific criteria for falling into
each category can be developed and made explicit by the key
informants. Wealth is a relative category and, therefore, research
scientists should be aware that members in the communities
possess knowledge of the wealth positions of community
members.
Assessing how wealth interacts with technologies is necessary
since the adoption and adaptation of an intervention may differ by
the endowment in resources or productive assets. Knowledge of
participant’s wealth categories may provide information to the
researcher to guide recommendations of how the intervention may
match the differing resources in the community.
Wealth ranking approach may be an important alternative and
complement to other methods, such as conventional surveys that
estimate poverty rates and asset-based wealth indices, and may be
cheaper to administer.
[79]
In wealth ranking, people are ranked and placed on different steps
of the social ladder based on their wealth. The objective is to have
a first-hand information about the stratification of local society
into rich, middle, and poor categories as viewed by people
themselves. The exercise helps officials concerned to have an idea
about the differences in wealth in every neighbourhood leading to
an overall understanding of the socio-economic conditions of the
population in the territory. This exercise is also helpful for
selecting the beneficiaries for various schemes. The most
common version of this technique involves a focus group
discussion involving members of a locality. The facilitator
introduces the procedure using local terms for wealth and poverty
and encourages them to first discuss how they define these terms
and how they would describe a poor or rich household. Using
these criteria, cards are made and actual ranking is done by
sorting cards. Wealth ranking may be difficult in urban and semi-
urban areas, where people tend to be less familiar with their
neighbours than in rural settings. Moreover, in some
communities, relative wealth ranking is a very sensitive topic and,
therefore, it is better to conduct this technique in a private setting
allowing participants to talk freely.
Trend analysis
Trend analysis is a PRA tool of collecting information and
attempting to spot a pattern. Trend analysis is often used to
predict future events. However, it could also be used to estimate
uncertain events in the past.
Trend analysis shows the changes in the past few years regarding
the daily life pattern of people in a locality. It can be in the form
of a line graph, which indicates the relationship between two
[80]
types of data. In agriculture, trend analysis can be done for the
items such as the change in crop yield (increased or decreased),
cost of cultivation of crops, wasteland area, farm produce prices,
consumption of fertilizers and pesticides, land use changes,
cropping pattern, population growth, coverage of improved
cultivars, tree species grown, fuel used, flow of income (increase
or decrease), changes in credit, and status of transport and
communication facilities. Seasonal calendars and daily activity
charts are two common trend analysis techniques.
Seasonal calendars
Seasonal calendars or seasonal diagrams are tools, which help to
explore changes taking place over a certain period of time. In
such participatory exercise, attempts are made to determine the
seasonal activities as understood and practised by the
stakeholders. Seasonal features such as labour supply shortage),
pest and disease incidence, harvesting of crops, ploughing
activities, sowing of crops, intercultural operations, input
requirements, irrigation requirement, weather elements such as
temperature and rainfall, soil moisture status, and fuel and fodder
availability can be assessed based on seasonal calendars.
[83]
cultures, women are reluctant to attend meetings and to speak
their minds in the presence of men or their husbands. In such
cases, a woman facilitator should assist the discussion and help
women to find out what they wish to discuss and how.
[85]
sensitivity in divulging information, may be done only after
establishing good rapport with the people.
[86]
Unlike on-farm verification trials for crops, on-farm verification
trials for livestock, researchers take the lead because of the
knowledge-intensive nature animal research. However, extension
workers and farmers actively participate in conducting g less
knowledge-intensive activities particularly at the initial stage of
the work. The necessary technological packages and animal
health care are provided by the research system but the input of
experimental animals may be provided by farmers as deemed
necessary. The day to day data collection activities are handled by
trained enumerators who are provided with technical
backstopping by researchers.
Meta-analysis
Meta-analysis is a statistical procedure for combining the results
from several previously made independent studies. This helps to
improve the dependability of the results. Meta-analysis gives a
more objective appraisal of the collected evidences by different
researchers than a traditional review of literature on the problem.
It is also helpful to provide a more precise estimate of a treatment
effect and explain heterogeneity between the results of individual
studies. Meta-analyses may help not only to mediate studies that
might otherwise seem to have conflicting results but also to
establish strategic implications of past studies.
6. Principles of Experimentation
[87]
The term ‘experiment’ originates from the Latin term Experiri,
which means, ‘to try’. Experiments are conducted to decide the
fate of two or more competing hypotheses or research questions
on a particular phenomenon. The knowledge that is generated
through experiments is empirical knowledge, which is based on
observation and experience.
[88]
drought, or pest attack). These also have to be controlled by the
researcher as much as possible.
[91]
6.1.1. Threats to internal validity
The factors that affect internal validity of a research design are:
history, maturation, testing effects, instrumentation, sampling
bias, attrition, and selection bias.
History
While the experiment is under implementation, if some external
events other than the treatments such as drought, flood, or pest
incidence occur, these can influence the results, and internal
validity is at stake. These kinds of events during the period of
experimentation are usually denoted by the term ‘history’. By
including a control group from the same population as the
experimental group sharing the same history, we can reduce the
effects of history largely. The threat from history is relatively low
in experiments of short durations.
Maturation
Maturation refers to changes that can occur in the subjects for
over a period of time influencing the results of a research study.
Unlike history, effects of maturation are not the results of specific
events but occur because of ageing, changes in physical,
intellectual, or emotional characteristics that happen naturally
over time, etc. These effects are more problematic with respect to
human and animal subjects, because during the experimental
period, physical or psychological changes taking place within the
subjects can jeopardise the conclusions. As in the case of dealing
with the effects of history, the effects of maturation can be
overcome by using a control group chosen from the population
from which the experimental group is drawn. The effects of
maturation are likely to be low in short duration studies.
[92]
Testing effects
Testing effects is a threat to internal validity that happens due to
the effects of a previous test upon the performance after a second
test. For example, exposure to a pre-test usually influences
observations from a post-test. This threat is more obvious in
experiments involving human beings. If the intervening time
between pre-test and post-test is short, testing can become a
serious threat to internal validity. In most cases, the use of a
research design that does not include a pre-test can eliminate
testing as a potential threat to internal validity. However, if pre-
treatment data are required, the only option is to use data
collection techniques without revealing the actual intention to
participants.
Instrumentation
Changes in the calibration of instruments, questionnaires, or
interviewing technique can create problems to internal validity.
Standardized instruments, data collection procedures, and the
training of observers are some of the measures, which reduce
problems from instrumentation. Most threats from
instrumentation can be eliminated by specifying the measurement
procedures. Occasionally, the instruments being used for the
experiment have to be recalibrated, if their readings become
doubtful. For example, voltage fluctuations and temperature
variations can do havoc on data. However, by keeping these
factors constant during the course of investigation, these can be
prevented from influencing other variables. This stabilization
approach is the best for variables that have a disruptive influence,
for example, voltage or temperature variations. In many instances,
[93]
a researcher can use a standard sample for managing
simultaneously uncontrollable or unknown variables.
Sampling bias
A sampling bias occurs when the assignment of treatments or
subjects to experimental groups or plots is done in a way likely to
prejudice the outcomes. Avoiding using extreme scorers and
employing a random sampling method or assigning treatments to
experimental units randomly will minimize the threat due to
sampling bias.
Attrition
Attrition or mortality is the differential loss of individuals from
treatment or comparison groups, which may bias the results. Loss
of plants, animals, and human subjects are threats of attrition. In
experiments with human subjects, this is often a problem when
research participants are volunteers. They may drop out of the
study, if they find that it is consuming too much of their time or
the task is too arduous. To reduce mortality threats, a researcher
needs to select large groups and must make certain that they are
true representative of the population.
Selection bias
Selection bias refers to the possibility that differences exist
between individuals in treatment and control groups at the start of
the study and that those differences may affect the results. For
example, one group may differ from another group in age, ability,
gender, ethnic composition, or other ways. If the differences in
features of a group affect the result of a study, these amount to a
serious threat to internal validity. Internal validly threats due to
[94]
selection can be minimized by adopting random selection,
random assignment of subjects and blocking.
6.1.2. Threats to external validity
External validity is under threat whenever conditions inherent in
the research design are such that the generalizability of the results
to other settings or groups is limited. In general, a researcher can
reduce threats due to external validity by taking various
precautions to ensure that the selected sample, the environment,
and the background are representative of the population.
[95]
Ecological validity
The extent to which the results of a study can be simulated from
the background environmental conditions of the study to other
environmental conditions is often called ecological validity. It is
possible that a researcher may have created a set of environmental
conditions for the research work and the results may be valid only
under those conditions. That is why plant breeders strive to prove
the appropriateness of their varieties (before release) for wide
adaptation in terms of performance consistency across a range of
physical environments, which is confirmed by spatial and
temporal replication of the test environments even if it is
laborious, costly, and time consuming. Threats to ecological
validity aggravate when the environmental background of the
study is not representative of the population.
[97]
In experiments, assigning plots or subjects to various treatments
must be done in such a way that treatment and control groups are
comparable in all respects except for the treatment. For example,
if a researcher selectively assigns treatments to participants, plots,
or any other experimental units, personal bias may occur.
Therefore, randomisation of treatments is an important principle
to avoid personal bias, and it ensures that each treatment has an
equal chance of being assigned to any experimental plot.
For example, if a researcher grows one variety of teff, say, in the
first half of the parts of a field and we grow the other teff variety
in the other half, then it is just possible that the soil fertility status
may differ in the first half in comparison to the other half. If this
is so the results would not be truthful. In such a case, the
researcher may assign the variety of teff and grow it different
parts of the field on the basis of a random sampling technique.
Thus, the researcher may apply randomization principle and
protect the experiment against the effects of extraneous factors
(difference in soil fertility status). As a result, the researcher can
have a better estimate of the experimental error.
Randomization is also helpful to deal with uncontrolled variables.
When a researcher resorts to random selection of samples, he or
she can easily translate the biasing effects of uncontrolled
variables to random unbiased errors. For example, ‘time’ can
influence an experiment as equipment may show minor changes
because of the period factor. By randomizing the order of sample
measurements, the researcher can evade temporal influences of
this kind from potentially biasing the outcome.
In social science studies, groups can be created in two ways:
through matching and randomization. The subjects may be
[98]
matched according to characteristics such as family lineage, age,
weight, health condition, soil fertility levels, or some other
characteristics. This involves distributing these subjects so that
each subject in one group exactly matches characteristics of
subjects in other groups. However, it would be difficult to have
equal groupings; therefore, randomization is preferred to
matching. Random assignment makes sure that the experimental
groups are probabilistically alike at the time of assignment.
Randomization can be done with a table of random numbers or by
drawing lots.
In fact, randomization is based on the statistical principle of
normal distribution. If you subject the population data to a normal
distribution, most individuals will fall within the middle range of
values for a given characteristic with progressively fewer ones
towards either extreme (remember the bell curve of normal
distribution). Differences between groups will average out and
become more comparable.
6.2.2. Replication
Experiments should be repeated more than once to increase
reliability. The process of repeating the treatment more than once
is known as replication (a coined term from repetition and
duplication). Replication increases statistical accuracy and
precision. The treatment must be replicated at least twice to
estimate experimental error. However, too many replications are
costly, and beyond a certain limit, additional advantage due to
precision is not significant if you consider the additional cost
involved. The number of replications needed depends on the
magnitude of experimental error likely to be obtained in the
experiment and the degree of precision wanted. The experimental
[99]
error can be kept to the minimum by providing more degrees of
freedom for the experimental error.
Degrees of freedom is an interesting concept in the analysis of
variance. The number of degrees of freedom in a distribution is
the number of values that are independent of each other, which
cannot be deduced from each other. Generally, a rule of thumb is
followed to determine the number of replications. Choose the
number of replications to provide not less than 10 degrees of
freedom for estimating experimental error or, in other sources, 12
degrees of freedom as the lower limit, the latter being the most
commonly followed in most experiments. By following this rule
of thumb, with five treatments in a randomized block design, for
instance, a minimum of four replications are needed.
6.2.3. Blocking/local control
Blocking or local control is the method by which the extraneous
factor, the known source of variability, is made to vary
deliberately over as wide a range as necessary. This is done in
such a way that the variability it causes can be measured and
eliminated from the experimental error. This signifies that the
experiment should be planned in such a way that a two-way
analysis of variance is done. The total variability in the data is
divided into three components, which are attributed to the
treatment (varieties of teff in the above case described in the
Principle of Replication above), the extraneous factor (soil
fertility status in the same case indicated above), and
experimental error.
It was Sir Ronald Fisher who observed that by dividing the
experimental fields into different blocks, and then conducting
experiments, the data gathered and inferences drawn would be
[100]
more reliable. This process of blocking or local control helps the
researcher to separate out differences due to confounding
variables and by excluding them from the estimates of error
effects.
Blocks refer to categories of subjects within a treatment group. In
agricultural field experiments, variations between experimental
plots can be reduced largely through blocking. When the blocks
differ widely, there will be substantial reduction in experimental
error. However, plots within a block should be homogenous.
When the fertility pattern of an experimental field is known,
blocks can be oriented in such a way that soil differences between
blocks are maximized and those within blocks are minimized.
When fertility patterns are not known, avoid using long and
narrow blocks, but rather opt for compact blocks as nearly square,
since closer plots can be more alike than those that are farther
apart.
We can have blocks in experiments related to animals too.
Suppose we want to test two drugs. We might divide the diseased
animals into three blocks—old aged, middle aged, and young
ones; and further divide the groups into a group treated with drug
A and another treated with drug B. This arrangement allows us to
find out how the treatment affects different age groups. In the
example, we might observe that drug B out performs performed
drug medicine A except for older patients where drug A
outperformed drug B. This phenomenon is due to interaction
between the treatment (the drug) and subject characteristics (age).
Interaction between treatment factors can occur in factorial trials
when there are more than two factors.
[101]
6.2.4. Control in experiments
Normally, an experiment demonstrates that an event occurs after a
certain treatment is given, and that the event does not occur in the
absence of the treatment. By dividing the entire experimental
units into two groups, the ‘control group’ and the ‘experimental
group’, you can confirm the effect of a variable, even if many
unknown variables interfere. In such experiments, a ‘control
group’ is useful, especially when one must deal with several
uncontrolled variables. The two groups should be as similar as
possible except for the one aspect whose effect is being tested. In
this context, you should particularly note that a ‘controlled
experiment’ is not an experiment under control; it simply means
that the experiment is designed with the ‘experiment’ and the
‘control’ groups.
[104]
7. Classification of Experiments
Hypothesis experiments
Hypothesis testing experiments are generally classified as true
experiments, quasi-experiments, and ex post facto experiments
based on the applicability of randomization and manipulation of
treatments.
True experiments
True experiments are characterized by three main features,
namely, randomly formed groups, manipulation of treatments and
measurement of dependent variables.
[106]
with laboratory studies are common for basic and some applied
studies. Pot culture experiments are most often used in certain
disciplines such as plant pathology, soil science, plant physiology,
horticulture, etc. A negative result obtained from a pot culture
experiment would, in all probability, be negative in field trails
also, while a positive result need not necessarily be so.
Field experiments
Field experiments are routine in agricultural sciences in which
independent variables are manipulated and measurements are
made on the dependent variable from the experimental units or
plots in their natural setting. Using modern techniques and
application of appropriate statistical methods, field experiments
have the potential to show significant results. The heterogeneity
experienced in the fields can be eliminated largely by suitable
experimental designs, layouts, and statistical analysis.
Quasi-experiments
Unlike true experiments, in a quasi-experiment, groups of
subjects are formed not based on random assignment but by non-
random methods. Quasi experiments are just like a true
experiment with the only difference of missing randomly assigned
groups. Quasi-experimental design serves in place of true
experiments in situations where the latter cannot be applied for
ethical or practical reasons. For instance, when using human
subjects, it is often impossible to do random assignment,
especially when they are part of intact groups such as schools,
colleges, communities, neighbourhoods, etc. Although groups
might be reasonably similar in a practical sense, using data from
intact groups limits the conclusions that can be drawn concerning
the treatment effects.
[107]
Ex Post Facto experiments
This type of experiment is used in situations wherein the
researcher devises an experiment to examine the effect of a
treatment after it has already taken place. Ex post facto means
‘after the fact’. Thus, the causal event of interest has already
happened without the manipulation of treatments by the
researcher. These kinds of experiments are useful when human
subjects or animals in true situations are involved, and the
researcher comes to the scene only ‘after the fact’. Therefore,
most ex post facto studies are observational studies as no
manipulation of treatment is possible. In such situations, the
investigator begins the investigation by identifying the outcome
variables and attempts to identify possible causes, which is
independent variables responsible for the outcome. As an
example, take the case of two groups of animals in a vet clinic,
one treated with a particular medicine and the other with an
alternate medicine. If the researcher is deliberately selecting the
patients and giving the medicines randomly, then it would be a
true experiment. On the other hand, if the researcher has no role
in medication and she/he just takes observations after somebody
else gave the medicines, it would be an ex post facto study.
Quasi-experimental research and ex post-facto are commonly
used in health and social science fields of study.
[108]
SECTION III. PLANNING RESEARCH
8. Research Designs
[109]
(b) The observational design, which relates to the conditions
under which the observations are to be made
(c) The statistical design, which deals with the question of
how many items are to be observed and how the
information and data gathered are to be analyzed;
(d) The operational design, which deals with the techniques
by which the procedures specified in the sampling,
statistical and observational designs can be carried out.
[110]
proper type of research design, which is suitable for meeting the
objective of the research. In doing so, a researcher must keep in
mind the type of data required and its collection and analysis, so
as to extract the hidden information from the subject area of the
research.
A good research design is often the one that minimizes bias and
maximizes reliability of the data collected and analyzed. The
design which gives the smallest experimental error is considered
the best design in many investigations. In the same way, a
research design which leads to the generation of maximal
information and provides an opportunity for handling many
different aspects of the research problem is regarded as the most
appropriate and efficient design. Consequently, the question of a
good design is related to the objective of the research and type of
problem to be studied. In this connection, a design may be
suitable for researching one problem, but may not be suitable in
one respect or other in the context of some other research
problem. Therefore, one single design cannot serve the purpose of
all types of research problems. As a result, for choosing a
research design appropriate for a particular research problem, the
following factors should be considered:
[111]
Accordingly, for exploratory or formulative research, in which the
major aim is discovering new ideas and insights, the research
design that is appropriate must be flexible enough to consider a
number of different aspects of a phenomenon. However, if the
purpose of the research describing a situation or an association
between variables, which is common with descriptive research,
accuracy is the main consideration. For such research the most
appropriate design is the one that minimizes bias and maximizes
the reliability of the evidence collected. For research dealing with
testing of a hypothesis to reveal a causal relationship between
variables, the most appropriate design is the one that permits
inferences about causality in addition to the minimizing bias and
maximizing reliability.
[115]
In terms of research design, the two types of research share
common features. In both types of research, the researcher should
define clearly the data to be measured and the methods for
measuring the data together with a clear definition of the
‘population’ he/she wants to study. Under this type of research,
the objective is to obtain thorough and accurate information.
However, the research design to be used and the procedure to be
followed have to be carefully planned. The research design must
guarantee protection against bias and maximize reliability, and
economical completion of the study. Thus, it should not be
flexible and must be focused on the following six requirements:
formulating the objective of the study (what the study is about
and why is it being made?), designing the methods of data
collection (what techniques of gathering data will be adopted?),
selecting the sample (how much material will be needed?),
collecting the data (where can the required data be found and with
what time period should the data be related?), processing and
analyzing the data, and reporting the findings.
[116]
Experimental research requires procedures that will not only
minimize bias and increase reliability, but also will permit
drawing inferences. Experimental research meets this
requirement. Thus, research design for such research often mean
the design of experiments.
However, in the diagnostic type of research also, there is a scope
for testing the hypothesis, and diagnosing the causal relationship
among the variables in a research design.
Thus, hypothesis-testing type of design can broadly be
categorized under: research design for diagnostic studies, and
research design for experimental studies.
8.4. Research design for diagnostic studies
Diagnostic research is the type of research that determines the
frequency with which something occurs or it is associated with
something else. Thus, studies conducted to ascertain whether
certain variables are associated are examples of diagnostic
research. In this type of research, one or many hypotheses relating
to the concerned population are tested. In the diagnostic type of
research design, generally the observations are recorded from the
existing population; an association between the variables and the
related hypotheses is tested. A diagnostic type of study deals with
problems as well as solutions. The main objective is to diagnose
the problem accurately to work out for some solutions and, in the
process, to find out the relationship among the variables
associated.
[117]
8.5. Research designs for experimental studies
In an experimental type of studies, a researcher wants to test the
hypothesis with respect to the populations through
experimentation where the independent variable is varied or
manipulated and the response of the dependent variable is
measured. Experimental designs, in this case, may be of two
types: (a) informal and (b) formal.
8.5.1. Informal experimental research designs
Informal research designs are based on or associated with a less
sophisticated form of analysis. Informal experimental design can
be of three categories: before and after without a control design,
after only with a control design, and before and after with a
control design, after only with a control design, and before and
after with a control design.
The after-only design without control
In ‘after-only’ experimental designs without control or post-test
only without control, data are collected after the subjects have
been exposed to the independent variable. In this design, baseline
data are created depending on the respondents’ recall of the
situation before the intervention or from existing records.
Changes in the dependent variable are reported as the difference
between the baseline data and the observations made ‘after’ the
intervention. This type of design is adopted when you do not have
the time to take ‘before’ observations directly. For example, if
you want to study the impact of a campaign by the government,
which must be implemented as a contingency measure, probably
you may employ this method. In this case, baseline data are
created from the records, and any change in trends is assumed to
be because of the new programme. The main problem with after-
[118]
only designs is that they do not have any control over other
confounding factors that could have affected the post-test
observations.
The after-only design with control group
In this type of experiment, the experimental groups and the
control groups are evaluated and compared only after the
implementation of an intervention. The ‘after only design with
control group’ is also sometimes called ‘post-test only control
group’ design, wherein subjects are randomly assigned to either a
control group or an experimental group. The groups are not pre-
tested. One group is exposed to a treatment or a series of different
treatments, and then both groups are post-tested. Thus, two
groups or areas (test area and control area) are selected and the
treatments introduced into the test area only. The dependent
variable is then measured in both groups or areas at the same
time. The effect of the treatment is evaluated by subtracting the
value of the dependent variable in the control group (area) from
its value in the test group (area). The differences of the values are
subjected to statistical analysis to determine treatment effects.
Most of the comparative experiments being taken up in
agriculture fall under this category.
The fundamental basic postulation in this design is that the two
groups or areas are identical with respect to their behaviour
towards the situation in question. If this postulation is not true,
there is the possibility of extraneous variation occurring in the
treatment effect. However, unlike the before-and-after without
control design, data can be collected in this design with no
occurrence of variations due to extraneous variables with the
passage of time.
[119]
The before-and-after design without control
This type of experiment is also known as the pre-test/post-test
without control. In this type, a single experimental group is
chosen and the impact of the dependent variable on it is measured
before introducing the treatments. After the treatments are
introduced, the dependent variable is again measured and the
difference between the pre-test values and post-test values are
estimated. The before-and-after design is an upgraded version
compared to the after-only design, because the researcher is
considering the probable effect of the independent variable by
observing differences between the observations on the dependent
variable before and after the test. The effect of the treatment is
equal to the level of the situation after the treatment minus the
level of the situation before the treatment. Thus, this kind of study
normally includes two sets of cross-sectional data collection
points on the same population to find out the change in the
phenomenon or variable between two points in time, the second
being undertaken after a certain period.
The before-and-after design without control is considered as the
most suitable design for measuring the impact of a programme or
activity. It is also one of the most common designs in evaluation
studies. We get the overall impact of introducing the treatments
from the differences in observation before the treatment and after
the treatment.
The main downside of this design is that as time elapses,
considerable extraneous variations may occur in the treatment
effect.
[120]
The before-and-after design with control group
In this type of experiments (also called pre-test/post-test control
group design), two test groups are established; an experimental
group, which would be exposed to an independent variable and a
control group, which would not be subjected to the variable under
study. Both groups are pre-tested. After exposing the
experimental group to a treatment or different treatments, both
groups are post-tested and the dependent variable is measured for
an identical time-period. The treatment effect is determined by
subtracting the change in the dependent variable in the control
group from the change in the dependent variable in the
experimental group. The before-and-after design with control is
designed based on the assumption that the confounding factors, if
any, would affect equally the experimental and control groups.
Therefore, any differences in the data collected from the two
groups can be credited to the impact of the treatment alone.
This design is superior to the above-mentioned three designs
because it avoids extraneous variations occurring because of
passage of time and from non-comparability of the test and
control areas. However, at times, due to lack of historical data,
time or a comparable control area, a researcher may have to prefer
to select one of the first three informal designs stated above.
8.5.2. Formal experimental designs
Compared to informal experimental design, the researcher has
more control over the experiments in the formal experimental
design. Also more advanced statistical tools can be used for the
analysis of the data from the experiments. Formal experiments are
of two types: laboratory experiments and field experiments.
[121]
Formal experimental designs deal with the planning and conduct
of experiments including the system of assigning the selected
treatments to the experimental plots and analysing the generated
data to obtain valid conclusions. The main objective of an
experimental design is to establish a causal relationship between
the independent and dependent variables. Another major goal is to
extract the maximum information with the minimum utilization of
resources. A good experimental design allows valid comparisons
between treatments. In the case of agricultural field experiments,
soil heterogeneity is the main source of variation. The selected
experimental design must balance the requirements and
limitations of the problem in which one works so that the
experiment can provide the best conclusion about the hypothesis
being tested. An experimental design recognizes the independent,
dependent, and confounding or external variables, and specifies
the manner in which the principles of experimentation and
statistical aspects of an experiment are taken up.
[122]
Whatever the number of factors may be, these designs are based
on certain basic principles and follow three basic designs. The
principles of designs of experiments are replication,
randomization, and local control.
[124]
It is assumed that the differences observed between experimental
units receiving the same treatment, if any, are due to experimental
errors and this error must be kept to the minimum.
[125]
freedom, t (r-1) and no other experimental design provide higher
error degree of freedom with similar number of plots and
treatments.
On the other hand, the disadvantage of this design is that the basic
assumption of homogeneity of experimental units, particularly
under field condition, is rare. That is why this design is suitable
mostly in laboratory condition or greenhouse condition rather
than under field conditions.
[126]
It is the most widely used design that takes into account
variability among the experimental units. A randomized block
design uses all the three basic principles of experimental design
explained above, namely replication, randomization, and local
control.
For example, when conducting field trials to compare fertilizers,
plant varieties, or whatever, there is concern that some parts of a
field may be more fertile than others. So, if one were comparing
three fertilizers, say, it would not be a good idea to use one
fertilizer here, another fertilizer over there, and the third fertilizer
way out back because the effects of the fertilizers would be
confounded with the natural fertility of the land.
The design takes account of the heterogeneity of an experimental
unit in one direction. In RCBD, the whole variation is partitioned
mainly into three components: (a) factors that are varied by the
experimenter at his/her own wish, (b) variability in experimental
units, and (c) variability in extraneous factors, i.e. the
experimental error.
[127]
of design of experiments are given due consideration and it is
more efficient than CRD. In addition, there is no restriction on the
number of treatments or replicates. There will be no problem if
some treatments are replicated more times than others.
Furthermore, missing plots can also be easily estimated.
This means that LSD has the capacity to handle two sources of
variation independently from the blocking criterion as in the case
of RCBD. Treatments appear once in each row and once in each
column. Replicates are also included in this design. Because of
this type of allocation of treatments, the total variations among
the experimental units are partitioned into different sources,
namely, row, column, treatments, and errors. In this design, it is
assumed that there is no interaction effect between row, column,
and treatment factors. If the number of treatments is also equal to
the number of replications r for each treatment, then the total
number of experimental units needed for this design is t t.
One advantage of the Latin square design is the improvement
over the other two basic designs, CRD and RCBD, as it takes care
of the heterogeneity or the two-way variations in the experimental
units. Sometimes, when an experimenter does not have an idea
about the heterogeneity among the experimental units or does not
have the time to check the heterogeneity pattern, he/she can opt
for the LSD design. On the other hand, the disadvantages include
the rigidity of requiring that the number of treatments be equal to
the number of rows and columns as well as the fact that the layout
of the design is not as simple as in the case of CRD or RCBD.
Crossover design
The residual effect of a treatment may continue even after the
application of another succeeding treatment if the same
experimental unit is sequentially used again and again. A
crossover design, where the experimental units cross over from
one treatment to another during the course of the trial periods,
[129]
provides a technical solution to the carryover effects of previous
treatments with better efficiency compared to a parallel design or
non-crossover design where experimental units receive separate
treatments.
In livestock research (e.g. animal nutritional studies), where the
price of experimental animals is high and the number of animals
available for different experiments is limited, the same animals
may be used repeatedly for different experiments. The problem
associated with such an approach is that it makes difficult to
prove if the differences in performances between the animals is
due to a carryover effect of the previous study or if it is due to the
actual treatment effect of the follow up study. Therefore, reusing
the experimental animals is possible only with certain pre-
conditioning treatments to remove the “carryover effects” from
the treatments given in a previous study. The preconditioning
treatment is necessary to avoid the confounding effect the initial
treatment on the effect the new treatment. Thus, one practical way
to minimize carryover effects is providing a sufficient resting or
wash-out period between two treatment periods. The other is the
use of counterbalancing of treatments for each animal when
treatments are assigned to the experimental animals, i.e. each
treatment should follow each of the other treatments an equal
number of times.
Augmented design
These designs may be minimum variance designs for estimating
contrasts of check effects, of new variety effects, of new variety
versus checks, or of all check and new varieties.
In augmented designs, the goal is to compare existing (control)
treatments with new treatments that have an experimental
[130]
constraint of "limited replication". To understand limited
replication, think about experiments that may only allow a single
representation of the new treatment, this limitation may be due to
the cost associated with the experiment, limited resources, or
limited number of new units that can be used in the experiment.
In contrast, the existing treatments, referred as checks, are
generally replicated multiple times. With augmented design one
can estimate the following:
a) Differences between checks and new treatments,
b) Differences among new treatments,
c) Differences among check treatments, and
d) Differences among new and check treatments combined.
Graeco-Latin square design
As mentioned earlier, the Latin square design is useful to block
two directional variations in the experimental unit (double
blocking) into rows and columns, and then each of the treatments
(designated in Latin letters) are randomly allocated to the
experimental units only once in each row and in each column.
The Graeco-Latin square design, as a modification of the Latin
square design, consisting of two Latin square designs (one using
the letters A, B, C, etc. and the other using Greek letters α, β, χ,
etc.). When the two Latin squares are superimposed on each
other, in such a way that each treatment (Latin letter) appears just
once in each row, once in each column and once with each Greek
letter (triple blocking) the Graeco-Latin square design is formed
as illustrated below in Table 6. The two Latin square designs
become orthogonal as every Latin letter coincides exactly once
with a Greek letter.
[131]
Table 6. Schematic format of the Graeco-Latin square design
Row Column
C1 C2 C3 C4 C5 C6 C7
R1 A B C D E F G
R2 B C D E F G A
R3 C D E F G A B
R4 D E F G A B C
R5 E F G A B C D
R6 F G A B C D E
R7 G A B C D E F
Row Column
C1 C2 C3 C4 C5 C6 C7
R1 α β χ
R2 β χ α
R3 Χ α β
R4 α Β χ
R5 β Χ α
R6 Χ α β
R7 α β χ
Row Column
C1 C2 C3 C4 C5 C6 C7
R1 Aα B Cβ D Eχ F G
R2 Bβ C Dχ E F Gα A
R3 Cχ D E Fα G Aβ B
R4 D Eα F Gβ A Bχ C
R5 E Fβ G Aχ B C Dα
R6 F Gχ A B Cα D Eβ
R7 G A Bα C Dβ E Fχ
[133]
precision when there is variability within larger blocks. The
disadvantages of the incomplete block designs, on the other hand,
include the rigid requirement for a fixed number of treatments, a
fixed number of replication, or both and the complexity of the
analysis. There is also unequal precision for certain comparisons
of treatment means.
Multiple factor experiments
Factorial experiment
Factorial experiments are experiments that simultaneously
involve more than one factor, with each factor being at two or
more levels. Several factors may affect concurrently the
characteristic under study and the experimenter is interested in the
main effects and the interaction effects of the factors on the
characteristic under study. A factorial experiment is particularly
useful when little is known about factors and all combinations
have to be analyzed in order to conclude which combination is the
best.
The effect of a factor alone is called a main effect whereas the
effect of different factors acting together is called an interaction.
The term factorial is used to indicate that all possible
combinations of the factors are considered. Note that the
background experimental design could be completely
randomized, randomized complete block, Latin-square design,
and incomplete blocks depending on situations.
This type of experiment is chosen mostly to save time and other
resources and also to know the interaction effects of different
factors. Factorial experiments are suitable for agricultural, social
[134]
science, and other studies in which the effect of more than one
factor is required to be compared.
For example, consider an experiment to test the effect of protein
content and type of feed on milk yield of dairy cows. The first
factor is the protein content and the second is type of feed. Protein
content is defined in three levels, and two types of feed are used.
Each cow in the experiment receives one of the six protein x feed
combinations. This experiment is called a 3 x 2 factorial
experiment, because three levels of the first factor and two levels
of the second factor are defined. An objective could be to
determine if cows’ response to different protein levels is different
with different feeds or what we call interaction. The main
characteristic of a factorial experiment is the possibility to
analyze interactions between factor levels.
Likewise, to investigate the effect of different varieties of a crop
with different rates of fertilizer, different irrigation regime with
different crop genotypes, etc., factorial experiments are
conducted.
Similarly, in socioeconomic studies, one may be interested in
relating the economic status and educational status of the people
in adopting modern agricultural practices. Thus, factorial
experiments are the methods for answering the questions related
to more than one factor at a time for their individual effects as
well as their interactions.
[135]
to single-factor experiments. Factorial experiments could also be
set up with lesser number of replications because the required
error degree of freedom could be easily achieved by virtue of
involving a number factors at a time.
[136]
asymmetrical factorial experiment. For example, a two-factor
factorial experiment with five varieties and five different rates
of nitrogen is a symmetrical factorial experiment, but a
factorial experiment with five varieties and any other number
of doses of nitrogen (not equal to five) is an asymmetrical
factorial experiment.
[137]
second nitrogen level (N2) being the best regardless of the
varieties. In this case, we can obviously explain the main
treatment effects without any reservation as the interaction effect
was non-significant (scenario 1 in Figure 1).
Scenario 2. The application of nitrogen increased yields of both
varieties but not at the same rate as depicted from the non-parallel
lines which implies that varieties showed differential response to
fertilizer, i.e. interaction, which maybe or may not be detected by
the ANOVA table. Still, as could be witnessed from the graph
(scenario 2 in Figure 1), the first variety (V1) maintained its
relative rank despite the deferential response and the two lines
seem to cross each other at some point if they are allowed to
extend. Variety V1 stood the best under both nitrogen levels and
the second nitrogen level (N2) was also the best in biological
terms regardless of varieties.
Some authors argue that whenever the interaction effect is
significant, the main effects cannot be explained because of the
interdependence between the main factors. However, explanation
of results of the interaction effects depend not on the magnitude
but on direction of the interaction response as witnessed here. In
this case (scenario 2), for instance, we can obviously explain the
main treatment effects without any reservation as the interaction
effect maybe significant but did not cause a relative change in
rank order of varietal performance, i.e. “non-cross over type” of
interaction.
Scenario 3. The application of nitrogen not only increased yields
of both varieties but also caused a rank order change in varietal
performance, i.e. resulted in a “cross-over type” of interaction. In
this case, comparison of the main effects (varietal and nitrogen
[138]
levels) would be difficult and we cannot obviously explain the
main treatment effects without any reservation as the interaction
effect was a cross-over type.
We cannot right away answer the question, “which variety is the
best?”, as it automatically raises another pertinent question, “with
which nitrogen level”? Likewise, the question, “which nitrogen
level is the best?” raises another question, “with which variety”?
In this case, therefore, we should explain the result in terms of the
best combination of variety by nitrogen levels.
For poor farmers who could not afford application of nitrogen at
all, variety V1 is the best; whereas for well-to-do farmers who
could afford application of nitrogen, variety V2 is the best.
Therefore, when significant interactions exist, the interpretation
of the main effects must be modified in the light of the interaction
types.
[139]
[140]
Figure 1. Interaction plots of grain yields (q ha–1) of two varieties (V1 and V2) grown under two
nitrogen levels (N1 and N2) showing different scenarios when there is no, a non-cross
over and a cross-over types of interactions between the two.
Split-plot design
A split-plot design is used for experiments involving two or more
factors each with different levels, and differing in the requirement
of plot size and accuracy. A split plot design is characterized by a
“nested” blocking structure: split plots are nested within whole
plots, which may be nested within blocks. This arrangement is
applied when the practical limit for plot size is much larger for
one factor compared with the other. A good example is an
experiment conducted to compare irrigation treatments and plant
population densities.
The split plot arrangement can also be used when greater
precision is desired in one factor relative to the other; e.g., if
several varieties are being compared at different fertilizer levels
and the factor of primary interest is the varieties, then it should be
assigned to the subplots and fertilizer levels assigned to the main
[141]
plots. In this case, an extra factor (second) could be introduced
into a study by dividing the large experimental units (whole unit)
for the first factor into smaller experimental units (sub-units) on
which the different levels of the second factor will be applied.
Since sub-unit variance is generally less than whole unit variance,
the sub-unit treatment factor and the interaction are generally
tested with greater sensitivity/precision.
[145]
Size and dimension of plots
Size of plots is another crucial factor, which affects experimental
error. Smaller plots are unreliable, but too large plots are
unmanageable and misuse resources and labour. For the same plot
area, the perimeter dimension of a square plot is lesser compared
to a rectangular plot and, therefore, only lesser number of plants
are exposed to border effects in square plots. While laying out
plots, the length and width of plots must be measured correctly, as
even a small error in plot dimensions can greatly affect the
experimental results. This is especially so when we project the
yield from a small net plot area to a large area; for example, a
minor error in projecting the yield from 12 m2 to one hectare
might be substantial.
For crops like rice, the size of plots generally ranges from 8 m2 to
25 m2, depending on the nature of treatment and uniformity of
plots. For field crops like rice, decide the size of plots in such a
[146]
way that a minimum net area of 5 m2 is available for harvesting,
leaving border rows and rows for destructive sampling. Normally,
fertilizer trials require larger plots than a variety trail. An
irrigation trial requires still larger plots to take care of buffer
strips between plots. Similarly, for those experiments involving
pesticides, the width of the plots should be decided by the
coverage of the sprayer being used.
Selection of treatments
Treatments for the experiment are to be fixed after carefully
considering many aspects. There may be cases when, before
going for experimentation in a detailed way, it could be advisable
to try the treatments in an observation trial. The preliminary tests
often reveal possible difficulties that might be involved in the
application of the treatments or the unsuitability of some
treatments under field conditions. The treatments must be selected
in such a way as to achieve the objectives and to increase the
precision of the experiment. This is especially important when
studying the effects of inputs in increasing doses such as
herbicides, fertilizers, water, fungicides, or insecticides. In such
experiments, it is more beneficial to determine how the
experimental units respond to increasing rates of treatments than
to know whether different rates are significantly different. The
major objective of these kinds of experiments should, therefore,
be to determine a response curve with a range of rates going well
beyond the optimum. For determining the shape of the response
curve, too many treatments are not required; but four or five well-
structured rates could be enough. For example, if the optimum
rate of nitrogen is expected to be around 100, then suitable
treatments for the trial might be 0, 50,100, and 150 or 0,
[147]
40,80,120 and 160 kg/ha. This indicates that rates in equal or
multiple increments within the expected range of the response are
most efficient in establishing equations for a rate: response curve.
Border effect and harvest area
In agricultural field experiments, an ‘experimental plot’ is a unit
of land area on which random assignment of treatments is made.
The whole unit of land receiving a treatment (gross plot size) may
not be the harvest area (net plot size). Harvest area is decided
excluding the ‘border plants’. The phenomenon in which the yield
or other characteristics of crops in the border areas of a plot differ
from those of the central portions is called the “border effect”.
Border effects can occur when plants in a plot facing the outer
margin of unplanted free space are advantaged in terms of
resource like nutrients, moisture and even space as compared to
those in the inner side or centre of the plot higher relative
competition is expected, i.e. the advantage is not available to
inner plants. Thus, if we are not accounting border effects, the
difference between the performances of the varieties in the field is
liable to be overestimation. Apart from the possibility of bias, the
border effects would aggravate error variances by increasing
heterogeneity among plants. In fertilizer trials, chances are that
the nutrients at different doses supplied to various plots might
seep up to the border plants in the unfertilized plots, which
ultimately affect the response of border plants to the fertilizers
applied. In the case of trials involving irrigation, more precautions
to avoid border effects are needed, as lateral movement of
irrigation water is to be expected, and double bunds and buffer
areas between the plots are required in addition to excluding
border plants from observations.
[148]
The size, shape, and orientation of plots should be in such a way
that experimental error is reduced to the minimum. In varietal
yield trials involving crops like rice, where inter-varietal
competition is expected, plots with at least six rows should be
used leaving out one row on each side of the plot as border, so
that four centre rows are available for harvest. Some plants at
both ends of each row should also be excluded as border plants.
Destructive sampling
Some experiments involve the measurement of several plant
characters. In certain cases, it may also involve destruction of
plants as in the case of dry matter production. In weed
management trials, for instance, periodic monitoring of dry matter
production of weeds is common by uprooting weeds. Uprooting
of weeds enable crops in the weed uprooted area to be vigorous
and more competitive. You may follow some techniques to avoid
plant competition near the spot from where uprooting is done.
Leaving an area in the centre of the plot for final harvesting, and
using the surrounding areas for sampling is a common method.
Another option is to set up an area entirely for destructive
sampling lengthwise. For example, if you are taking a plot size of
6 m × 4 m, you could provide 2 m lengthwise entirely to conduct
sampling.
Experimental site
A researcher should ensure that a site selected for an experiment
is as uniform as possible in all aspects. By following efficient
blocking, a researcher can take care of heterogeneity to a certain
extent. It is often observed that quantitative characters measured
from neighbouring plots sown simultaneously with the same
cultivar and treatment are not uniform and differ mildly or widely
[149]
depending on several factors. The most obvious and probably the
most important features that magnify the differences are related to
soil heterogeneity, which is amplified by one or any of the
following features:
Slope: Slope of the land affects soil uniformity. If the
experimental site is not uniform in terms of slope, soluble
nutrients may move to lower slopes along with runoff water.
Differences in slope may create differences in soil texture and soil
depth too. Obviously, an ideal experimental site is one that has no
slope. In the absence of such levelled lands, we can go for lands
with uniform and gentle slope having predictable fertility
gradients using efficient blocking along the contours.
[150]
such areas are not ideal as this operation causes an uneven depth
of surface soil and at times exposes the subsoil and, as far as
possible, it is advisable to avoid such sites. Nevertheless, if there
is no option except the present site, assess the pattern of soil
heterogeneity through uniformity trials and follow blocking or
adjustments through analysis of covariance techniques.
[151]
For uniform germination of seeds, compact the soil around the
seeds immediately after sowing and ensure soil moisture.
Thinning and gap filling
Excess plants in the experimental plots should be removed within
a reasonable time. The removal of excess plants is called thinning.
Thinning should be done within 6–10 days after seedling
emergence to avoid unevenness in the growth of the crop. While
removing excess seedlings, take care to avoid disturbance to the
remaining plants. Seedlings should be left as equally spaced as
possible. A common practice is to lay a two metre pole or stick
along the row and remove the seedlings in excess of the
calculated numbers. The most vigorous seedlings of similar size
are to be retained. Diseased, damaged, and weak seedlings may
be removed while thinning. As far as possible, the same person
should be engaged to thin all plots in a block to reduce bias.
Thinning should be done within the shortest time in the whole
replication in a day. Normally, transplanting seedlings in vacant
places is not recommended because the transplanted plants need
some recovery time from the stress, may be weaker and less
productive than the normal plants. A researcher has two
alternatives in dealing with missing plants. One is to manipulate
the thinning process so that the areas adjacent to the vacant space
have more plants or to ignore the gaps at the seedlings stage and
adjust the number of plants at harvest or adjust plot size at
harvest.
Manures and fertilizers
Manures and fertilizers required for each plot should be spread
uniformly so that each plant in the experimental plot gets its due
share. Plants in a plot may behave differently if these are not
[152]
applied uniformly. Sub-divide the experimental plot into smaller
units to enable uniform application to smaller areas. Applying
fertilizers to each row of plot separately can also be considered.
The usual procedure is to weigh or measure the fertilizer required
per row, and uniformly spreading it on each row by hand.
Cultural operations
All the common cultural operations including ploughing, seedbed
preparation, levelling, weeding, earthing up, and plant protection
must be done uniformly to all plots, covering all the plots in one
block at a time. Differences in cultural operations can aggravate
experimental errors. Sufficient protection from animals, birds, and
intruders must be given. Damaged and disturbed plots should not
be included for observation, but they should be considered within
a limit as missing plots at the time of statistical analysis.
Off-type plants
Sometimes, you may notice a few exceptionally tall or vigorous
plants in the plots. These off-type plants may have come from the
seeds of a previous crop or may be natural mutants. You cannot
simply ignore these plants as they may already have affected
surrounding plants. Their removal creates missing hills or gaps in
the row and thus affects the surrounding plants. Therefore, they
are normally allowed to mature, but just before harvest, such
plants are counted and removed. The yield of the plot can then be
computed as:
[153]
𝑎+𝑏
Y=( )𝑦
𝑎
plants.
For example, take the case of a plot with a total plant stand of
100, in which 4 plants are off types. Suppose that after removing
the 4 off types, the remaining 96 plants yielded a harvest of 2 kg.
The corrected plot yield is 2.083 kg. This correction is applied
based on an assumption that the competition effects offered by the
off-types to the surrounding plants are similar to those of the
normal plants.
Competition effects
Competition between plants for various resources is common in
crop communities. Competition between crops and weeds for the
same resources such as solar energy, soil nutrients, and moisture
should be kept to the minimum. Competition effects between crop
plants within a plot (intraspecific competition) should also be
considered and kept uniform. Make sure that the plant response
represents the actual conditions being tested in terms of intra-
varietal competition. Intra-specific competition is also most
obvious when the experiment involves different varieties or
genotypes of a crop. Different cultivars or genotypes sown in
adjacent plots may be subjected to different environmental
[154]
conditions depending upon their location relative to adjacent
plots. In such trials, the plants near the borders may experience
the effects of varietal competition or edge effects.
Competition could also occur for nutrients when neighbouring
plots receive different rates of fertilizers. Plants that receive a
higher rate tend to be more vigorous and more competitive.
Likewise, another source of competition is seepage of water from
fertilized plots, which may spread nutrients to the root zone of the
adjacent plots. Ultimately, this may favourably influence the plots
receiving smaller doses of fertilizers.
Pathways or alleys
It is common to see vigorous and luxuriously growing crops along
the pathways and alleys in a farm. This happens mainly because
of less competition along pathways and alleys where there are
free spaces than those in the centre of the plot.
Missing hills or plants
Missing hills or plants are common problems for farm
researchers. It is very difficult to ensure full stand for all plots in
an experiment even for the vigilant researcher who have taken all
precautions. Poor germination, bird damage, insect and disease
attacks, physical mutilation, and similar causes may be
responsible for the death of a few hills or plants in a plot. Plants
near to the spots of missing plants perform better than the normal
plants because of less competition compared to other plants
creating more problems. Discard all the plants immediately
adjacent to a missing hill, and harvest only those that are fully
competitive. While computing total yield, this loss of plants must
be accounted for. If seeds of the test genotypes vary in age, they
should be rejuvenated at the same time and under the same
[155]
condition to minimize initial variations resulting from the
disparity in age.
9.2. Quasi experiments
[156]
In life sciences, natural experiments involve observing an animal
or groups of animals, a plant or plant community, or some
physical phenomena. Natural experiments are also feasible in
health science when a randomized controlled trial is difficult to
conduct because of ethical issues. A typical example of a natural
experiment is to relate the quality of water in a particular locality
and the occurrence of diseases like cholera.
[157]
9.5. Causal-comparative studies
[161]
out whether there are any significant differences between the
groups, and it allows the researcher to arrive at a firm conclusion.
[162]
you have no other choice but to study a sample of those subjects
whom you are able to recruit (convenience sampling). There are
issues in selecting the controls too. To enable the controls to
represent the same population as the cases, pair wise matching of
participants is often followed. For each subject in a group, the
researcher finds a match in the other group with the same or very
near score on the control variable. If a volunteer does not have a
suitable match, he or she will be eliminated from the study. The
resulting matched groups are very similar with respect to the
recognized extraneous variable.
Blocking, proper plot techniques and proper data analysis are the
three techniques followed in agricultural research for the control
of systematic error. In field experiments, where substantial
variations are expected within an experimental field, employing
proper blocking can reduce experimental errors. This is called
[164]
local control. Proper plot techniques include measures adopted to
reduce soil heterogeneity, competition effects, and mechanical
errors. In experiments where blocking is not done effectively,
proper data analysis can help to control errors. Analysis of
covariance can be adopted in such cases. Suppose you want to lay
out an experiment in a coconut garden where the yield levels of
coconut trees differ considerably. Using the initial yield as the
covariate, the final yield after the experiment can be adjusted to
the values that would have been attained had all experimental
trees started with the same yield.
10.2. Precision
10.4. Simplicity
[166]
SECTION IV. DATA COLLECTION,
MANAGEMENT, AND ANALYSIS
[167]
Sampling
A parameter, a value which represents a certain feature of a
population, is usually unknown (and therefore has to be
estimated). The population mean, for example, is a parameter that
helps in indicating the center or an average value of a population
characteristic. A population parameter for a given population does
not vary as it is a fixed value but it obviously requires a complete
enumeration of all items in the ‘population’ or the procedure
known as a census inquiry in cases such as population census. It
can be presumed that in such an inquiry, when all items are
covered, highest accuracy is obtained. Nevertheless, this type of
inquiry is practically not affordable as it involves a great deal of
time, money and energy.
The common method is possible to study only a part of total
population, i.e. a representative sample, to obtain a fairly accurate
sample statistic. Sampling is the process of taking a
predetermined number of observations from a larger population,
which is meant for statistical analysis. Thus, sampling is a
procedure of selecting a representative sample from a big mass of
population.
A statistic is calculated from a sample which is randomly drawn
from a population and a sample statistic which is obviously used
to estimate the corresponding unknown value of the population
parameter. A good example is a mean value of a sample which is
used to give information about the mean of the corresponding
population from which that sample was initially drawn.
For better representation of a population by a single or multiple
samples, a good sampling design, i.e. the basic framework or road
map for the selection of a sample, is required.
[168]
The characteristics of a good sample design include: good
representation of the corresponding population (with a small
sampling error), enables to monitor and control any systematic
bias that may be encountered in the process, and the results of
such a sample study can be applied for the population with a
reasonable level of confidence.
A major problem of sample evaluation is the occurrence of
sampling errors, as only a part of the population is measured in
sampling. Although there will not be any sampling errors in
complete enumeration, possibilities of non-sampling errors are
greater. If you want to have high degree of precision, take large
samples and use superior instruments for measurements.
Sampling and non-sampling errors
In sampling, instead of studying a whole population, you study a
fraction of the population, the sample, and infer the situation to
the population under investigation based on the sample statistics.
This is actually an inductive process. Inferences are made by
observing a small section of people, animals, or plants and
extrapolate them for the whole population, which they represent.
Note that representative sampling is a prerequisite for
successfully averaging out random errors and avoiding systematic
errors. The quality and usefulness of your inference depends on
how best representative is the sample.
[170]
Probability sampling methods
In probability sampling, each constituent of the population has a
known probability of being selected. Because of this character,
sampling error can be estimated—a major advantage of
probability sampling. When extrapolating data from samples to
that of population, values are presented plus or minus the
sampling error. Common probability methods include simple
random sampling, systematic random sampling, and stratified
random sampling.
Simple random sampling
As the name indicates, it is the simplest form of probability
sampling where individual units are drawn from the population at
random. In this sampling method, every item in the population
has an equal chance of being included in the sample. For a small
and almost a uniform population the simple random sampling
method is most preferred. When you attempt sampling, ensure
that every constituent of the population has an equal chance of
being selected. You have to fix up the number of samples based
on the size of population, and every element of population has the
same probability of being selected. In such a design, the selection
process starts by picking some random point in the list and then
every nth element is selected until the desired number is secured.
[173]
can be listed. It is also called an Nth name selection technique.
This method of sampling is useful when sampling frame is
available in the form of a list. The selection starts by taking some
random point in the list and then every nth element is selected
until the desired number of samples is obtained. Thus, first, the
required sample size is determined, suppose it is 50 from a
population of 1000. Then, the number of intervals is found out by
dividing the population by the sample size. One would select the
first item by choosing a randomly selected item, and then, every
40th (Nth record) item is selected from a list of the population until
the sample of 50 items is completed. For example, if the first
sample is the 6th item, subsequent samples will be 46th, 86th, 126th,
and so on until we get 50 samples. This kind of systematic
sampling is as good as random sampling
Stratified random sampling
Stratified random sampling is a commonly used probability
method when large samples are involved. In such cases, it is
considered superior to random sampling as it helps to reduce
sampling error. Stratified sampling is adopted usually for
sampling heterogeneous populations. The population is divided
into homogeneous subgroups or strata, and from each subgroup or
stratum, a random sample is drawn. In other words, the
population is stratified into a number of non-overlapping sub-
populations or strata and sample items are selected from each
stratum. Before going for sampling, however, the researcher has
to identify relevant strata with some common characteristics and
their actual representation in the population. Afterwards, for each
stratum, subjects are selected in proportion to its frequency in the
population using random sampling procedure.
[174]
Cluster sampling and area sampling
Cluster sampling refers to the method of grouping the population
and then selecting the groups or the clusters rather than individual
elements for sampling. Suppose a Zonal Agricultural Office
wishes to sample farmers in a Peasant Association or a district
who have bank accounts. The bank has issued 2000 bank account
books to its farmer customers. The sample size is to be kept say
150. For cluster sampling this list of 4500, the bank account book
holding farmers could be formed into 45 clusters of 100 card
holders each. Three clusters might be selected for the sample
randomly. The sample size must often be larger than the simple
random sample to ensure the same level of accuracy. This is
because the potential for order bias and other sources of error is
usually high. The clustering approach can, make the sampling
procedure relatively easy and increase the efficiency of field
work, particularly for conducting interviews. Area sampling is
similar to cluster sampling but is often applied when the
geographical area to be studied is too vast. Therefore, first, the
total area is first divided into a number of smaller non-
overlapping area. These are called geographical clusters. Then,
the smaller areas are randomly selected, with inclusion of all units
in the sample. Area sampling is particularly useful when the list
of the target population is not available. It also enables making of
efficient field interviewing for interviewers can administer a
number of interviews at each location.
Multistage sampling
It is a type of stratified sampling suitable for infinite populations,
where a list of members is absent, or when the individuals are
living in widely scattered groups. This is also called cluster or
[175]
area sampling. It is an extension of cluster sampling. The method
is meant for big investigations extending to a considerably large
geographical area like the whole of a country. The population is
first divided into different stages, and random samples are drawn.
Initially, the population is divided into first stage sampling units,
from which a random sample is selected. This sample is then
divided into second stage units, and again a sample is selected. In
this way, a random sample is selected at each stage. There must
be at least two stages in this type of sampling.
[176]
Convenience sampling
Convenience sampling is a non-probability sampling technique,
which is also called accidental sampling. It is most often used in
descriptive research where the concern of researchers is to get an
inexpensive estimate of facts. As the name implies, selection of
samples is based on convenience. Convenience sampling occurs
when samples are drawn from the population based on ease of
access. However, such a procedure may give very biased results
particularly when the population is not homogeneous. This non-
probability method is often used during preliminary stages of
research to get a rough estimate of the results.
Judgment sampling
Judgment sampling is often used when the universe (population)
is small and a known characteristic of it is to be studied
intensively. In judgement sampling, the researcher’s judgement is
used for selecting items which he/she regards as representatives
of the population. For example, a judgement sample of college
students might be taken to secure reactions to a new method of
teaching. Judgement sampling is often used in qualitative research
when the researcher intends to formulate a hypothesis rather than
to generalize to larger populations.
The researcher selects the sample based on some judgment,
especially when the entire population is inaccessible. This is
actually an extension of convenience sampling. Suppose that an
investigator has to take samples from several districts. The
researcher may decide to select samples from one representative
district only instead of several districts, having convinced that the
chosen district is truly representative of all the districts to be
sampled. Although bias can occur in judgment sampling, you can
[177]
still have good representation of population, if you can do it
objectively.
Quota sampling
Quota sampling is an important form of non-probability sampling.
In general, in stratified sampling, the cost of taking random
samples from individual strata is often expensive. Therefore,
interviewers are given quotas to be filled from different strata.
The selection of the samples is left to the interviewer’s
judgement. This is what constitutes quota sampling. The size of
the quota for each stratum is generally proportionate to the size of
that stratum in the population. Quota samples generally happen to
be judgement samples rather than random samples.
[178]
11.1. Types of data collected in research
Data that researchers collect are generally grouped into two types,
namely, primary and secondary data. The grouping is based on
their source.
11.1.1. Primary data
Primary data are original data that are collected by researchers
from the actual research he or she has done. Thus, when the data
are collected by direct observation or survey, they are called
primary data. Primary data, also known as raw data, give first-
hand information to the researcher after processed statistically.
For primary data, specific method of data collection is required.
However, for secondary data, what is required is mere
compilation of the data from its source.
[180]
possible to avoid bias in observations. Researchers can use
modern techniques such as microscopes, hidden cameras,
recorders, and videos to record observations.
Natural observation
In natural observation, researchers passively observe and record
the behaviour, phenomena, or some other events in its natural
background. The researcher will not in any way interfere with the
system. This kind of observation has been a successful method in
such physical sciences as astronomy, geology, oceanography, and
meteorology. In social sciences, humans or animals are observed
as they go about their activities in real life situations. In natural
sciences, this may involve observing plants, animals, or some
physical phenomena in natural settings. In health science-related
areas such as human anatomy, observation is the primary method
used to describe the construction of the body. In ecology,
observation has always been of importance although experimental
methods have also been utilized.
Participant observation
Participant observation is one of the most common methods for
collecting qualitative data. In participant observation, researchers
live with the subjects being observed as an active participant and
record extensive field notes. They take part in the daily activities
of people, reconstructing their interactions and activities in field
notes taken on the spot or as soon as possible after their
occurrence. Compared to direct observation, participant
observation often requires long periods, months, or even years of
intensive work. Time is a major constraint with participant
observation as a data collection method.
[181]
Observation is used to collect data from structured experiments as
well as from descriptive research studies. This method of data
collection is used more commonly in experimental research than
in social science studies. This method of data collection is
planned in advance, and carefully and thoughtfully selected. Data
collecting using the method of observation often yields accurate
findings and results in sound conclusions. If observation is taken
accurately, subjective bias may also get reduced. When using this
method of data collection, a researcher should bear in mind the
following facts: (a) what to observe, (b) how observations are
required to be noted, (c) how to ensure the accuracy of the data,
etc.
[183]
is biased, she/he can introduce biased observations and may come
up with a wrong conclusion. For instance, sponsored research
from corporate firms or projects funded by sources with dubious
agenda may result in intentional biases. Personal bias of a lesser
degree may also occur when selecting plots for a particular
treatment or locating the plots. In field experiments, unintentional
biases can be eliminated by adopting the three principles of
experimentation—randomization, replication, and local control.
Interview method
This is one of the most common methods of data collection,
particularly in social and behavioural sciences. Oral
communication is the main theme behind such method. Different
questions, sometimes called stimuli are presented, to the
respondents to record their responses.
[184]
Structured interviews
In structured interviews, the interviewer uses a pre-prepared
questionnaire (an interview schedule) and conducts the interview
as such without much variation. A major advantage of structured
interview is that the quantitative data generated are amenable to
statistical analysis.
Unstructured interviews
This takes the form of a conversation between the informant and
the researcher. There is no standardized list of questions, and it is
a free flowing conversation in a natural setting. In an unstructured
way, it focuses on the respondent’s perception or opinion on
various issues. This is also called open-ended interviewing or in-
depth interviewing.
Semi-structured interviews
Semi-structured interview makes use of a guide list with some
broad questions or issues, which are to be discussed for possible
investigation during an interview. The list normally includes
broad and open-ended questions to be answered in a free flowing,
conversational, relaxed, and informal setting. The interviewer is
left free to rephrase the questions and to ask probing questions for
added details. Semi-structured interview is one of the main tools
used in ‘participatory learning and action’ (PLA), an umbrella
term for a variety of participatory approaches to development.
Interviews can broadly be classified as personal interview,
telephonic interview, and chatting.
Personal interview
In a personal interview method of data collection, a researcher or
an interviewer generally asks some questions and notes down the
respondent’s responses, while in a direct personal interview
[185]
method, an interviewer collects the information directly from the
respondent. This is comparatively easy, and data collection takes
place then and there. But, in some cases, it may not be possible to
contact directly the person concerned due to various reasons; in
such cases, indirect oral examinations can be conducted and of
course followed by cross-examinations from other persons who
have sufficient knowledge about the problem under investigation.
An indirect method of interview is mostly useful if respondents
are high profile in nature or are members of the commission and
committee appointed by the government for specific
investigations.
[188]
Explanatory research analyses and justifies the reason behind the
occurrence of particular phenomenon or association between the
variables. It fundamentally answers the “Why” type of questions.
It explains why a relationship, association, or interdependence
exist. Some of the examples of explanatory research are “Why is
continuous use fertilizer for some years creates a situation that the
land becomes progressively unproductive next time when no
fertilizer is applied to the crop”?
Attitude surveys
Attitudes are predispositions to react positively or negatively to
some social objects. In attitude surveys, also called opinion
surveys, standardized questionnaires indicating the degree of
favourability towards an object are used to measure attitudes or
opinions. It is mainly based on the individual’s agreement or
disagreement with a number of statements relevant to the attitude
object. An attitude scale usually consists of the belief component
of the theoretical attitude in a number of statements. Many
attitude scales like the Thurstone scale and the Likert method
were developed by researchers. The Thurstone technique of
scaled values which is a method to facilitate interval scale
measurement. The researcher selects a large number of evaluative
statements, usually 20 or more, about a particular group,
institution, idea, or practice. The statements should be
unambiguous and cover a full range of attitudes towards the topic;
and after the set of statements are made, a panel of judges are
asked to rate each statement, either agree or disagree, and finally
analysis is done. However, in surveys with questionnaires, the
Likert scale is the most widely used scale. A Likert item is a
statement, which the respondent is asked to evaluate according to
[189]
any kind of subjective or objective criteria. Often, the level of
agreement or disagreement is measured on 5- or 7-point scale
response levels. For example, if the 5-point scale is taken, 2 are
subjective degrees of affirmation, 2 are subjective degrees of
negation, and 1 neutral. The format of a typical 5-point scale
Likert item is 1 stands for strongly disagree, 2 for disagree, 3 for
neutral (neither agree nor disagree), 4 for agree, and 5 for strongly
agree.
Questionnaire
A questionnaire consists of a series of pre-determined questions
that can be self-administered, administered by mail, or asked by
interviewers. The information is collected usually through mail by
sending a proforma. The respondent is asked to fill it, and there is
no interaction between the investigator and the respondent.
Hence, simple questions only are included in questionnaires.
When the questionnaire is administered by an interviewer, it is
often called an interview schedule or simply schedule. Here,
investigators ask questions directly to the respondents using the
schedule. They frame a set of questions, and while asking
questions, they can make some variations in the mode of asking
questions.
[190]
Forced choice items
Forced-choice items or closed items allow the respondent to
choose from two or more fixed alternatives. Most frequently used
are the dichotomous items, which offer two alternatives only, for
example: ‘yes/no’ or ‘agree/disagree’. Sometimes, a third
alternative is also given as ‘undecided’ or ‘don’t know’. The
alternatives offered should cover all the possibilities.
Open-ended items
The respondents are free to answer anything to the questions
offered to them. The answers may be a short note or short essay
depending on the nature of question. No restraints are imposed on
their answer to the question.
Scale items
As already mentioned, the scale is a set of verbal items to which
the respondent answers by indicating degrees of agreement or
disagreement. Individual responses are located on a scale of fixed
alternatives, for example: ‘strongly disagree’ to ‘strongly agree’.
[191]
Clarity in the nature of questioning is the most important factor in
getting an actual response. The degree of clarity of the questions
asked and their wordings are the most important things.
Therefore, simplicity in language and communication is also the
art of framing a good questionnaire. Thus, a researcher should
communicate to the respondent in a very simple and sober manner
using simple language. Any vague or ambiguous or confusing
question should be avoided. Questions should be very short,
simple, and informative. One question should convey only one
message at a time. The researcher should try to avoid asking any
personal questions which may make the respondent hesitant in
answering those questions.
[193]
publish different data and reports, which can be used as sources of
secondary data.
Prior to using any secondary data, a researcher should make sure
that the data are original and authentic, with very much care about
the originality or authenticity of the data. Thus, reliability,
accuracy, and adoptability of the data are the most important
features. Note that the sources of secondary data may be
published or unpublished.
[195]
(a) Nominal scale
Nominal scale (also called classificatory scale or categorical
scale) is the most elementary method of quantification of
observation, and the least precise. This scaling is done for
nominal variables. A nominal scale describes differences between
characters by assigning them to categories. By using nominal
scale, you can classify animate beings, inanimate objects, or
events into a number of mutually exclusive categories, so that
each member of the subgroups has some characteristics in
common. A nominal scale is used when variables do not have a
natural order or ranking. You can include numbered or
unnumbered variables, but common survey examples include
gender, location, political party, pets, and so on. For example, the
variable ‘gender’ can have two categories, males or females; and
considering ‘educational qualification’, six categories can be
suggested, non-literate, literate, matriculate, graduate, post-
graduate, and doctorate.
For example, if a researcher wants to measure attendance of a
conference based on sex, i.e., as the ratio of male to female, the
researcher may tabulate those have attended the conference
according to sex. If the object in the domain appears to be male,
assign to “0” and if female assign to “1”. Similarly, we can record
a person’s marital status as 1, 2, 3 or 4, depending on whether the
person is single, married, widowed or divorced. The researcher
can as well record “Yes or No” answers to a question as “0” and
“1” (or as 1 and 2 or perhaps as 59 and 60). In this artificial or
nominal way, categorical data (qualitative or descriptive) can be
made into numerical data and if the various categories are thus
coded, they are referred to as numbers recorded as nominal data.
[196]
Nominal data are numerical in name only, because they do not
share any of the properties of the numbers we deal in ordinary
arithmetic. For example, if the researcher records marital status as
1, 2, 3, or 4 as stated above, he/she cannot write 4 > 2 or 3 < 4
and we cannot write 3 – 1 = 4 – 2, 1 + 3 = 4 or 4 ÷ 2 = 2.
Using nominal scale, you can only allot individuals to a category,
but cannot rank them. Sometimes, code values are given for
processing data, for example, 1 for female and 2 for male.
Individuals having a single value are alike and those having
different values are different. The labels tell us that the categories
are quantitatively different from each other (Table 7). However,
they have no quantitative significance, implying that they cannot
be added, subtracted, multiplied, or divided. Probably, the only
arithmetic operation possible with nominal scales is counting.
Table 7. Educational level of people in a village showing nominal scale (fictitious data)
Non-literate 5 7 12
Literate 80 52 132
Matriculate 78 86 164
Graduate 46 42 88
Postgraduate 26 22 48
Doctorate 3 2 5
[198]
respective hardness numbers on Mohs’ scale are 8 and 4. The
greater than symbol (i.e., >) in connection with ordinal data may
be used to designate “happier than” “preferred to” and so on.
[199]
Consider the example given in Table 8. In the example, ranks
were allotted based on the degree of adoption of integrated pest
management (IPM) in wheat by farmers. The lowest score of ‘0’
was given to ‘no adoption’ and the highest rank of ‘5’ was given
to ‘full adoption’.
Table 8. Scales of measurement showing ordinal scale
0 No adoption
1 Slight adoption
2 Partial adoption
3 Moderate adoption
4 Majority adoption
5 Full adoption
[201]
fact, we have only to change to the centigrade scale, where the
first temperature becomes 5/9 (116 – 32) = 46.6°, the second
temperature becomes 5/9 (58 – 32) = 14.4° and the first figure is
now more than two times the second. This problem arises from
the fact that Fahrenheit and Centigrade scales both have arbitrary
origins (zeros) i.e., the number 0 of neither scale is indicative of
the absence of whatever quantity we are trying to measure.
[205]
Types of items in Likert scales
You can measure a wide range of perceptions, motivations, and
intentions
Some of the most common types of items include:
Agreement: Strongly agree, Agree, Neither agree nor disagree,
Disagree, Strongly disagree
Quality: Very poor, Poor, Fair, Good, Excellent
Likelihood: Not at all likely, Somewhat likely, Extremely likely
Experience: Very negative, Somewhat negative, Neutral,
Somewhat positive, Very positive
15.4. Causes of errors in data measurement
[206]
validation of data by using multiple methods, multiple observers
and multiple investigators.
(b) Situation
The situation during the time of collection of information plays a
great role in manifesting an effective research output. A situation
(strained/easy) during the time of data collection, particularly for
socioeconomic research, may enhance or distort information
needed for a research project. Sometimes, a respondent may feel
that anonymity is not assured and she/he may be at risk as a result
of which he/she may be very reluctant to provide genuine
information. The presence of somebody may also hinder or ease
out an information extraction process.
[207]
not up to the standard because of faulty instruments, it will have
some adverse effects on the output of a research program.
[208]
12. Organizing Data
Working with data starts with the scrutiny of data. This is the data
organizational stage, i.e. the practice of categorizing and
classifying data to make them more usable.
Thus, before analyzing data, the researchers need to put the data
into a standard format like the excel spreadsheet or other formats
in the given statistical package that can be used for the analysis
method. Consistency is highly required starting from this stage
particularly different people are entering data, for instance, on
different response characters are coded.
Researchers cannot rule out occurrence of errors no matter how
properly the experiment designed. At the data organization stage,
erroneous data points are identified, cleaned, edited or trimmed
out for effective and efficient analysis. Each and every data point
should be checked for deviation from expectations if, for instance,
anything is incomplete, not understandable, or out of range.
For describing and analysing the results, a basic understanding on
statistics and its application in agricultural and life sciences is
necessary. A number of statistical software have a built in system
purely meant for organizing the collected data by showing
outliers, estimating missing values, trimming outliers, etc. An
outlier is an observation in a data set which are far removed as an
unusually large or an unusually small value compared to the
others. If an outlier is a genuine result, it is important because it
might indicate an extreme of behavior of the process under study.
For this reason, all outliers must be examined carefully before
embarking on any formal analysis. Some erroneous data may be
[209]
corrected by referring back to the original data collection sheet or
logbook or the researcher may be compelled to re-collect the data
by running the same test again, for instance, by re-analyzing the
same sample if the data are originally from laboratory analysis.
[210]
The other assumption of the analysis of variance is homogeneity
of the variance. If this assumption is justified, then two or more
sample variances can be pooled and the test completed. This
pooling is only valid if the within-treatment variation is similar
for each treatment.
The last assumption of the analysis of variance is related to the
concept of additivity of variances (treatment effects and
environmental effects are additive). Validity of the analysis of
variance is also based on the assumption that the yields are made
of components which are added together.
As a case example, assumptions of analysis of variance
(ANOVA), particularly test of heterogeneity of error variance for
which several methods are available, may be considered. As the
first step towards remedial measure for handling variance
heterogeneity, a correct diagnosis of the specific type of variance
heterogeneity present in the data must be made before appropriate
remedial measures are selected as, for instance, a simplified
procedure is presented below.
First, the variance and mean across replications are computed for
each treatment; second a scatter diagram is plotted between the
mean and the variance values (note that the number of points in
the scatter diagram equals the number of treatments unless and
otherwise there are overlapping points); third the scatter diagram
is visually examined to identify the pattern of relationship, if any,
between the mean and the variance.
Figure 2 below depicts three possible outcomes of such an
examination. The first part of the Figure (left) shows
homogeneous variance as there is no functional relationship
[211]
between the mean and the variance (Figure 2a); the second part of
the Figure (middle) shows heterogeneous variance when there
was a strong functional relationship between the mean and the
variance (Figure 2b); and the third part of the Figure (right) shows
heterogeneous variance when there was no clear functional
relationship between the mean and the variance but simply
because of existence of some outliers (Figure 2c).
There is no need to go for data transformation for the data shown
in the first part of the Figure 2a (left) as it has a readily
homogeneous error variance but the data presented in the second
part of the Figure 2b (middle) need proper transformation as the
data has clearly heterogeneous error variance. However, for the
data shown in the last part of the Figure 2c (right), even if the data
has heterogeneous error variance, there may be no need to go for
data transformation as trimming of the limited outliers may
resolve the limitations due to error variance heterogeneity in such
particular cases.
Data transformations
If your data do not conform to the assumptions, which validate
the analysis of variance, it may be possible to transform them to a
new scale conforming to the assumptions. Analysis of variance is
taken up on the transformed data and inferences are made
accordingly with the transformed means. In this case, analysis of
variance carried out on the transformed data will be valid.
Presentation of results should include the untransformed and
transformed treatment means.
In general, transformations should be skipped unless they are
obviously necessary to avoid biased tests of significance. As the
analyses can be carried out very quickly on the computer, you are
[212]
advised to compare the results with and without transformations.
If alternative analyses lead to the same conclusions, it is best to
present the results based on the untransformed data. The
transformation chosen should be the one which most closely
satisfies the analysis of variance assumptions; this may not be the
one which gives you the results you are looking for!
Among the different types of transformation to make the data
corrected for analysis of variance, logarithmic transformation,
square root transformation, and angular transformation are widely
used.
Logarithmic transformation
This is most suitable for data where the standard deviation is
proportional to the mean or where the effects are multiplicative.
Examples include the number of insect pests observed per unit
area, number of egg masses per plant or unit area, number of
insects per plant and number of diseased plants per plot. Usually,
simple logarithm of the values (log X) is used. These data are
counts that frequently cover a wide range from single-digit
numbers to numbers in hundreds or thousands.
Thus, the number of plant insects, number of egg mass per unit
area, number of larvae per unit area, etc., are typical examples
wherein variance is proportional to the mean and logarithmic
transformation can be used effectively. The procedure is to take
simply the logarithm of each and every observation and carry out
the analysis of variance following the usual procedure with the
transformed data. However, if in the data set small values (less
than 10) are recorded, then instead of taking log(x), it will be
better to take log (x + 1), i.e. if the data contain zeros or numbers
closer to zeros, add one to each number before taking logs.
[213]
The final results or inference should be drawn on the basis of
transformed mean values and calculations made through
transformed data. However, while presenting the mean table, it
will be appropriate to recalculate the means by taking the antilog
of the transformed data. In practice, the treatment means are
calculated from the original data because of simplicity of
calculations, but statistically the procedure of converting
transformed mean to original form is more appropriate. If there is
a mismatch in the two procedures, then the procedure of
converting the transformed mean with the help of the antilog is
preferred over the other procedure.
Square root transformation
Data needing a square root transformation are typically number of
events per unit of time or space when the event is considered rare,
for example numbers of insects caught in a trap, the number of
death per unit time, the number of infested leaf per plant, or the
percentage of infestation (disease or pasts) in a plot (either 0–30%
or 70–100%).
Usually, square roots of the data are used (X½). However, if the
data set include small values (less than 10), especially when zeros
are present, use (x + 0.5)½ for transformation.
Some researchers recommend the square root transformation for
leaf area because it is measured in square units. Small increases in
length when the length is large are associated with large increases
in area. This transformation is also recommended for percentage
data in the range 0–30% or 70–100% (skewed to the left or right)
because for such data, the variances tend to be proportional to the
mean.
[214]
Arcsine transformation
Angular transformation is suitable for proportions, data obtained
from a count, and data expressed as fractions or percentages. For
arc sine transformation, usually a table prepared by Fisher and
Yates is used. However, for percentage data lying between 30 and
70 percent, no transformation is required. For percentage data
lying within the range of either 0–30 or 70–100 percent (but not
both), the square root transmission is most ideal. For percentage
data that do not follow the ranges noted, arc sine transmission
could be used.
Percentage data (e.g., percentage of carbohydrate, protein, and
sugar) which are not arising out of count data may not commonly
need transformation. Moreover, all the percentage data arising out
of count data need not be subjected to arcsine transformation
before analysis of variance:
(a) For percentage data ranging either between 0 and 30% or
70 and 100% but not both, the square root transformation
should be used.
(b) For percentage data ranging between 30 and 70%, no
transformation is required.
Percentage data which overlaps the above two situations should
only be put under arcsine transformation. Thus, a data set having
0 to more than 30%, less than 70–100%, and 0–100% should be
put under arcsine transformation. The values of 0% should be
1 1
substituted by 4𝑛 and the values of 100% by 100 – 4𝑛 , where n is
the number of counts on which percentages are worked out before
transforming the data following arcsine rule of transformation.
The essence of arcsine transformation is to convert percentage
data into angles measured in degrees, that is, to transform 0–
[215]
100% data into 0–90⸰ angles. The actual procedure is to convert
the percentage data into proportions and transform them it into
sin–1 √𝑃 , where p is the percentage data measured in proportions.
Ready-made tables are available for different percentage values
with their corresponding transformed values. However, in MS
Excel with the following functional form, percentage data can be
directly converted to arcsine transformed data as: degrees
(arcsine(sqrt(p/100))), where p is the percentage value. As a
general guide to deciding between a Log and a Square Root
Transformation, if the ratio of standard deviation to treatment
mean is constant, for data from a randomized complete block
design (CRD) so that treatments with large means have large
values, a log transformation is recommended. Check by making a
graph of standard deviation against treatment mean. If the points
lie approximately on a straight line, a log transformation is
appropriate. However, if it is the variance and not the standard
deviation which is proportional to the treatment mean, the square
root transformation is recommended.
[216]
a b
Figures 2a–c. Different levels of variance heterogeneity as depicted from the relationship
between intra-treatment means and variances across replications
[217]
Arc Sine transformed (if error variance is heterogeneous) before
conducting analysis of variance.
Table 9. Pre-transformed percentage values for commonly used rating scales of disease severity
Rating scale Alternative scoring scale
0–3 0-–5 1–5 0–9 1–9
0 0 0 - 0 -
1 25 10 0 3 0
2 75 35 15 12 4
3 100 65 50 25 15
4 90 85 42 30
5 100 100 58 50
6 75 70
7 88 85
8 97 96
9 100 100
[219]
13.1. Univariate Analysis
Descriptive statistics
During the course of investigation, you may be accumulating
voluminous data, which need to be summarized and presented in
a clear accurate format for easy comprehension. For this purpose
of summarizing a data set, you make use of descriptive statistics
or deductive statistics. Using descriptive statistics, you can reduce
a set of numbers into simple values and describe the main features
of a data set quantitatively. These include calculation of measures
of central tendency such as mean, median, and mode; dispersion
measures such as standard deviation and range; association
measures such as correlation and regression; frequency
distribution tables; cross tabulation tables; and graphs and figures.
Normally, a combination of tables, graphs, charts, and a
discussion is used to summarize and present a data set. A major
drawback of descriptive statistical analysis is that it limits
generalization to the particular group of individuals only.
Therefore, no conclusions are possible beyond this group, and
you cannot assume any similarity to those outside the group.
There are three general types of descriptive statistics used to
describe data, the measures of central tendency, the measures of
spread or dispersion, and the measures of association.
[220]
‘normal distribution’, the mean, the median, and the mode
coincide.
[221]
Other common descriptive statistical tools include percentages,
proportions, ratios, and rates. Frequency distribution tables, cross-
tabulation tables, graphs, and figures are also made according to
the type of observation and data collected.
Measures of central tendency
Measure of central tendency, namely, mean, median, and mode
provide central value or typical representative of a set of scores as
a whole. These measures give a characteristic of the whole group
by a single number. Then, it is possible to compare different sets
of scores to compare the achievement of any different groups.
Mean
Sample mean ( X ), a measure of center of the sample data
including the outliers commonly called the average, is considered
a good estimator for the population mean (). The sample mean,
in addition to giving information about the test sample, is also
important to make inferences (draw conclusions) about a
population, which is defined as the collection of all possible
observations of interest as it may not always possible to deal with
populations because of their too large size to study.
For example, if we want to know the average body weight of
goats in Ethiopia, it is practically impossible to measure each and
every goat in Ethiopia. Likewise, the average yield of the teff
crop in Ethiopia cannot be determined by weighing the whole
harvest. For practical reasons, we need to deal with a sample
where proper estimates of the population mean could be
generated. A sample is a representative group taken at random
from a population and the number of observations in the sample is
called the sample size. When a sample is properly taken, the
[222]
statistics from that sample can be applied to the population. The
mean shows that ½ the members of the population fall on either
side of an estimated value, i.e. the mean. Measured characteristics
of the sample are called statistics (e.g. sample mean) and
characteristics of the population are called parameters (e.g.
population mean). The arithmetic mean is the best-known
descriptive statistic as an estimator of population mean.
The arithmetic mean (denoted by X ) is mathematically defined
as the sum of all the observations in a sample divided by their
number as given in the following formula:
∑𝑋
Arithmetic mean( X ) = , where
𝑁
sample.
[223]
data are combined. For instance, if some treatments are tested in
two replications and others are tested in three replications for any
reason in the same experiment, all other factors kept constant, the
weighted mean should be used in place of the arithmetic mean.
Suppose we have three sets of data consisting of n1, n2, and n3
observed values and having the means x1, x2, x3, respectively.
Then the mean for the combined data is the weighted average of
the individual means, the respective weights being the sample
sizes n1, n2, and n3.
[225]
∑(𝐱− X ) 𝟐
S =
2
𝒏−𝟏
Standard deviation
Standard deviation, which is used as a measure of average
deviation from the mean designated by the symbol s when dealing
with a sample, is the square root of variance. The mean is usually
expressed together with standard deviation to have a complete
meaning as standard deviation is a measure of variability that is
more convenient in analysis of statistical data. Standard deviation
is considered the most important measure of statistical dispersion,
measuring how widely spread the values in the data set are. If
many data points are close to the mean, the standard deviation is
small; if many data points are far from the mean, then the
standard deviation is large. If all data values are equal, then the
standard deviation is zero. A useful property of standard deviation
is that, unlike variance, it is expressed in the same units as the
data.
𝑠 = √𝑠 2
𝑠
SE =
√𝑛
Take the example of a sample mean and the population mean. The
sample mean is considered as a probable estimator of the
population mean. However, different samples drawn from the
same population may have different values of the sample mean.
In such cases, researchers would be interested to know how far
their sample means are fluctuating. For this purpose, estimation of
standard error becomes useful. The standard error depends on
mainly two factors, the size of the sample, and the variations of
measurements in the sample indicated by the standard deviation.
For example, standard error of the mean (SEm) is the standard
deviation of all those sample means drawn from the population.
The standard error of the mean (SEm) is estimated by sample
standard deviation divided by the square root of the sample size
assuming statistical independence of the values in the sample.
[227]
The standard error should be clearly differentiated from the
standard deviation. The standard deviation is a measure of the
variability in the particular sample studied. At the same time, the
standard error is a measure of the uncertainty in a sample statistic.
The standard error, which depends on both the standard deviation
and the sample size, is recognition that a sample is unlikely to
determine the population value exactly.
Coefficient of Variation
Coefficient of variation gives an idea about the degree of
precision with which the treatments are compared. It is a good
indicator of the reliability of the research. It provides an idea
about the experimental error, which is obtained by dividing the
standard deviation with the mean and expressing it as a
percentage or proportion of the total. Coefficient of variation is
helpful in comparing the extent of variation between groups with
different means. A higher CV value means that the reliability of
the research is low. While doing an ANOVA, CV is obtained by
dividing the square root of error MS by the grand mean, and
multiplying it with 100.
[228]
10 to 12% for fertilizer trials, and 13 to 15% for insecticide and
herbicide trials.
[230]
In agricultural research, chi-square test is mainly used for testing
the significance of proportions, analysis of attribute data, test for
homogeneity of variance, and test for goodness of fit. Chi-square
test is used widely in breeding experiments, for example: to test
the significance of deviation of an observed segregation from a
theoretical one, simultaneous testing of a number of questions
such as single factor ratios, linkage, and heterogeneity.
The null hypothesis testing for the Chi-square test of
independence is the same as it is for other tests like ANOVA
where a test statistic is computed and compared to a critical value.
Calculating the Chi-square statistic and comparing it against a
critical value from the Chi-square table allows the researcher to
assess whether the observed values are significantly different
from the expected values which some time are established facts
from previous study.
∑(O−E) 2
Chi-square (2) = , where ∑ = summation,
E
frequencies.
Note the differences and similarities between the z-test and the t-
test carefully. The z-test follows normal distribution while t-test
follows Student’s t-distribution. A t-test is appropriate when you
are handling small samples (n < 30) while a z-test is appropriate
when you are handling moderate to large samples (n > 30).
[233]
The critical values necessary for rejection of a null hypothesis are
higher for small samples at a given level of significance. Each
critical t-value for rejection is based upon appropriate degrees of
freedom. As the sample sizes increase, the critical t-values
necessary for rejection of a null hypothesis decrease and approach
the z-values of the normal probability tables.
If the calculated t value is greater than the table t-value, you have
to reject the null hypothesis at the chosen level of significance
and accept the research hypothesis and proceed further.
Conversely, if the calculated t value is less than the table t-value,
we have to accept the null hypothesis and reject the research
hypothesis. The t-test is often referred to as the Student’s t-test.
X −
t= 𝑠 , where ( X ) = sample mean, = population
√𝑛
X −
t = 1 1
, where ( X ) = mean of first sample mean,
𝑠√ +
𝑛1 𝑛2
Analysis of variance
The t- and z-tests should not serve for comparing the means of
more than two samples coming from different treatment groups
that are normally distributed with a common variance. Although it
is possible to use a number of t- and z-tests to determine the
significance of the difference between more than two means, it
would involve several separate tests. For example, if you want to
compare 6 means, 2 at a time, it would involve 15 separate tests
(number of pair wise comparisons of N items = N (N − 1)/2).
An analysis of variance (ANOVA) should be used in order to
make a statistical test of whether or not
the means of several groups are equal. As the name indicates,
[235]
ANOVA uses measures of variance instead of means as in a t-test.
ANOVA, based on linear regression and general linear models,
also requires the same assumption with the t-test. It is a statistical
procedure which separates the total variation in a replicated
experiment into different components, mainly variance between
treatments (mean squares due to treatment, MST) and
variance within treatments (mean squares due to error, MSE),
thereby providing the basis for the test of significance or what is
called the F-ratio (the ratio of the two, F = MST/MSE) as a
decision tool to determine whether an observed difference is real
or just due to chance. ANOVA, in the example mentioned above,
for instance, makes it possible to determine whether the 6 means
differ significantly with a single test rather than 15 paired tests.
Experiments involving several treatments are usually subjected to
ANOVA.
Factor Model
While ANOVA per se tells that the means are different, it does
not tell which means are different from each other when we have
more than two treatments for comparison (but we only know that
the highest and the lowest means are significantly different). If
the null hypothesis is not rejected based on the result of ANOVA,
it is not necessary or appropriate to further deal with the data. If
the null hypothesis is rejected based on the result of the F test,
however, it is appropriate to further question which treatment(s)
caused the effect.
Tests of significance is based on probability statements that our
findings reflect the truth.
The major reason for using the concept of probability in statistical
testing is that we cannot be sure if our inferences, based on the
sample data, apply to the population, since our sample may
deviate from the population.
[237]
The probability that a statistical inference is caused by pure
chance is called the p-value. The p-value is compared with the
significance level (α), which represents the maximum level of risk
that we are willing to take that our inference is incorrect.
Generally, p-value of p ≤ 0.01 is believed to produce very strong,
a value of 0.01 < p ≤ 0.05 strong, a value of 0.05 < p ≤ 0.10
moderate and a value of p > 0.10 weak or none evidences against
the null hypothesis. For most statistical analysis in agriculture,
however, α level set at 0.05 may be sufficient for the purpose of
mean comparison, i.e. the test treatment means are different at
least 95% of the time. A p-value less than α = 0.05 means that we
have enough statistical evidence to reject the null hypothesis and,
thereby, indirectly accept the alternative hypothesis. However, for
medical sciences, which involve human health and wellbeing a
minimum level is at 0.001 is necessary.
Whatever the p-value, we have a number of range tests commonly
used with their own advantages and limitations for mean
comparison or mean separation based on the outputs of ANOVA
or the F test including the least significant differences (LSD),
Duncan’s multiple range test (DMRT), and the Tukey’s test. It
should be noted that any method of mean separation should be
applied if and only if the F test for the treatments is significant
(when the ANOVA has an outcome which fails to accept the null
hypothesis - post hoc tests).
The LSD provides valid test criteria in two situations; making
comparisons planned in advance of data collection (e.g. treatment
with control) and comparing adjacent ranked means (to choose a
winner) but LSD should not be used for all possible pair-wise
comparisons particularly when the pairs are more than six. The
[238]
difference between two means is declared significant at any
desired level of significance if it exceeds the LSD value using
different formula for different designs.
The other method of mean separation, the Duncan’s multiple
range test (DMRT), which is more useful than the LSD when
larger numbers of mean pairs are compared with each other.
DMRT is considered to be more stringent as compared to LSD as
the former requires larger differences between means compared to
the latter. For instance, the same mean differences found to be
significant by the LSD (which is lenient) maybe declared non-
significant when the DMRT is applied.
The Tukey honestly significant difference (HSD) test, like the
DMRT, is used for pairwise comparisons to determine if multiple
means are significantly different from each other in all possible
pairs based on a studentized range distribution (q). Tukey’s test
tends to have the most stringent results as compared to both the
LSD and DMRT.
Correlation analysis
Researchers in Biology, including Agriculture often find
important to consider the simultaneous variation within a number
of different parameters. He or she may wish to assess
relationships between yield, environmental data, and yield
components. Studies like that, for example, can be used to
investigate whether an increase or decrease in one variable, such
as number of pods per plant, can be explained by change in
another such as plant population and light intensity. Study of
[239]
simultaneous change in two (or more) variables can be carried out
using techniques of regression and correlation.
Covxy
𝑟=
√ x2 ∗ y2
[240]
r√n−2
t=
√1−r2
[241]
provide a succinct summary of large amounts of experimental and
observational data.
[246]
Y = a + b 1 x 1 + b 2 x 2 +b 3 x 3
predicted or explained), a = y
[248]
14. Illustrations of Analysis of Variance
[249]
Step 1. To calculate the different sources of variation of the
analysis of variance, the following step should follow:
𝐺2
Correction factor (CF) = , where G is the grand total
𝑛
and n is the number of observation (i.e. n = r t).
57,1102
CF = (4)(7)
116,484,004
[250]
Step 2. To calculate the mean squares (MS) for each sources of
variation by dividing each sum of square (SS) by its
corresponding degree of freedom, the following step
should have followed:
SST
MST = 𝑡−1
5,587,174
MST = = 931,196
6
SSE
MSE = 𝑡(𝑟−1)
1,990,238
MSE = = 94,773
(7)(3)
√𝑀𝑆𝐸
CV% = Grand mean 100
94,773
CV% = √2,040 100
CV% =15.1%
[251]
The CV, i.e. the experimental error standard deviation percentage
of the mean, indicates the degree of precision with which the
treatments are compared and is a good index of the reliability of
the experiment.
Note that the “F” value should only be computed when the error
degree of freedom is large enough for a reliable estimate of the
error variance. As a general guideline, some text books suggest
that the F value should be computed only when the error degree
of freedom is 12 or more.
In this case, there were highly significant differences among the
insecticide treatments as the computed F value of 9.83 is far
larger than the tabular F value of 3.81 at the 1% level of
significance. However, note that a non-significant F test in the
analysis of variance indicates not lack of difference among the
treatments but the failure of the experiment to detect the
difference because of either a small treatment difference or a very
large experimental error or both. Thus, whenever the F test is
non-significant, it is advisable to examine the size of the
experimental error and the numerical difference among treatment
means. If both values are large, the trial may be repeated and
efforts made to reduce the experimental error so that the
difference between treatments, if any, can be detected. On the
other hand, if both values are small, the difference among
treatments is probability too small to be detected.
Step 5. Mean separation
It should be noted that a significant F test tells only existence of
difference but does not specify the particular pair (or pairs) of
treatments that differ significantly. To obtain such information on
[252]
which treatment is superior over which, another procedure called
mean separation must be conducted.
There are different ways of mean separation but the most
common include the least significant differences (LSD), the
Duncan’s multiple range test (DMR) and the Tukey’s test.
The LSD provides a valid test criterion when making
comparisons planned in advance of data observed (e.g. treatment
with control and comparing adjacent ranked means (to choose a
winner) but LSD should not be used for all possible pair-wise
comparisons particularly when the number of treatment is large.
For the above experiment, for instance, the LSD value is
calculated as illustrated below:
[253]
Computation of the Duncan’s Multiple Range Test (DMR)
essentially follows the same procedure but instead of a t value we
use a Q value obtained from a table "the Studentized Range".
Assume that three treatments were tested in three replications and
ANOVA was conducted on the records as shown below (Tables
13a and 13b):
Tables 13a. Records from the test of the three treatments in three replications
Tables 13b. ANOVA Table of the three treatments tested in three replications
[254]
DMRT0.05 = Q√2 ∗ 𝑀𝑆𝐸/𝑟
DMRT0.05 = 10.50
If we rank the treatments from highest to lowest mean, we
get the following order:
39.3
20.7
11.3
Compare the highest mean (39.3) with the lowest (11.3)
mean: 39.3 – 11.3 = 28.
The difference between the highest and lowest means is
greater than both the LSD (5.92) and DMRT (10.50)
values.
So the highest mean differs significantly from the lowest.
Compare the second highest mean (20.7) with the lowest
(11.3) mean:
20.7 – 11.3 = 9.4.
The difference between the second highest and lowest
means is greater than the LSD (5.92) value.
[255]
So the second highest mean differs significantly from the
lowest.
With DMRT we use a different Q value for the remaining
two treatments excluding the highest mean. The Q-value
will change to 3.46 as:
HSD = 𝑞√𝑀𝑆𝑤/𝑛𝐻
HSD = 4.26√65/3.69 = 17.87
[257]
Table 14. Yield of the six varieties
[258]
𝐺2
Correction factor (CF) = 𝑛
, where G is the grand total
and n is the number of observation (i.e. n = r t).
27.632
CF = (4)(6)
31.8090
Sum of square of total (TSS) sum the squared values
of treatments in each plot and then minus the
correction term.
TSS = ∑xi2 –CF
TSS = [(1.52)2 + (1.49) 2 + … (0.26) 2 + (0.82) 2] – 31.8090
= 1.9619
Sum of square of block sum the squared value of
block, divide by the number of treatments and then
minus correction term.
∑B 2
SSB – CF
𝑡
[(6.98)2 + (7.17) 2 + (6.79) 2 + (6.69) 2] 2
SSB – 31.8090 =
6
0.0226
Sum of square of treatment (SST) sum the squared
value of treatments, divide by the number of
replications and then minus the correction term.
∑T 2
SST – CF
𝑟
(6.09)2 + (2.90)2 +… (3.46)2
SST − 31.8090 =33.6446 –
4
30.8090 1.8356
Error sum of square (SSE) Sum of square of total
minus sum of square of block minus sum of square of
treatment.
SSE = SS total - SST
SSE = 1.9619-1.8356 – 0.0226 0.10378
[259]
Step 2. To calculate the different mean squares, the following
step should follow:
[260]
Source of
variation df SS MS F
Block 3 0.0226 0.0075 1.09
Variety 5 1.8356 0.3671 53.1
Error 15 0.10378 0.0069
Total 23 1.9619
CV% = 7.7%
Test of significance
If we look in the F table for the 5% and 1% F values using the
error degrees of freedom F tests larger than the F tabulated which
is 2.90 at 5% and 4.56 at 1%. Since 53.06 is greater than 4.56, the
difference among the mean yields of the six varieties are highly
significant. There is no significant difference between the blocks
since the F calculated (1.09) is far less that less than the F
tabulated (2.90).
[261]
Since the F test for the treatments is significant, we need to make
mean separation.
[262]
For example, assume that four treatments (A, B, C and D) were
tested in three replications and the record from treatment C in
block 2 is missing as indicated by the question mark in Table 16
below.
Table 16. Data from four treatments tested in 3 replications with a missing value
(𝑟𝐵+𝑡𝑇−𝐺)
Yij = (𝑟−1)(𝑡−1)
(3∗31)+(4∗11)−92)
Yij = (3−1)(4−1)
Yij = 7.5
Step 2. Substitute the calculated value into the missing spot in the
data as indicated in Table 17 below.
Table 17. Data from four treatments tested in 3 replications with a filled missing value
[263]
Step 3. Compute ANOVA following the right procedure
Source of df SS MS F
variation
Block 2 10.792 5.396 1.023ns
Treatment 3 60.063 20.021 3.795ns
Error 5 26.375 5.275
Total 10 97.229
Remember that you will lose one degree of freedom in error and
total for each missing value.
Points to remember about the missing value analysis:
Use of the estimated value does not improve the analysis
or supply additional information.
The error mean square calculated using the estimate of the
missing value is a minimum. Use of any other value but
the one calculated would result in a larger value.
The mean calculated using the estimate of the missing
value is called a Least Square Mean.
Calculating LSD when you have one missing values:
When you have a missing plot, you need to calculate two (not
one) LSD values. The first LSD value is used to compare the
treatments with no missing values while the second is to compare
the treatment with the missing value with those having no missing
vlaue.
LSD value for comparing the treatments with no missing values is
calculated in the usual way as:
[264]
LSD 0.05 = t √𝟐 ∗ 𝑴𝑺𝑬/𝒓
LSD 0.05 = 2.571√𝟐 ∗ 𝟓. 𝟐𝟕𝟓/𝟑
LSD 0.05 = 4.821
LSD value for comparing the treatment with the missing value
with those having no missing vlaue is calculated as:
2 t
𝐿𝑆𝐷 = t√𝑆 2 [ + ]
r r(r − 1)(t − 1)
2 4
𝐿𝑆𝐷 = 2.571√5.275[ + ]
3 3(3 − 1)(4 − 1)
𝐿𝑆𝐷 = 5.567
Note that the LSD value for comparing the treatment with the
missing value with those having no missing vlaue is more
stringent than the LSD value for comparing the treatments with
no missing values.
The steps become rather lengthy and the approach is a little bit
different when two missing values are calculated as demonstrated
in another example given below using the following hypothetical
data. Note that Treat 2 in block two and Treat 4 in block 1 have
one each missing values.
[265]
Block Treatment Total
Treat 1 Treat 2 Treat 3 Treat 4
1 3.1 3.3 3.6 X2 13.9
2 3.1 X1 3.4 4.0 13.9
3 3.0 3.2 3.6 4.2 14.0
Total 9.2 6.5 10.6 8.2 41.8
X1 = 3.375
Step 3. Estimate the other missing value (X2) using the proper
missing plot technique.
[266]
(𝑟𝐵+𝑡𝑇−𝐺)
X2 =
(𝑟−1)(𝑡−1)
(3∗10)+(4∗8.2)−37.875)
X2 =
(3−1)(4−1)
X2 = 4.15
(𝑟𝐵+𝑡𝑇−𝐺)
X1 = (𝑟−1)(𝑡−1)
(3∗10.5)+(4∗6.5)−38.65)
X1 = (3−1)(4−1)
X1 = 3.14
[267]
Step 5. Substitute this value in place X1, put the place of X2
missing again as shown below and then estimate the
latter using the proper missing plot technique.
Block Treatment Total
(𝑟𝐵+𝑡𝑇−𝐺)
X2 = (𝑟−1)(𝑡−1)
(3∗10)+(4∗8.2)−37.64)
X2 = (3−1)(4−1)
X2 = 4.19
[268]
(𝑟𝐵+𝑡𝑇−𝐺)
X1 = (𝑟−1)(𝑡−1)
(3∗10.5)+(4∗6.5)−38.69)
X1 = (3−1)(4−1)
X1 = 3.14
Step 7. Keep on doing the same eteps until you get more or less
constant values; fill in the final values and continue with
your ANOVA. Once you are done with your ANOVA,
the calculation of LSD value when two values are
missing is a little bit different from what we have seen
when one value is missing. It is advisable, in that case, to
use statistical packages like R or SAS to estimate LSD
than manually calculating it to rule out possibilities of
committing a mistake.
[269]
Table 18. Liver cholesterol level (mmol/L) recorded on sheep of different weight and age groups
which were fed with different deits.
Then compute treatment totals and treatment means as shown in Table 19 below.
Treatment A B C D E
Total 17.88 17.52 17.84 17.45 14.58
Mean 3.576 3.504 3.568 3.490 2.916
Grand mean 3.41
[270]
𝐺2
CF = 𝑟𝑐
85.272
CF = 25
CF = 290.84
TSS = X2 – CF
TSS = [(3.38)2 + (3.37)2 + … + (3.64)2] – 290.84
TSS = 2.97
𝑅 2
SSR = – CF
𝑡
(15.50)2 + (16.73)2 +⋯ (18.04)2
SSR = – 290.84
5
SSR = 0.87
𝐶 2
SSC = – CF
𝑡
(17.46)2 + (17.43)2 +⋯ (16.34)2
SSC = – 290.84
5
SSC = 0.17
𝑇 2
SST = – CF
𝑡
(17.88)2 + (17.52)2 +⋯ (14.58)2
SST = – 290.84
5
SST = 1.56
SSE = TSS –SSR-SSC-SST
SSE = 2.97-0.87-0.17-1.56
SSE = 0.37
[271]
𝑆𝑆𝑅
MSR = 𝑡−1
0.87
MSR = 4
MSR = 0.22
𝑆𝑆𝐶
MSC = 𝑡−1
0.17
MSC = 4
MSC = 0.04
𝑆𝑆𝑇
MST = 𝑡−1
1.56
MST = 4
MST = 0.39
SSE
MSE = (𝑡−1( (𝑡−2)
0.37
MSE = (4)(3)
MSE =0.03
𝑀𝑆𝑅 0.22
F (rows) = 𝑀𝑆𝐸 = 0.03 = 7.12
𝑀𝑆𝐶 0.04
F (columns) = 𝑀𝑆𝐸 = 0.03 = 1.35
𝑀𝑆𝑇 0.39
F (treatments) = 𝑀𝑆𝐸 = 0.03 = 12.69
[272]
In crop research, one may not be that much interested in MSR and
MSC as this sources of variation block the variation in the
experimental unit so that block effects in different directions
would not be confounded with the treatment effects. But in
animal research, in this particular experiment for instance,
calculating F values for rows and columns tell how animals of
different age and weight group behave in response to different
deits.
Source of
variation df* SS MS F
[273]
√𝑀𝑆𝐸
CV% = 100
Grand mean
√0.03
CV% = 100
3.41
CV% = 5.145%
LSD0.05 √2 ∗ MSE/r
LSD0.05 = 2.179√2 ∗ 0.0308/5
LSD0.05 = 0.241859
Many students, when they are asked “which of the diets is the
best?”, they answer as treatment “A” merly because this
treatment had the highest mean value. Note, in reality, that it
should not be the treatment that produced the highest mean value
that should be considered the best but rather it should be the
treatment with the lowest mean value as cholesterol level in meat
of animals is something that is undesirable, i.e. the lower is the
better.
The computed F value for column was non-significant indicating
that this experiment could have been conducted using a
randomized complete block design (RCBD) using the weight
groups as blocks (disregarding the age groups) instead of the
Latin Square design because the age groups were non-
significantly different.
[274]
Case example 2. Crop research
Assume that three hybrid maize varieties (A, B and C) were tested
with one standard check (D) using a 4 4 Latin Square design
and the following results were obtained with computed row totals,
column totals and treatment totals (Table 21).
Table 21. Yield of three test maize hybrids and a standard check from an experiment in Latin
Square design
Row Grain yield (t ha–1) Coloumn
Column I Column II Column III Column IV totals
1 B = 1.640 D = 1.210 C = 1.425 A = 1.345 5.620
2 C = 1.475 A = 1.185 D = 1.400 B = 1.290 5. 350
3 A = 1.670 C = 0.710 B = 1.665 D = 1.180 5.225
4 D = 1.565 B = 1.290 A = 1.655 C = 0.660 5.170
Column totals 6.350 4.395 6.145 4.475
Grand total (G) 21.365
[275]
𝐺2
CF = 𝑟𝑐
(21.365)2
CF = = 28.528952
16
TSS = X2 – CF
TSS = [(1.640)2 + (1.210)2 + … + (0.660)2] – 28.528952
TSS = 1.413923
𝑅 2
SSR = – CF
𝑡
(5.620)2 + (5.350)2 +(5.225)2 +(5.170)2
SSR = – 28.528952
4
SSR = 0.030154
𝐶 2
SSC = – CF
𝑡
(6.350)2 + (4.395)2 +(6.145)2 +(4.475)2
SSC = – 28.528952
4
SSC = 0.827342
𝑇 2
SST = – CF
𝑡
(5.855)2 + (5.885)2 +(4.270)2 +(5.355)2
SST = – 28.528952
4
SST
To = 0.426842
compute mean squares due to rows, columns, treatment and
SSE = TSS –SSR-SSC-SST
error, follow the following steps.
SSE = 1.413923-0.030154-0.827342-0.426842
SSE = 0.129585
[276]
𝑆𝑆𝑅
MSR = 𝑡−1
0.030154
MSR = 3
MSR = 0.010051
𝑆𝑆𝐶
MSC = 𝑡−1
0.827342
MSC = 3
MSC = 0.275781
𝑆𝑆𝑇
MST =
𝑡−1
0.426842
MST = 3
MST = 0.142281
𝑆𝑆𝐸
MSE = (𝑡−1)(𝑡−2)
0.129585
MSE = (3)(2)
MSE = 0.021598
𝑀𝑆𝑇 0.142281
F (treatments) = 𝑀𝑆𝐸 = 0.021598 = 6.59
[277]
Source of df* SS MS F
variation
√𝑀𝑆𝐸
CV% = 100
Grand mean
√0.021598
CV% = 100
1.335
CV% = 11%
LSD0.05 √2 ∗ MSE/r
LSD0.05 = 2.447√2 ∗ 0.021598/4
LSD0.05 = 0.2543
[278]
Case example 3. Crossover design (aimal research)
Assume that there are only a few cows (say eight) whose number
is not adequate for conducting a non-crossover trial or a parallel
design/trial to test the effect of two rations. In this case, it is
technically advisable to apply a crossover design where the ration
treatments are administrated to the same experimental units
(cows) but in a sequence, for example during different periods.
This approach is assumed to be cost-effective as the same limited
number of cows are subjected to different treatments at different
times again and again as having more number of cows for a non-
crossover trial or a parallel trial can be expensive. A random
sample of eight cows was taken to test the effect of two rations,
say A and B, on their milk yields. Out of these cows, four cows
were selected randomly. Each of these cows were given ration A
in their productive lactation period and ration B in their lean
(ppor) lactation period. Assume also that after an adequate
washout period or resting period between the periods of a
crossover/switch over study, each of the remaining four cows
were given ration B in their better lactation period and ration A in
their poorer lactation period.
The null hypothesis (H0) is: the effects of the two rations do not
differ on milk yield; or alternatively, the alternate or research
hypothesis (H1) is: the two rations have different effects on milk
yield. The layout and average milk yield per day (in kg) is gven
below (Table 24).
[279]
Table 24. Milk yield of eight cows fed on two rations (A and B) at their productive and lean
lactation periods in a crossover/switch over design
SST = 20.25
SSE = TSS –SSC- SSR-SST
SSE = 315.75-126.75-121.00-20.25
SSE = 47.75
[280]
To compute mean squares due to rows (lactation period), columns
(cows), treatment and error, follow the following steps (Table 25).
𝑆𝑆𝑅
MSR = 𝑡−1
121
MSR = 1
MSR = 121
𝑆𝑆𝐶
MSC = 𝑡−1
126.75
MSC = 7
MSC = 18.10
𝑆𝑆𝑇
MST = 𝑡−1
20.25
MST = 1
MST = 20.25
𝑆𝑆𝐸
MSE = (𝑡−1)(𝑡−2)
47.75
MSE = 6
MSE = 7.95
Table 25. Analysis of variance (ANOVA) for milk yield of eight cows provided with two rations (A
and B) at their better and poorer lactation periods in a crossover/switch over
design
Source of df* SS MS F cal F tab
variation (5%)
Total nk-1=15
[282]
Table 26. Data from seven cows (column) fed with different protein contents having different
lysine levels for over seven three-month periods (rows)
Column
Row Total
C1 C2 C3 C4 C5 C6 C7
R1 Aα=304 B=436 Cβ=350 D=504 Eχ=417 F=519 G=432 2962
R2 Bβ=381 C=505 Dχ=425 E=564 F=494 Gα=350 A=413 3132
R3 Cχ=432 D=566 E=479 Fα=357 G=461 Aβ=340 B=502 3137
R4 D=442 Eα=372 F=536 Gβ=366 A=495 Bχ=425 C=507 3143
R5 E=496 Fβ=449 G=493 Aχ=345 B=509 C=481 Dα=380 3153
R6 F=534 Gχ=421 A=452 B=427 Cα=346 D=478 Eβ=397 3055
R7 G=543 A=386 Bα=435 C=485 Dβ=406 E=554 Fχ=410 2919
Total 3132 2835 3170 3048 3128 3147 3041 21501
[283]
𝐺2
CF = 𝑛
215012
CF = 47
CF = 9699665.327
TSS = X2 – CF
TSS = (3042 + 4362 + …+ 4102) – 9699665.327
TSS = 214461.76
Calculation of the sum of squares of rows:
𝑅2
SSR = 𝑡
– CF
(2962)2 + (3132)2 +⋯+ (2919)2
SSR = 7
–
9699665.327
SSR = 5831.959184
Calculation of the sum of squares of column:
𝐶2
SSC = 𝑡
– CF
(3132)2 + (2835)2 +(3170)2 +⋯+(3041)2
SSC = 7
– 9699665.327
SSC = 2124.24
[284]
𝐿2
SSL = 𝑡
– CF
(2735)2 + (3115)2 +(3106)2 +⋯+(3066)2
SSL = 7
– 9699665.327
SSL = 30718.24
Greek letter
Observations
Treatments Total
Α 304 350 357 372 380 346 435 2544
Β 350 381 340 366 449 397 406 2689
Χ 417 425 432 425 345 421 410 2875
432 494 479 442 481 427 386 3141
436 413 461 536 496 478 485 3305
504 505 502 495 493 534 554 3587
519 564 566 507 509 452 543 3660
Total 2962 3132 3137 3143 3153 3055 3219 21801
𝐺2
SSG = 𝑡
– CF
SSG =
2 2 2 2
(2544) + (2689) +(2875) +⋯+(3660)
7
– 9699665.327
SSG = 160242.8163
[285]
SSE = TSS–SSR–SSC–SSL–SSG
SSE = 214461.76–5831.96–2124.24–30718.24–160242.82
SSE =15544.41
[286]
N3 and N4) in RCBD with 4 replications and the following
results were obtained (Table 28):
Table 28. Grain yield of three rice varieties tested with five levels of nitrogen in an RCBD
[287]
To construct ANOVA table, follow the following steps.
G2
CF = rab
(297.390)2
CF = = 1474.014
(4)(3)(5)
TSS = X2 – CF
TSS = [(3.852)2 + (2.606)2 + … + (5.362)2]
– 1474.014
TSS = 53.530
R2
SSR = – CF
ab
(76.992)2 +⋯+(69.502)2
SSR = – 1474.014
(3)(5)
SSR = 2.599
T2
SST = – CF
r
(12.496)2 +⋯+ (23.546)2
SST = – 1474.014
4
SST = 44.578
SSE = TSS-SSR-SST
SSE = 53.530-2.599-44.578
SSE = 6.353
[288]
To compute sum of square of the main factors (A and B) and their
interaction (AB), follow the following steps.
𝐴2
SSA = – CF
𝑟𝑏
(95.388)2 +(100.840)2 + (101.162)2
SSA = – 1474.014
(4)(5)
SSA = 1.052
𝐵2
SSB = – CF
𝑟𝑎
(41.800)2 +⋯+ (69.560)2
SSB = – 1474.014
(4)(3)
SSB = 41.234
SSAB = SST – SSA-SSB
SSAB = 44.578-1.052-41.234
SSAB= 2.292
[289]
SSA
MSA = 𝑎−1
1.052
MSA = 2
MSA = 0.526
SSB
MSB = 𝑏−1
41.234
MSB =
4
MSB = 10.308
SSAB
MSAB =
(𝑎−1)(𝑏−1)
2.292
MSAB = (2)(4)
MSAB = 0.286
SSE
MSE =
(𝑟−1)(𝑎𝑏−1)
6.353
MSE = (3)(3)(5)−1
MSE = 0.151
[290]
Assemble the calculated values into ANOVA table as follows
(Table 29):
Table 29. Analysis of variance for 3 varieties tested with 5 nitrogen levels in a factorial
arrangement
[291]
√𝑀𝑆𝐸
CV% = Grand mean
100
√0.151
CV% = 100
4.956
CV% = 7.8%
LSDV0.05 √2 ∗ MSE/rb
LSDV0.05 = 2.021√2 ∗ 0.151/20
LSDV0.05 = 0.06
LSDN0.05 √2 ∗ MSE/ra
LSDN0.05 = 2.021√2 ∗ 0.151/12
LSDN0.05 = 0.09
LSD(VN)0.05 √2 ∗ MSE/r
[292]
RCBD in split-plot arrangement replicated 4 times. The main plot
treatments were three irritation treatments and the sub-plot
treatments were three three nitrogen levels. The data collected
from the experiment is given below (Table 30):
Table 30. Replication-wise yield data (kg plot–1)
Step 1. Calculate the replication total (R), and the grand total (G)
by first constructing a table for replication by irrigation totals as
shown below (Table 31):
[293]
Table 31. Replication irrigation (RI) table of yield totals
[294]
G2
CF =
rab
(639)2
CF =
(4)(3)(3)
CF = 11342.25
TSS = X2 – CF
TSS = [(15.5)2 + (20.5)2 + … + (10.5)2] – 11342.25
TSS = 637.97
R2
SSR = – CF
ab
(181.3)2 +(168.1)2 +(163.9)2 +(125.7)2 (168.9)2
SSR = – 11342.25
(3)(3)
SSR = 190.08
A2
SSA = – CF
rb
(203.2)2 +(239.6)2 + (196.2)2
SSA = – 11342.25
43
SSA = 90.487
(RA)2
Main plot error (SSE1) = – CF − SSR − SSA
b
(53.8)2 +(63.6)2 +⋯+ (34.9)2
SSE1 = – 11342.25 − 190.08 − 90.487
3
SSE1 = 174.103
B2
SSB = – CF
𝑟𝑎
(189.4)2 +(213.1)2 + (236.5)2
SSB = – 11342.25
4 3
SSB = 92.435
AB2
SSAB = – CF − SSA − SSB
𝑟
(60.2)2 +(65.7)2 +⋯+ (69.8)2
SSAB = – 11342.25 − 90.487 − 92.435
4
SSAB = 9.533
Sub-plot error (SSE2) = TSS-all other sum of squares
SSE2 = 637.97-(190.08+90.487+174.103+92.435+9.533)
SSE2 = 81.332
[295]
Step 4. Calculate mean squares for each source of variation by
dividing the sum of squares by its corresponding degrees of
freedom and compute the F value of each effect that needs to be
tested, by dividing each mean square by the error mean square to
construct the ANOVA table (Table 33).
SSR
MSR = 𝑟−1
190.08
MSR = 3
MSR = 63.360
SSA
MSA = 𝑎−1
90.487
MSA = 2
MSA = 45.243
SSB
MSB = 𝑏−1
92.435
MSB = 2
MSB = 46.218
SSAB
MSAB = (𝑎−1)(𝑏−1)
9.533
MSAB = 4
MSAB = 2.383
SSE
MSE1 = (𝑟−1)(𝑎𝑏−1)
174.103
MSE1 = 6
MSE1 = 29.017
SSE
MSE2 = (𝑟−1)(𝑎𝑏−1)
81.332
MSE2 = 18
MSE2 = 4518
[296]
Table 33. Table of ANOVA
Source of
variation df SS MS F*
Replication 3 190.08 63.360
Irrigation (A) 2 90.487 45.243 1.56ns
Error (E1) 6 174.103 29.017
Nitrogen (B) 2 92.435 46.218 10.23**
AB 4 9.533 2.383
Error (E2) 18 81.332 4.518
*ns = non- siginificant; ** = hghly siginificant
√𝑀𝑆𝐸1
CV(A)% = Grand mean 100
√29.017
CV(A)% = 17.75 100
CV(A)% = 30.31%
√𝑀𝑆𝐸2
CV(B)% = Grand mean 100
√4.518
CV(B)% = 17.75 100
CV(B)% = 11.98%
[297]
First, LSD value for comparison of two main plot treatments
is calculated as:
√2 ∗ MSE1/rb
√2 ∗ MSE2/ra
[298]
Since the analysis of variance in augmented designs is based on
control/check treatments, records on these treatments across
blocks are sorted out from the above Table (Table 35) as shown in
Table 35 below.
Table 35. Performances of the check varieties as sorted out from Table 34 above
For the above three blocks (r1-r3), the adjustment factors are
calculated as follows:
[299]
rj = 1/c (Bj-M)
r1 = 1/3 (238-249) = -3.67
r2 = 1/3 (241-249) = -2.67
r3 = 1/3 (268-249) = 6.33
Note that the sum of r1, r2 and r3 should be zero.
Once the adjustment factors are generated for each block, then
adjustments are made on records from the un-replicated new test
entries as: adjusted record is equal to unadjusted record minus the
adjustment factor of that particular block (Table 36).
Table 37. Adjusted and unadjusted records from the test entries
Source of variation df SS MS
Block 2 182.00
Checks 2 12.67
Error 4 23.33 5.83
Total 8 218
LSD0.05 = 8.95
[301]
Example 7. The incomplete block designs (ICBD)
Manually processing data from the incomplete block designs
(ICBD) is a little bit difficult and easily liable to mistakes unless
otherwise computer packages are used. However, just to
demonstrate the most important steps in analysis of incomplete
block design, assume that an experiment involving 9 rice varieties
was conducted in a 3 3 balanced lattice design replicated 4
times, with 3 incomlete blocks within replication and each block
with 3 plots (Table 39).
Table 39. The layout and grain yields of the rice varieties with
block total (B), replication total (R), and grand total (G).
[302]
Replication I Replication III
Replication II Replication IV
[303]
Before calculating the sum of squares, take the following actions
at a preliminary stage.
Step 1. Calculate the block totals (B), replication totals (R), and
grand totals (G) (Table 40).
Step 2. For each treatment, compute the sum of block totals over
all blocks in which the particular treatment appears. Denote this
value by Bt and also compute treatment totals (T). Check that Bt
= kG, where k is the block size (Table 40).
Step 3. For each treatment, compute W = kT-(k+1)Bt+G, check
that W = 0.
Table 40. Computations of the treatment totals (T), the sum of block totals over all blocks in which
the particular treatment appears (Bt) and W.
[304]
Step 4. Compute the sum of squares and coonstruct the ANOVA
Table (Table 41).
𝐺2
CF = (𝑘 2 )(𝑘+1)
(169.80)2
CF = (9)(4)
(639)2
CF = 36
CF = 800.89
TSS = X2 – CF
TSS = [(6.31)2 + (5.22)2 + … + (5.50)2] – 800.89
TSS = 19.7838
R2
SSR = – CF
𝑘2
(45.97)2 +⋯+(42.84)2
SSR = – 800.89
9
SSR = 803.1550– 800.89
SSR = 2.2650
T2
SST = – CF
(𝑘+1)
(16.30)2 +⋯+(21.84)2
SST (unadjusted) = – 800.89
4
SST (unadjusted) = 815.6842– 800.89
SST (unadjusted) = 14.7942
W2
SSB (adjusted) = (𝑘 3 )(𝑘+1)
26.6022
SSB (adjusted) = 108
SSB (adjusted) = 0.2463
SSE (interblock) = TSS-SSR-SST(unadjusted)-SSB(adjusted)
SSE (interblock) = 19.7838-2.2650-14.7942-0.2463
SSE (interblock) = 2.4783
[305]
Table 41. ANOVA for a lattice design.
Source of variation df SS MS F
Replication (R) k=3 2.2650 -
Block (adjusted) (B) k2 -1 = 8 0.2463 0.0308
Treatment (unadjusted) (T) k2 -1 = 8 14.7942 1.8493 11.939
Intrablock error (E) (k-1) (k2 -1) = 16 2.4783 0.1549
LSD0.05 √2 ∗ MSE/r
LSD0.05 = 2.120√2 ∗ 0.1549/4
LSD0.05 = 0.59
[306]
15. Interpreting analytical results
Once data analysis is done, a proper interpretation of the results
should be made to acquire useful information for making
informed decisions. Data interpretation involves analyzing the
data first, taking the results of the data analysis, reviewing the
result through some predefined processes and making inferences
of the broader implication of the findings, and using them to
arrive at a sensible conclusion in terms of what the data are telling
including novelty and new insights provided by the information.
Interpretation of results should be compared not only against
targets set for the project but also against established standards.
The results should also be reviewed for consistency or
inconsistency of the findings with results of previous studies.
Interpretation of results may also include what key findings
would be of most interest to areas of the subject matter and what
need future attention as some studies may raise more questions
than they provide answers including unexpected results.
Generally, data interpretation may include aspects of establishing
explanatory concepts from the findings which can serve as a
guide for further researches and the effort put in place to establish
continuity in research through linking the results with previous
findings.
[308]
Therefore, plan the experiment in such a way as to have an
estimate of experimental error.
[310]
Systematic errors
While conducting an experiment, we must make sure that there
are no systematic differences between experimental units
receiving a treatment from those receiving another treatment. At
times, systematic errors may be more complicated. A constant
systematic error affects accuracy of values, but it will not
influence the correctness of measurements. At the same time, a
variable systematic error affects both accuracy and correctness of
measurements. Systematic errors occur mainly because of two
reasons, experimental unit (plot) variations and faulty techniques.
It is assumed that any difference between the values of two
experimental units (plots) is caused by the treatments alone and
nothing else. In field experiments, chances of plot-to-plot
variations due to soil heterogeneity are a major problem. Soil
heterogeneity occurs mainly because of texture, fertility gradients,
pH variations, and erosion hazards. There might also be
differences in pest and disease occurrence, bird damage, etc.
These variations can also occur when the ‘plot’ consists of
animals or even human beings. Soil heterogeneity is tackled
largely by random arrangement of plots, replications, and suitable
layouts. Faulty techniques include inaccurate scales and
measures, faulty instruments, wrong methods, or personal bias.
For example, a frequent source of systematic errors is calibration
errors with equipment and instruments. If the calibration is faulty,
the values may be too high or low. This kind of errors can be
eliminated by the skill, care, and experience of the researchers.
Researchers well versed in research methodology and
instrumentation seldom commit this kind of mistakes.
[311]
16.2. Type I Error and Type II Error
In most research studies, we draw and examine a sample hoping
that it will reveal all the facts about the population accurately.
However, because a representative sample only is studied instead
of the original population, there is every chance of committing
mistakes in the decision for rejecting or accepting the null
hypothesis. Take the example of a null hypothesis, which says:
There is no significant decrease in grain yield when irrigation is
limited to critical stages compared to irrigation throughout the
growth period.
After analysing the data, you set an arbitrary value for the
rejection or acceptance of a null hypothesis based on some level
of significance; p is the probability that a difference or an
association as large as the one observed could have occurred by
chance alone. You reject the null hypothesis, if the p value is less
than the predetermined level of statistical significance, usually
expressed as a percentage. A result is considered statistically
significant, if the p value is less than 5% (p = 0.05) and is said to
be highly significant if p is less than 1% (p = 0.01).
[312]
as that between the experimental and control groups would have
occurred from sampling error in less than 5 out of 100 items of
the experiment. Conversely, the probability that the difference in
values is due to the treatment, instead of sampling error, is 95%.
The rejection of the null hypothesis while it is true is called a type
I error. At the same time, failing to reject the null hypothesis
while it is false is called a type II error. The chance of committing
a type I error, rejecting the null hypothesis when it is actually
true, is represented by α, and the chance of committing type II
error, proving an association when none exists, is generally
represented by β (Table 42).
[314]
software as a practical alternative to costly commercial packages.
Most free statistical software packages are easy to learn and use
by means of menu systems. A few popular packages (both priced
and free) are presented below.
SAS
SAS is an integrated system of software for solving many tasks.
The Statistical Analysis System, SAS was developed by SAS
Institute. The software can be used for data entry and
management, graphics designing, multivariate analyses, advanced
analytics, predictive analytics, business intelligence and decision
[315]
support, operations research and project management, and several
such applications.
R Software
R is a powerful, free and efficient software that is available freely
and used in different fields of research for data analysis and data
management. It is currently a free, open-source code and stable
and reliable software. Its application range from simple analysis
descriptive statistics (mean, variance, median etc.) to more
sophisticated data analysis such as genomic selection and spatial
analysis. Besides the R software has one of the best graphic-
producing packages. The other application of R is in data science
for data mining purposes from the big data and make usable for
the decision-makers. In agriculture, the application of R can go
from generating different experimental design randomization and
layout to the analysis of data based on different experimental
designs.
R software run in any operating system such as Windows, Unix
systems, and Mac that show how the software is versatile and the
code and its output can be read on different platforms. The R also
allows user to write their Package and distribute to other R users
in the world. R has an easily readable, precise, and
understandable help system that is integrated with the package or
you can access it from the internet. One of the best ways to get
help for R is R communities who provide information about R
and answer questions from different users:
[Link]
[Link]
[Link]
[316]
R connects with other languages such as Python, C++ etc.
MaxStat
MaxStat is a software package for statistical analysis specifically
designed for students and researchers who do not have much
knowledge in statistics. The MaxStat Lite version is offered free
to use for non-commercial purpose. This is useful for smaller
projects and theses. The full version, MaxStat Pro, offers analysis
of larger data sets. The Lite version features descriptive statistics,
t-tests, chi-square, ANOVA, nonparametric tests, linear
regression, correlation, and basic graphing functions. The Pro
version features advanced analyses, more types of graph, word-
processing functions, and options for formatting of results.
MaxStat supports over 100 commonly used statistical tests.
Stata
Stata is a statistical software package created in 1985 by
StataCorp for general use. It is specifically suited for researchers
working in the fields of economics, sociology, political science,
and health science. Data management, statistical analysis,
graphics, simulations, regression, and custom programming are
some of the highlights of Stata.
Microsoft Excel
Excel is a spreadsheet application available with ‘Microsoft
Office’ suite, useful for data management and analysis. With the
same basic features of all spreadsheet applications, Excel uses a
collection of cells arranged into rows and columns to organize
and manipulate data. It is useful to perform basic calculations and
statistical analysis. They can also display data as charts,
histograms, and line graphs.
[317]
CropStat
CropStat is a statistical package developed by International Rice
Research Institute (IRRI) for the management and analysis of data
from experiments. Although CropStat has been developed mainly
to cater to the needs of agricultural workers for analysing the data
from field experiments, some programmes can be used for
analysis of data from other disciplines too. Please note that the
much popular earlier version is not being used today because it
was originally written in the BASIC (Beginner’s All-purpose
Symbolic Instruction Code) language, which is not compatible
with ‘Windows’. You can download CropStat and some other
useful software from the IRRI website, [Link]
Similar to the above, you may find many freer or priced software.
R, Jamovi, JASP, PSPP are examples of open-source software,
and Minitab, Matlab, Systat, Statistix, AcaStat, Statwing,
Statistica, and XLStat are some proprietary products.
Figure 3. The guiding principle of a right angle triangle to construct an experimental field layout
The step-by-step procedure of layout:
a) Drive a wooden peg into the soil at point C;
b) Stretch a string from the peg at point C along the “b” or “l”
direction desired to be the borderline between the experiment
and the field;
c) Drive another peg at the point marked to be the end and tie the
string onto it very tightly;
[319]
d) Stretch out another string from the same peg at the origin
(point “C”) to the direction opposite to the borderline (along
the line “b” or “l” as the case may be);
e) In order to make this string form a right angle at point “C”
with the borderline, it has to pass through a definite point to
be determined using the above equation. For practical
purposes, this reference point can be determined by measuring
a distance of 4 m from “C” along the borderline (“l” for
example) and 3 m long the base, “b”; now by definition “h”
would be 5 m and mark the point of junction on the tape by
joining the “0” and 12 m (3+4+5) (Figure 4). Marking can be
done by setting a thin but straight piece of stick exactly at the
juncture;
[320]
f) Once the point of the reference is determined, adjust the
direction of the string along the base by stretching it well as
far as required so that it can only just touch the reference stick
(from the outer side of the experimental plot);
g) At the end of the required distance from the origin, drive a
peg into the soil and tie the string tightly;
h) Determine the diagonal opposite corner of the origin (point
“d”) either by directly measuring both the vertical and
horizontal sides or by the same 3, 4, and 5 principles. Drive a
peg into the soil at this point and extend the strings from the
pegs at the ends of the borderline and the base and tie both
strings tightly onto the peg;
i) Once the four corners of the experimental field are in place,
plots and blocks can be delimited using pegs according to the
plan drafted on the paper;
Blocking is done against the soil fertility gradient while the row
orientation is along the fertility gradient. Blocking is performed
such that the variation within a block is minimal and variation
between blocks is maximal as represented by different in color
intensity as shown in Figure 5 below. If the length of a plot is 4
m; width of a plot is 1.6 m (say 4 rows with 0.4 m between rows);
spacing between blocks is 2 m and spacing between plots is 0.6
m, then the layout of the experiment maybe made.
[321]
Figure 5. Field layout before treatments are assigned to plots
[322]
Then final stage of the layout would be to give consecutive plot
numbers for the ease of work, allot treatments to the plots at
random using lottery method (drawing ballot) or using the
random number table. Within each block, the treatments are
assigned at random so that a different treatment is applied to each
unit. That is, all treatments are observed within each block. The
defining feature of the randomized complete block design is that
each block sees each treatment exactly once.
Fertilizer and seed rates per plot are calculated based on the
recommendation on a hectare base.
Randomized complete block design (RCBD) is a design used
when the experimental units are not homogeneous and thus can be
allocated to groups of block such that the variation among blocks
is maximized while the variation within any particular block is
minimized.
When RCBD is employed in animal research, as the case holds
true for crop research, treatments (feed types for example) should
be compared under similar circumstances. For example, imagine
that the body weight varies among the experimental animals. If
the animals are not properly blocked in groups of similar initial
body weight, obviously, the effects of the feed types would be
“confounded” with the initial weight of the animals, i.e. the initial
weights of the animals are interfering with the conclusions about
the feed effects). As a result, if there is known variability in initial
weights of the experimental animals, it would be advisable to
block the animals thereby remove any advantage or disadvantage
of one treatment over the other because of the animal to which it
is allotted.
[323]
Individual animals may differ in many aspects for which they
must be blocked. In livestock research, animals are most often
grouped into blocks according to initial weight, body condition,
breed, sex, stage of lactation, litter size, etc. Note in this case that
block does not necessarily indicate physical grouping.
It is important that during the experiment all animals within a
block receive the same conditions in everything except
treatments. Example of a good blocking where five feed
treatments (A, B, C, D and E) have been randomized below to 4
different breeds of chicken (Figure 6).
[324]
Block 1
B C A E D
Block 2
C A D B E
Block 3
E C A D B
Block 4
A D C E B
Figure 6. Field layout after the 5 treatments are assigned to the experimental animals arranged in a randomized complete block design
[325]
SECTION V. MANAGING AGRICULTURAL
RESEARCH IN ETHIOPIA
[326]
which genotypes are made to fit the prevailing growth environment
is encouraged instead of the environment being altered to fit the
cultivars. Therefore, the genotype “fit-in” approach as an option has
been more appropriate under very marginal production conditions
where it is not feasible to develop and utilize resource-needy
technologies. Examples include failure of technology development
from among pure breeds of European livestock, particularly dairy
cows, under small-scale production because of inability of the
farmers to provide the required management level and poor
performance of the cows under the existing animal management
conditions. The genotype “fit-in” approach has also been a feasible
approach in crop technology development under abiotic stresses like
drought. In all cases, there is also a tendency to build on past
successes, as starting research works from the scratch each time
may take a longer and ultimately show lesser probability of success
to generate good results.
Research approaches in Ethiopian so far rely on conventional
methods which have tried to address the major research problems
facing farmers and pastoralists in Ethiopia. However, there have
been barriers to achieving the desired level of improvement using
the conventional approaches. Among the features of the
conventional approaches include less responsive and slow
technology generation/adaptation or product development process.
For effective utilization of the wealth of genetic resources available
in Ethiopia in research programs, however, forging the best way of
combining the conventional and cutting-edge biotechnological tools
deserve a special attention.
[327]
19.1. Working with Farmers
[329]
All operations and management, not part of treatments, maybe
left to the farmer and different farmers/replicates even at a single
site (say a village) represent potentially distinct environments.
The way farmers manage their field may induce additional
differences between plot variations within any single farmer’s
field. For example, a farmer may weed part of his/her plot on a
given day and another part a few days or a week later. Farmer-
induced within field variations would further inflate error
variance, reducing precision and accuracy of estimates of
treatment differences.
Treatment effects are measured under as many different
environments as there are farmers/replicates at that site. Assessing
differences in treatment performance across different farm to farm
conditions is often of more interest than average performance
across farmers in order to identify treatments with consistent
performance, i.e. less G E interactions. Objective and accurate
collection of relevant data on between and within field differences
in on-farm trials is the key to obtain quality results and draw
sound conclusions.
It is obvious that if a technology developed for a better
performance by researchers is unacceptable to farmers for some
reasons and is not adopted at the end of the day, all the resources
invested to the development of that technology will be wasted. It
is very important, therefore, that farmers be involved in problem
identification as well as selecting and testing processes of
technologies. Farmers may participate in different ways as
detailed below.
a) On-station trials (planned and executed entirely by
researchers with farmers’ inputs in design or in the form
[330]
of comments/feedback on its outcome or relevance) (Type
0).
b) On-farm trials (planned and executed entirely by
researchers by taking account of farmers needs and
preferences) (Type 1).
c) On-farm trials (planned mainly by researchers or jointly
by both but executed entirely by farmers) (Type 2).
d) On-farm trials (planned and executed entirely by farmers
in their own way with the researcher merely observing)
(Type 3).
The farm to farm variation in productivity is tremendous because
of the inherent farm to farm variations and owning to the ability
of farmers to employ ‘best practices’ available to them.
Therefore, technological breakthrough in attaining high
productivity is achieved not only by introducing improved
technologies but also by improving the technical efficiency of
technology and knowledge adopters. In on-farm trials, therefore,
non-treatment factors, which reflect important components of
farmers’ normal crop management practices, should be observed
and analyzed to reveal how these non-treatment factors affect
performance of treatments. Data on between-field differences
relevant at farmer level could be used as explanatory variables to
assess how inter-farmer differences in technology performance
depend on differences in field and farmers’ conditions. At a plot
level, it may also be advisable to record data on relevant farmer-
related (and other) within-field variations for use as covariates in
data analysis to improve precision and accuracy.
Site replication is required to accommodate farm to farm variation
as many fields within a village or community have their own
[331]
peculiar features including difference in management practices.
Replication within each farmer’s field may or may not be required
depending on the stage and objectives of the experiment. When
the objective of the experiment is to develop farmer-preferred
technologies under the active participation of farmers, we may
need to estimate both the intra-farm and the inter-farm variability.
In that case, both site replication and within site replication is
required not only to partition out effects of site and effects within
site but also to assess effects of treatment by site (farmer)
interactions. In such cases, use of single factor trials with
experimental designs like a randomized complete block design
(RCBD) on a homogeneous part of the field, and keeping the
number of treatments manageable within the scope of the farmer
to avoid complication, is considered advisable. When the
experiment is a factorial type, again limiting the factors and factor
levels within bounds to avoid complication is required. There
should be adequate error degrees of freedom, say 10 or more, so
that a good estimate of the error variance would be possible.
The principle of experimental design for on-farm experiments is
more or less similar with on-station experiments but more
complex designs like incomplete block designs should be
avoided. The application of other designs like the split-plot or
strip-plot arrangements may complicate better understanding and
full participation of farmers.
When the objective of the experiment is to demonstrate “finished”
technologies already tested and proven to be superior through
prior experiments at different levels, however, the “one-farmer
one-replicate approach” or site replication alone may suffice for
the purpose. In this approach, we need precession only at practical
[332]
level (not at theoretical level). However, by its nature, the
approach keeps trial size manageable and the demonstration effect
and technology application could also be maximized because of
low level of complication. It should be noted that inter-farmer
variation is likely to be higher than intra-farmer variation which
also justifies single-replicate per farm approach, unless we wish
to estimate both intra and inter farmer variability with treatment
by site (farmer) interaction effects.
The number of site replications may vary based again on the
objectives of the experiment and variability of the
recommendation domain. Experiences show that the number of
differently treated plots should be limited to say not more than 6
for agronomic studies and 20–30 for variety tests where all
treatments should occur in every field. This is believed to enable
farmers to properly understand what is being tested and easily and
correctly assess treatments using their own criteria.
In addition to the regular designs, two types of trials, i.e. the
mother and the baby trial system is frequently applied at on-farm
level. The mother trial is fully replicated (Type 1 trial) and the
nearby baby trials are un-replicated (Type 2 trials). The mother
and baby trial is becoming a popular method to evaluate new
technologies under farmers’ own conditions. The usual way is to
have one replicated researcher managing a mother trial and
numerous farmers managing un-replicated baby trials within one
village. The mother may consist of two experiments: one
conducted under farmer’s management practices and the other
conducted with research specific inputs. On the other hand, the
baby trials comprise sub-sets of the mother trial in terms of
treatment and are located on many farmers’ fields. Treatments are
[333]
evaluated under real farmers’ conditions and create opportunities
for flow of information between farmers, between farmers and
researchers about the performance and appropriateness of the
technology under farmers’ conditions. It should be noted that the
check treatments including farmer’s preferred checks are essential
in the evaluation process. The farmer’s own crop or a neighbor’s
crop grown on an adjacent or nearby field may also be used as a
reference. Unless checks are included, it is not possible to tell if a
test treatment is better or worse than the ones that are currently
under promotion. From the baby trials, only analyzable farmers’
perceptions and acceptance of technologies are collected whereas
the actual statistically analyzable yield data are collected from
mother trials, carefully managed and monitored trials where all of
the entries are compared with each other. A matrix ranking of the
performance of the treatments can be done by a group of
interested farmers. There are only a few mother trials compared to
the number of baby trials. As a minimum, three mother trials may
be required in each village and these trials may be conducted in a
minimum of four villages. The three mother trials in a village are
grown by different farmers in different fields. The mother trial
may be repeated on the research station but baby trials are not
repeated on the research station. There are many more baby trials
than mother trials and, in order to avoid confusion, it is simpler
not to have any farmer growing both a mother and a baby trial.
The major differences between the mother and the baby trials are
summarized in Table 43 below.
[334]
Table 43. Summary of differences between mother and baby trials
Parameter of
comparison Mother Baby
Objective Obtain yield data Obtain farmers’ perception data (including
qualitative evaluation)
Number of trials Just a few Many
Replication Replicated (within site) Un-replicated (within site)
Supervision By researchers By farmers
Plot size Small Large
Treatments All Partial (fraction of mother trial)
Records Yield is recorded Yield is not recorded
[335]
herd or flock demographics and productivity, the current
condition and productivity of pasture/range lands, and nutritional
and health constraints. Under situations, where nutritional
interventions are of high priority, it is worth giving attention to
the overriding factor, for example key nutritional factor or health
problem, the period/s most limiting to the animal, the class of
animal most affected (age, sex and physiological stage), the
resulting impact on herd productivity, and the cause–effect
relationships of the problem. Additionally, it is important to take a
note on assessment of the area for its suitability to on-farm
research) in terms of willingness, cooperative spirit of the farmers
and availability of facilities (feeding/drinking troughs, stores,
balances, etc.).
Unlike on-farm research on crops, on-farm research on livestock
is usually planned and managed by researchers when the
experimental animals, inputs, and services are provided by the
researcher because of the knowledge-intensive nature of the
discipline. To verify the performance of a new technology, for
instance, researcher-managed trials are usually preferred because
farmer-managed trials lack the necessary control to derive
accurate results.
19.2. Major Steps in Undertaking Agricultural Research in
Ethiopia
The Ethiopian Institute of Agricultural Research is a major body
that undertakes various agricultural research at the national level
supported by a number of prominent Centres located in various
parts of the country. In addition, the Institute coordinates
agricultural research activities that are run by Higher Learning
Institutions which have affiliations to agricultural education in the
[336]
country. Moreover, the Institute collaborates with Regional
Agricultural Research Institutes (RARIs) in the country and
engages in a number of joint research activities. The agricultural
research activities conducted by all of these entities are
coordinated under one loosely organized system known as
National Agricultural Research System (NARS).
Good agricultural research must contribute to the technology and
knowledge base of the difficult task underway to improve
livelihoods of farmers and benefit other various stakeholders,
thereby contributing to the overall development of the sector by
addressing the actual and potential agricultural problems.
Generally, good research involves a number of peculiar features
including: prioritization of the most important problems that
constrain production, productivity and product quality at farm
level, systematic planning with valid and reliable methods that
best suit the nature of a given study, built on appropriate data,
characterized by reproducibility, and replicability.
[337]
research proposal (approval from competent authorities),
conducting the research work, collecting and analysing data,
interpreting the results, preparing the research report, presenting
the results in a scientific or other relevant fora, and publishing of
the report or the research paper.
Step 1. Problem identification
A research problem to be researched may be a statement
formulated about an area of concern, a condition to be improved,
a difficulty to be eliminated, or a troubling question that exists in
scholarly literature, in theory, or in practice that points to the need
for meaningful understanding and deliberate investigations.
Selecting and properly defining a research problem is the first and
foremost step in the agricultural research process. The problem
must be properly identified and defined for well-targeted
interventions. A properly selected and prioritized research
problem will provide guidance as to the techniques to be applied
to conduct the research, the type of data to be collected, the type
of analysis to be made, and general strategies to answer the
research questions. As a prerequisite for any research, a careful
formulation of the problem is the base for working out on the
research design and other subsequent steps involved in the
conduct of the research.
However, the researchable problem should not only be identified
but also prioritized based on different criteria. Agricultural
research problems may be defined as any difficulty or gap in
knowledge, technology, etc. Bridging this gap or solving the
problem may be required by farmers, ago-industries, exporters or
any users of other agricultural products to improve productivity,
[338]
efficiency, quality, income, etc. There is no purpose in repeating
research works done previously to achieve similar the same
results. Repeating the same previously done research for the same
result is what is called “re-inventing the wheel” and will have no
benefit, other than wasting resources.
Different approaches and techniques may be used to identify
research problems. These include surveys, stakeholder platforms,
literature survey, emerging issues, government development
plans, personal observations, etc.
Results of surveys
Surveys are important because they generate useful feedback on
gaps in agricultural production and productivity. Survey results
have led to better understanding of researchable problems of
different stakeholders in the agricultural value chain not only to
develop better targeted research agenda but also to make other
important decisions. Some sources ascertain that surveys
conducted with the intention of using the results to formulate a
research proposal that is reflective of the community’s input and
priorities can foster a greater level of trust and goodwill, thereby
increasing the relevance of the proposed project.
Not only social survey, but also information assembled from
biological and physical surveys (e.g. status of biotic and abiotic
stresses in a given area) could best serve in identifying
agricultural problems and designing different research agenda
under different conditions. Such surveys also provide insights into
the kind of technologies to be developed anew. They also help as
a decision tool to make readily available research interventions to
overcome certain agricultural problems.
[339]
Stakeholder platforms
The research system in Ethiopia has evolved through different
phases in terms of stakeholder participation, each phase with its
own advantages and disadvantages. At the initial stages, there was
largely a unidirectional top-down on-station based research
approach where there was little or no as such stakeholder
participation. As time went by, however, the linkage between
research, extension and farmers improved through different
approaches like farming systems research (FSR), an approach
implemented in the mid 1980’s. Another approach was the client-
oriented research approach, introduced in the late 1990's, which
attempted to change farmers’ participation from a consultative to
collaborative one. Recently, the agro-ecology based research
approach, which has enabled better targeting of the ultimate
production environments and recommendation domains, has been
practiced. The periodical improvement of the linkage among the
major stakeholders has obviously enabled agricultural researchers
to better understand the circumstances, needs, priorities, and
constraints of farmers, thereby enhancing research relevance.
The Ethiopian Institute of Agricultural Research has had a good
culture of rigorous internal evaluation of the research agenda at
different levels (peer-review, process or department level review,
center review, project or program review and corporate review).
This review stages have been helpful not only for technical
scrutiny but also for aligning the research projects with the
national development goals. Other criteria for accepting research
proposals include priorities, originality, gender sensitivity, and
resource requirement as well as for avoiding duplication of efforts
in relation to expected successes in terms of addressing
developmental questions.
[340]
Active engagement of the right stakeholders in problem
identification is critically important to comprehensively address
the whole value chains of a given commodity based on multi-
stakeholder needs and priorities. The interventions thereof could
also be adoptable when voices of multi-stakeholders are heard
and considered in this process. The engagement of
stakeholders not only in problem identification but also in search
of researchable solutions is essential as it provides ideas from
varying backgrounds with different viewpoints. In Ethiopia,
stakeholder platforms, particularly the Agricultural Research and
Development Partners Linkage Advisory Council (ARDPLACs at
Woreda, Zonal, Regional and National levels); Farmers Research
and Extension Groups (FRGs) and field days, for instance, have
served as a means of identifying researchable problems to a
certain extent.
Institutional research strategies
Any researchable problem to be identified must form part of the
research strategy documents developed by the Ethiopian Institute
of Agricultural Research, which, in turn, is aligned with the
national and sectoral economic drives of Ethiopia. In other words,
the problem to be identified should be sufficiently justified and to
be worth doing at least at the institutional level, as a priority by
any of the project beneficiaries including farmers, agro-industries,
exporters, and any end-product users.
Topics to be proposed need to be on problems of national
importance which is judged not only in terms of contribution to
food and nutrition security, export promotion/import substitution,
availing agro-industrial raw materials and job creation but also in
terms of the probability of success, scalability, gender sensitivity
[341]
and potential impact on the national development while
enhancing the natural resource base in the face of climate change.
Reading materials
During project plan preparation, a thorough review of pertinent
literature, i.e. the process of collecting, selecting and reading
reference materials (books, journals, reports, abstracts and others)
from previous studies, is of great help in selecting and defining a
research problem. Source materials reveal what information,
knowledge, and technology are ideally needed in the subject area;
what is available from previous research; what are the areas
understudied or gaps remaining; and knowledge and technology
to be generated anew as a rationale for further research.
Sometimes lack of consistency in results reported across prior
studies may justify further research to explore the basis of the
inconsistency. The research justification or the statement of the
'problem', which involves providing the reader with critical
background or contextual information that introduces the topic
area, must be presented in clear terms.
Reading pertinent literature helps not only in identifying a
researchable problem but also in ensuring that the identified
researchable problem is unique and prevents duplication of prior
works by others. A review of literature also provides theoretical
and methodological basis for the study; reveals evidences that the
problem really exists and is worth investigating; enables to
conceptualize a research problem, identifies and defines study
variables; describes the severity of the problem, and provides
lessons for data analysis and interpretation.
[342]
Emerging issues
Research projects need to be initiated to develop interventions
against compelling situations like emergence of biotic and abiotic
stresses. A good example in point for biotic stresses is the
emergence of a long list of crop pests including diseases, insects,
weeds and vertebrate pests. Likewise, a good example of abiotic
stresses is the recurrent drought which has been causing high
losses in crop and animal production in Ethiopia, which has been
exacerbated by climate change. The expansion of soil physical
and chemical degradation of soil erosion, acidity, salinity, etc. and
prevalence of climate change make another example of newly
emerging abiotic stresses.
While the familiar biotic and abiotic stresses themselves are
sufficient to complicate the task of agricultural production, the
emergence of new threats has worsened the situation and deserve
special research focus and priority. A number of such problems
are also evident in the livestock sub-sector. Project proposals that
are technically sound and have a strong policy-based thrust in
solving the emerged issues should be selected, presented, and
implemented.
Personal observations
Research problems can be identified by expert initiations
emanating from their own observations and previous experiences
based on real life experiences with farmers, agro-industries,
exporters and consumers. However, care must be taken that there
is no point in choosing a research topic of no interest to anyone
and, therefore, the principal investigator should prove the
significance of any research topic in terms of generating new
information, knowledge and technology. Whether the
[343]
information, knowledge, and technology generated thereof could
benefit the beneficiaries should be ensured through dialogue and
official endorsement in the project proposal review process.
When project proposals are based on personal observations, the
researchers need to somehow ensure that beneficiaries are
interested by involving them in the review process and
strengthening the proposal in the direction of their interests. Or
else, the requests for doing research on a topic should come from
the beneficiaries or development partners themselves.
Step 2. Prioritizing research problems
A priority is a statement about the importance or merit of selected
issues, actions, or circumstances. In some cases, you may have a
number of research problems. To state that “all priorities of are
equal” implies that you do not have a list of priorities at all.
Priorities have a rank-ordering character about them and you need
to address the top priority first, the second one next, and so on.
Thus, prioritization of research problems is a process of placing a
number of agricultural production problems in a rank order on their
importance or perceived significance as barriers to achieving the
desired level of productivity. Research problem prioritization is a
pressing issue because of resource scarcity and resource allocation
since addressing each and every problem is not affordable. The
research problems selected for the study must be prioritized based
on certain criteria including urgency of solving the problem,
comparative advantages of working over other similar projects and
even in terms of availability of the right staff with the right
experience and qualifications.
[344]
First and for most, the topic of research selected for proposal
writing should be within the scope of one or more of the national
development priority areas including food and nutrition security,
supplying raw materials for agro-industries, export promotion,
natural resource conservation, and job creation.
The probability of success needs to be justified as no research
project can be pursued with no probability of success. For a
research project to be accepted, not only should the project be
successful in terms of achieving its objectives and the likely
impacts, but also its level of risk of failure should be low. It is
also necessary to present convincing evidence that the risks of
investing in a project (potential negative consequences) are
smaller than the risks that will continue to occur in the absence of
solutions to the problems to be researched. Likewise, the ability
of the research organization (infrastructure, facility, and financial
capacities) hosting the project and its human power
(qualifications, training, and experience) to resolve the problems
needs to be clearly shown along with the affordability of the costs
involved and the time required to solve the problem. Interests of
research partners to cooperate may ensure the practicability of the
study.
From the scientific point of view, a subject which is overdone
should not be normally chosen to avoid investing to elicit
information, knowledge, and technologies that are already
available unless justified in terms of comparative advantages or
other vital aspects of the need for the research. A problem
preceded by a brief preliminary feasibility study may be better
justified for further in-depth study.
[345]
Step 3. Writing research proposal
A research plan or a research proposal may be defined as a
document that is typically written by a scientist which describes
an idea for investigating a certain topic, i.e. it is a document
summarizing prior literature and describing procedures to be used
for answering research questions. A research proposal is defined
also as a plan for a piece of scientific work written for obtaining
the means to conduct the proposed work. It is a mini-research
paper that has not reached the stage of actual implementation. A
scientific research proposal has two primary aim.
The first aim of a research proposal is to inform about the planned
work, its expected results, and the required efforts as well as to
convince decision makers that the work deserves to be pursued.
The second aim of a research proposal is convincing decision
makers that the work deserves to be pursued. These functions
determine the types of items that the proposal should contain, i.e.
description to inform and arguments to convince.
There are two types of research proposal. These are scientific
research proposal and development research proposal. Both are
more or less the same. A scientific research proposal is aimed
basically at the investigation of a situation or a phenomenon
through research and coming up with results that can be used for
addressing a given problem or problems. However, a
development research proposal is aimed at getting larger grants
for doing research-based activities to solve a societal problem of a
mega proportion and is somewhat more detailed in terms of the
methodology, input, expected output, monitoring and evaluation,
etc.
[346]
The current model of project planning in the Ethiopian
Agricultural Research Institute starts with formation of a team of
five to seven senior researchers from multidisciplinary
background in each program by the respective directors of the
research process. The team is tasked with designing new research
project proposals in different thematic areas every three years.
Team members constitute well experienced researchers who have
rich complementary competencies in different aspects of national
research and development.
Even if the procedure basically follows a top-down approach of
project proposal development, most of the implementing
researchers are represented by senior researchers as team
members and most of the researchers also contribute to
enhancement of the proposals at research program review levels.
This approach of project plan preparation is often criticized for
limited participation, less learning opportunity and limited
experience sharing and reduced scientific interaction particularly
for junior researchers.
The project proposals prepared in different thematic areas by
different research programs every three years is subjected to the
institutional review procedure and officially endorsed for
implementation. Each of the project proposals is then further
disaggregated to component activities which are presented to
review fora every year with all the necessary adjustments and
modifications based on contemporary situations. Inviting experts
(from inside and outside EIAR) from different background as
resource persons on the review fora has also become a norm.
A research proposal has outlines of the process from beginning to
end with the major components which include: Title, background
[347]
and rationale, objectives, research methods (detailed design,
collection and analysis of the data, interpretation and synthesis of
the results), work plan, financial requirement, project output,
logical framework matrix and beneficiaries and impact of the
project.
A research proposal should be written accurately, briefly, and
clearly. Writing a research proposal is both science and art. A
research proposal usually contains the following major sections:
Title
The title of a proposal is a very important section. It should be
written carefully with precision and clarity. See the section of
report writing for details.
[348]
Statement of the Problem
This sub-section of deals with the main question that the proposed
work is aimed to address. By definition, a problem is a gap, a
discrepancy between the way things are and the way things
should be. It is the failure of the status quo to address the need. It
could be the cause of the discrepancy between actual and
potential yield of a crop. It could be existing conflict in research
results in the literature. It could be a neglected topic in the
literature. It could be also “real-life” problems found in the
workplace, at the home, the community, and so forth. It could be
also government concerns, or problems ear-tagged by
governments.
The researcher should not assume that everyone sees the problem
as clearly as he/she does. Therefore, he/she should argue the
problem sufficiently even if when it appears obvious. This is
because, even if the problem is obvious, reviewers want to know
how clearly the researcher can state it. In addition, the problem
should be significant i.e. not trivial or a repeat of previous work.
For simple problems that can be addressed through a quick fix,
for problems that have already been researched, there is no need
to do research. That will only waste resources.
[350]
international agencies, and non-governmental organizations
should find the results useful in planning and decision making.
Purpose Statement (Objective, Research Questions, Hypothesis)
The purpose statement describes the aim of the study. It is a
statement of the central intent and questions for a study. A
proposal developer needs to convey the purpose of the study
clearly. The objectives of a study are the goals set to be attained
through the study.
Some authors only pose the question, whereas others do all three,
offering a question, framing it into a hypothesis, and then
describing specific research objectives. Each approach has its
place, but the question is the core of it all. To eliminate
redundancy, write only research questions or hypotheses—not
both—unless the hypotheses build on the research questions.
Choose the form based on tradition, recommendations from an
adviser, or whether past research indicates a prediction about
outcomes.
Hypothesis setting
Setting a hypothesis is an important step in experimental
approach. Thus, a hypothesis is used to test whether a relationship
exists between an independent and a dependent variable. It is s a
tentative explanation for an observation, certain behaviour,
phenomenon, or event, which has occurred or will occur. The
hypothesis gives an idea about the researcher’s expectations
pertaining to the relationship between the variables in the study.
In other words, a hypothesis is a probable answer to a specific
question, which describes what a researcher expects to happen in
his/her study in definite terms. A hypothesis may be either
correct or incorrect. A hypothesis is formulated after preliminary
observations or following a thorough review of related literature,
[352]
or both, but before the execution of the study. The researcher
collects enough data that either support the hypothesis or do not
support it. If the hypothesis works, the scientist can continue
further studies.
[353]
After the variables are operationalised, the researcher proceeds to
formulate one or more hypotheses. For conducting the statistical
analysis, the negative hypothesis is formulated in case the
research (alternate) hypothesis is false. It is written as a negative
statement for testing purpose only, for example:
A hypothesis should not also contain words like ‘and’ and ‘or’
because these make it difficult to distinguish which parts of the
hypothesis you are testing.
[354]
You write a null hypothesis as follows:
[356]
Literature Review
In some proposal, a literature review is necessary. The literature
review may include relevant theories or conceptual frameworks
(which may shape the research purpose statement and research
questions). It starts with brief historical background. It is mainly a
summary of the critical evaluation of previously completed work
which that is relevant to the present study. However, the
Literature Review should not be a place for a data dump where
one tells everything about the field. A researcher should be
selective. The literature review expands upon that knowledge and
provide the reader with a deeper understanding of the problem
area, prior research that has been conducted, and provides a basis
for a sound research methodology upon which to investigate the
problem, ideas to fill a research gap, the knowledge that the
researcher is an expert in the field.
In general, in the Literature Review, the following should be
noted: What's been done in this topic area to date? What are the
significant discoveries, key concepts, arguments, and/or theories
that scholars have put forward? Which are the important works?
On which particular areas of the topic has previous research
concentrated? Have there been developments over time? What
methodologies have been used? What prior qualitative studies
have contributed to our understanding of the topic? If no such
studies exist, it is important to point their absence. What will your
research add to prior quantitative studies? Are there any gaps in
the research? Are there areas that have not been looked at closely
yet, but which should be? Are there new ways of looking at the
topic? Are there improved methodologies for researching this
subject? What future directions should research in this subject
[357]
take? How will your research build on or depart from current and
previous research on the topic?
Materials and methods
The section of “Materials and Methods” focuses on the study
system, measurements, and data analysis. It is the most important
part of research since, without it, there could be no way for
researchers to agree on what is likely true result of the experiment
and what is not. Research methodology is vital because an
unreliable method produces unreliable results. The main purpose
of this section is often described to be enabling other researchers
to repeat the research. However, in fact, few researchers are likely
to repeat a piece of research work. Therefore, the practical
purpose of this section is to enable readers and reviews assess the
credibility of the data collection and analysis procedures.
This section should be organized logically, perhaps
chronologically by including necessary information, and omitting
unnecessary information as well as avoiding details of procedure
already published (just cite the original reference). The study
period and location (climate, soil, vegetation, cropping system,
etc.) is described under this topic.
Experimental materials
This is the sub-section of the Materials and Methods under which
the important study materials (study species, cell cultures, etc.)
are described. This section includes also population, sample, and
participants, data collection instruments, variables, etc.
For laboratory biological studies, complete taxonomic
information about the organisms is given under this sub-section:
genus and specific epithet as well as subspecies, strains, and so
[358]
on, if necessary. It is important to specify how the organism was
obtained. The composition, source, and quantities of chemical
substances, growth media, test solutions, and so on is also
described under this sub-topic. It is important to give crucial
details on such factors such as temperature conditions, pH,
photoperiod, duration of observation periods, sampling dates, and
criteria used to make for field studies, specify where and when the
work was carried out. Describe features of the study site relevant
to your research and include maps, drawings, or photographs
where necessary. If published information already exists on the
area, cite sources.
Treatments and experimental design
It is important to describe the treatment and how the experiment
will be laid out (design). Thus, the experimental subjects,
treatments, measurements, and statistical models, and design of
the planned experiment (randomization, replication, and blocking
structure) should be described here.
For surveys, the sampling procedures and observational methods
are described here, including sampling protocol of the surveys.
Methods of data collection and analysis are also described.
Experimental procedure
Under this sub-heading, the researcher should provide
information on how he/she will conduct the different activities of
the research and collect the data.
Statistical analysis
Under this sub-heading, the method of statistical analysis should
be described
[359]
The materials and methods section is usually written in the future
tenses.
Expected outcomes
Under this section, outcomes, which are the benefits, changes, or
effects that occur to the target population due to the research are
described. In other words, they are the desired changes in
peoples’ knowledge, skills, attitudes, or behaviours. Outcome
statements answer the question ‘‘so what?’’.
The main output of the proposed project, beyond publications,
should be described in terms of societal benefits and livelihood
impacts, which will be expected from the results of the
experiment. Many direct beneficiaries like farmers, industries,
exporters and indirect beneficiaries like consumers who will be
benefitted from purchase of the produce at a cheaper price may be
mentioned. Likewise, direct beneficiaries of a project to develop
drought-resistant varieties any crop may be farmers in dry areas
and other people who indirectly benefit from these new varieties
may include seed multipliers who can sell more seed to farmers.
The output could also be described in terms of deliverables like a
workshop, number of reports and trainees, a crop variety or
animal breed. For continuous projects like crop varietal
development or animal breeding, intermediate outputs may also
be presented as project milestones.
Work plan
It is important to develop a timetable (usually in table form or
flowchart), indicating the sequence of research phases and the
time that the researcher will probably need for each phase (Table
44).
[360]
Table 44. Work plan for a research undertaking
Budget
The budget should contain a detailed item-wise breakdown of the
funds requested for, along with a justification for each item (Table
45). The budget should be realistic, detailed, and accurate, listing
personnel costs, equipment, materials and supplies, travel,
workshops, publication, and any other significant expenses. Also
include the costs of preparing research reports and publishing
articles that will emerge from the research activities. Do not
include large amounts for contingencies or other vague purposes.
Exaggerated budget undermines funder confidence. On the other
hand, too little budget endangers execution of the project.
Therefore, each cost item should be justified.
[361]
Table 45. Budget arranged a quarterly basis for a research undertaking
Activities Unit Quantity per period Cost per unit (Birr) Cost per period (Birr)
Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
[362]
References
A researcher needs to navigate the works of other authors to
extract information. This is because citations/ the reference
section of a proposal are very important for showing your depth
of research and field work; this section also shows your
exceptional effort that you put in developing a research proposal;
it also shows that you want to give credit to your fellow authors
and researchers for how their work helped you; it also provides
proof of your arguments in the research work; it also helps avoid
any kind of plagiarism. Therefore, citing the reference work has
to be done in a proper way. Improper or inadequate citations can
make your work plagiarized and blame you of copying, even
stealing others’ contents. Be consistent in using the four reference
systems, i.e., APA (American Psychological Association) style,
Vancouver referencing style, Harvard style, and Numbering
system.
[365]
development of a LFM. When completed, the LFM provides a
summary of the project design. Along the project cycle
management, the log frame approach is used for the following
key stages (Table 46).
Table 46. Key stages of project cycle management and focus
No Stage Focus
1 Programing/planning • The situation at the national and sector level is analysed
to identify problems, constraints and opportunities which
a national project would address.
• Involves a review of socio-economic indicators of national
priorities with stakeholder and problem analyses.
• Represents the entire foundation of a research project or
program to be developed.
2 Identification • It is a stage at which the initial project proposal is
conceived and formulated.
• At this stage, it is worth checking whether the project
concept is relevant to priority local needs and consistent
with national policy priority.
3 Formulation • The main justification for the project, the description of
potential target groups and assumptions are more
important; key aspects of which include: situation
analysis/key assessments, project description and
management arrangement, and feasibility and
sustainability.
4 Implementation • Serves as basis for detailed operational planning.
including • The indicators and means of verification provide
monitoring and framework for a more detailed M&E plan for project
reporting management.
• The assumption provide basis for an operational risk
management plan.
• The results, indicators and means of verification
(activities, resources and costs) provide the framework
for preparing project progress reports.
5 Evaluation • Were the planned activities achieved? Will they be
sustained and what lessons have been learned?
[366]
The logical framework matrix
The logical framework matrix usually consists of four columns
and four rows (Table 47). The rows represent vertical logic while
the columns represent the horizontal logic. The key idea is to
show the interconnectivity, interdependence or the cause and
effect relationship between subsequent rows. On the vertical side,
if we begin from the lower level, i.e. activity leads to output,
output leads to purpose and purpose leads to goal and goal leads
to super goal. Any lower level serves as basis for the next stage
following a clear and logical pattern. Likewise, to ensure
attainment of the set targets, objectively verifiable indicators,
means of verification and important assumptions are articulated to
represent the horizontal logic for a particular issue in the vertical
logic. There is very strong interdependence/interconnectivity of
the focus areas in the horizontal logic as well.
The vertical logic of a logical framework consists of key
component including goal, purpose, output and activities. In some
cases, the fifth component above goal is put as super goal. Super
goal represents combined effect of several macro level goals,
including attainment of economic and social growth with
environmental sustenance as the basis for growth and
transformation in Ethiopia.
[367]
Table 47. The logical framework matrix
[368]
Thus growth and transformation can be taken as super goal while
attainment of food and nutritional security is a goal for the
agricultural sector. Arranged in cause-effect relationship, the
vertical logic consists of goal, purpose, outputs and activities.
The project purpose refers to the effect or change that the project
is expected to achieve and it describes, in verifiable and
measurable terms, the desired impact of the project once it is
completed. The operative word for a purpose is to “achieve”.
Generally, goal dictates the purpose while the purpose forms the
basis for objectives.
The objective of the project forms the basis for the activities and
it has to be (S-I-M-P-L-E or S-M-A-R-T), i.e. S= Specific, I=
Immediate, M=Measurable, P= Practical (real solution to a real
problem), L= Logical (systematic contribution to achieving the
project success), and E= Evaluate (how much has to occur for the
project to be effective). This implies that indicators need to be
specific, quantifiable (measurable both quantitatively and
qualitatively) and they must be attainable at reasonable cost using
appropriate data collection method, relevant to the management
information needs of the people who will use the data.
Additionally, an indicator needs to be collected and reported at
the right time to influence many management decisions. Example
of logical framework matrix is given Table 45. Suppose there is
an interest to develop comprehensive project for enhancing maize
production in the highlands of Ethiopia with key components of
breeding and genetics, agronomy, natural resource management
and capacity building, the example given in Table 48 is a typical
log frame matrix for the breeding component.
[369]
Table 48. Example of log frame matrix for enhancing maize production in the highlands of Ethiopia (Breeding component)
Intermediate goal Farmers adopt high land Number of farmers and land Base line data before and No major and un-expected changes
maize technology used for high land maize after intervention in natural environment
production (Climate, pests and disease)
Purpose EIAR develop and Certified seed with an on-farm Baseline survey and project [Link] gives sufficient
disseminate location yield potential yield of 6 ton/ha mid-term report priority and support to high land
specific high land maize and desirable characteristics maize research
technology availed to 5% farmers in the pilot [Link] national research systems
learning district by 2027 and program put in place
3. EIAR’s training and technical
support program are effective
[370]
Output [Link] maize 1. Farmers have access to at 1.1. Variety release [Link] give sufficient priority
cultivars least one location specific document or registry and support to high land maize
[Link] crop improved high land maize variety 1.2. Results of location [Link] national research system
management and by 2027 specific on-farm trial [Link]’s training and technical support
cropping systems 2. Farmers have access to at 2. Location specific high land programs are effective
[Link] land least one location specific crop maize production package
management practices management best bet practice [Link] and
by 2027 implementation manual of
3. Farmers have access to at sustainable land
least one location specific management practices
sustainable land management
practice
Activity [Link] maize cultivar 1. Five collaborating centres [Link] release [Link] of seed company which
development develop and release at least 1 document/registry can avail certified seed to farmers
1.1. Obtain planting improved variety each by 2025. [Link] of on-farm trial [Link] weather
materials [Link] the end of 2027 a minimum 3. Report of field days [Link] and institutional stability
1.2. Plant test plots of 5% farmers in the pilot 4. Base line survey 4. Adequate budget
1.3. Collect field data learning district adopt improved 5. Project final report
1.3. Harvest and measure variety 6. Project impact study
yield 3. Use of Improved variety of report
1.4. Analyze and report highland maize up-scaled in 5 7. CSA report
results districts around the pilot learning
districts by the end of 2030
[371]
20. Proposal Review Process
Project proposals are evaluated at two levels in the National
Agricultural Research System (NARS). The first level is the peer
review processes where scientists working in the subject area are
assigned to review the scientific merits and technical soundness
of the research proposals, thereby providing constructive criticism
to improve the proposed research project. The purpose of the peer
review process is to make evidence-based decision in accepting
only proposals designed with valid procedures, credible, and
ensure that scarce resources are allocated to those projects with
the greatest chance of success. Peer review processes may also
ascertain that the objectives are adequate, clear, and attainable;
the methods are sound and the schedule workable; the proposed
study is within the scope of available researchers and support
staff; if the proposal duplicates areas where information is already
available; and if the project is fundable. If several proposals are
presented, there may be a need to select the ones with the highest
comparative priority for funding. Proposals recommended by peer
reviewers for further consideration are promoted to the next stage
of review fora.
The second level is to organize review fora at different levels.
The purpose at this level is to consider a number of focal areas
including alignment with the national development goals
(contribution to food and nutrition security, export earning, agro-
industrial raw material, job creation and natural resource use
sustainability), technical soundness (quality of the science and the
strength of the methodology), relevance of the proposed study
(value of the research in terms of solving the societal problem),
scalability and potential impact, probability of success, etc.
[372]
Multidisciplinary scientists from various institutions as resource
persons and different stakeholders from the beneficiary
organization are invited to contribute ideas from their own
perspective.
In the Ethiopian Institute of Agricultural Research, proposals are
annually evaluated at different stages including center based case
team, center based process, national program level, center level,
zonal and regional ADPLAC level, national case team level, and
corporate level. The proposal may be readily approved or
approved subject to some changes or may be completely rejected
with reasons for the rejection clearly spelled out at any one of the
stages.
When this step is completed effectively, then approval of the
research proposal is sought. This step is important because
without procuring funds, no research can be conducted. A
research proposal is approved based on the merit of the proposal
to solve the problem. When a research proposal is approved, the
researcher proceeds with conducting the research using
appropriate research methods.
[373]
SECTION VI. REPORTING
RESEARCH RESULTS
21. Writing Research Reports
A research report is a document that describes what the researcher
has done, why he/she has done it, and the results obtained. Unlike
a research proposal, which is written before beginning the
research work, research reports are written after the reach work
has been completed.
Research reports constitute sections such as executive
summary/abstract, introduction/background, literature review,
research questions (hypothesis), objective, methodology
(materials and methods), findings, analysis, results, conclusion,
recommendations, and references.
Therefore, scientific papers that report experimental work are
often structured chronologically in five sections: title,
abstract/summary, introduction, materials and methods, results,
discussion, conclusion and references as detailed below.
Title
The first and important section of a research report is the title.
The title of a research report is the first section that informs the
reader about the subject of the report. Therefore, it should be not
only brief, concise, and understandable but also informative in
terms of describing the content and scope of the report. A
research report is written for a number of reasons including
[374]
sharing of original research work with fellow scientists, building
on current scientific knowledge, to get the credit for the discovery
or academic reputation to collaborate with others, to obtain
promotions and to fulfill requirements of donors. Research
communication documents may be research journals, research
reviews, conference proceedings, book chapters, annual reports,
posters, etc. However, it is advisable to focus on research journals
as journals are more advanced and skills acquired on writing
journal articles would obviously help to write for all other
research communications.
Although it is usually coined at the end of writing the research
report, the title is a very important section of the whole document.
The title of a research report should be clear and brief. It should
not be no more than 10 to 15 words (60–65 characters) and should
include the keywords to reference the classification of the
research subject. A title should contain no acronyms,
abbreviations, jargons, and formulas. Common names instead of
the Latin names of plants (and other living organisms) should be
used, especially for organisms whose common names are
familiar, well established. However, it is necessary to include
precise taxonomic information in the text of the paper.
The title must not contain abstract words such as that end in -tion,
cy, …ory, ment, etc.
It is rather important to use action words or infinitive+ ing forms
of a verb.
For example:
Incorrect: Development of new strains of bacteria under overnight
incubation in an agar medium
[375]
Correct: Developing new strains of bacteria by incubating
overnight in an agar medium
The other important aspect of the title is avoiding noun strings or
noun clusters (“noun trains”). It is better to use action verbs for
improved clarity. For example, instead of writing: “Carbon
sequestration determination of ecosystem services”. It is correct
to write: “Determining carbon sequestration of ecosystem
services”. One more example:
“Vegetable Produce Market Influence Factors in the Regions
Surrounding Addis Ababa”. “It is correct to rather re-write this
title as “Factors influencing Marketing of Vegetable Produce in
the regions Surrounding Addis Ababa”. However, it is okay to use
two noun strings in a title. For example: “Effect of nitrogen
application on barley yield”. However, using three or more than
three noun strings in a title is not acceptable. For example,
“Optimum nitrogen fertilizer rate determination for enhancing the
yield of ginger”. Instead, write this title as “Determining optimum
rates of nitrogen for enhancing the yield of ginger”.
In addition, the title should not contain low-impact or wastewords
such as: ‘‘Some notes on’’, ‘‘Observations on’’, ‘‘Investigations
on…’’, ‘‘Study of …’’, “Survey of…”, “Assessment of…”,
“Aspects of…”, "Comments on…”, "Inquiry Into…”, ‘'Analysis
of…”, “Development of.” For example, instead of writing a tile as
“Assessment of productivity of maize in western Ethiopia”,
simply, write “Productivity of maize in western Ethiopia. Instead
of writing “Survey of irrigation practices of farmers for potato
production in the eastern highlands of Ethiopia”, write “Irrigation
practices of farmers for potato production in the eastern highlands
of Ethiopia”.
Capitalizing a title
[376]
There are two ways to capitalize a title of a research report
correctly. These are “title case” and “sentence case”. In the “title
case”, a researcher should capitalize all major words, which are
all words except articles (a, an, the), prepositions
(e.g., on, in, of, at), and coordinating conjunctions (and, or, but,
and nor; also for, yet, and so when used as conjunctions).
Example: Effect of Fertilizer Application on the Yield of Selected
Barley Varieties in Central Ethiopia.
In the “sentence style”, a researcher should capitalize the first
letter of the first word of the title of his/her research report, and
then have all the other words in lower case. However, if the word
is a proper noun wherever it appears in the title, it should have an
initial capital letter. Example: Effect of fertilizer application on
the yield of selected barley varieties in central Ethiopia. However,
some journals and other publishing organizations may have their
own rule that prescribes writing all words of titles in capital
letters. In such cases authors must abide by the rules prescribed.
Types of title
There are four types of title. These include nominal (descriptive
or neutral title) title, e.g. “Effect of phosphorus application on
yield and yield components of teff in Central Highlands of
Ethiopia”; Compound (hanging) title, e.g. “Soil Fertility status in
smallholder farming system: a case study in Eastern Ethiopia”,
and question title, e.g., “Does balanced application of nitrogen,
phosphorus, and potassium risk the quality of malt barley?”;
declarative title.
In the declarative title, the main finding of the study itself is
described; it is believed to reduce the curiosity of the reader.
Declarative titles generally use past tense when describing the
results of a single investigation (‘Feeding cows on leaves of
[377]
legume trees increased protein content by 50%’) and present tense
when stating a universally accepted finding (‘Feeding cows on
leaves of legume trees increases protein content by 50%’).
Abstract
Abstract is a short form of a research report designed to give the
reader a complete, yet concise, understanding of a research
finding. Abstract is a mini-version of the research report (usually
a single paragraph) in that it is self-contained and concise,
explaining the whole work as briefly and clearly as possible. An
effective abstract will contain several key features including
problem statement, methods/procedure/approach, principal
results, and conclusions/implications without abbreviations (with
concise sentences using active voice).
The fact that most readers look at the abstract part (and only this
part) of a report makes it the most important section. Obviously,
the abstract must always be written last after the other sections
because it should be a stand-alone piece representing the whole
report with a clear message.
Generally, there are three different types of abstracts. These
include descriptive, informative and structured abstracts. First,
descriptive abstracts are usually used in the social sciences and
humanities, do not give specific information about methods and
results but may cover background, purpose, focus and an over
view of content. Second, informative abstracts are commonly
used in the sciences and present information on the background,
aim, methods, results, and conclusions. Third, structured abstracts
are essentially informative abstracts divided into a series of
headings (e.g., introduction, materials and methods, results and
discussion, and conclusion).
[378]
Keywords
Beneath the abstract, a limited number of keywords (mostly a
maximum of seven, but sometimes five to six) need to be listed as
a requirement by scientific or research journals. Keywords are
words that capture the essence of the paper, make the paper
searchable and ensure that the researcher gets more readers and
citations. This is because most electronic search engines,
databases, or journal websites will use these keywords to decide
whether and when to display your paper to interested readers.
Therefore, author(s) should include the most relevant keywords
that will help other authors find their paper – words help the
reader retrieve the article, words and phrases that suggest what
the topic is about, words and phrases that are closely related to the
topic, etc.
Keywords may include (when applicable) species, treatments and
the major response criteria. When listing keywords, words
appearing in the title should not be repeated as keywords because
such words are already considered keywords by search engines.
Common words such as plants, soils, potato, models, place,
people, etc., are too general to be of any value as keywords but
scientific names of organisms may help more. Thus, it is
recommended to list binomial names (scientific names of
organisms) here rather than in the title.
Introduction
Introduction is a part where you introduce the topic, describe the
background, establish research problem, specify your objective
and map out the paper. Introduction is part of the paper where you
convince the audience that your research result presented is
[379]
important, valid, and emphasis on why the study is needed or it
should set the scene of the study by presenting reasons for
conducting the research. It should clearly define the research
problem and what information, knowledge and technology are
ideally needed to overcome the problem, what is available from
previous research, and what are the areas understudied or gaps in
information, knowledge and technology gaps to be bridged as a
rationale for further research. The introductory part of a report
should refer to reliable literature as of the magnitude and causes
and consequences of the research problem, and its possible
solutions by including enough evidence to establish validity of the
expected outcome.
The scene of the study should be made clear to attract the reader's
attention in terms of what information is ideally required, what
information is already available, what information is missing,
what different opinion exist about the topic and which gaps are
going to be bridged by a particular study. Contents of an
introduction may include a brief introduction of study subjects, a
brief introduction of subject matter to be studied, the scene of the
study and its objectives.
The introduction should generally move from the broad big
picture that is well known then narrowing to the specific
knowledge gaps that are unknown and then finally end in research
questions which are important, specific and unresolved in a
“funnel-like organization”.
Materials and methods
This section explains clearly how the study was done by
chronologically describing the process undertaken to complete the
research. The materials and methods part is important in many
[380]
aspects particularly to ensure the credibility of the research,
ensure the reproducibility of the methods so that other research
may repeat the same research, and guide the readers on how the
research is conducted and organized. This section of your report
should be written in past tense as what was done in the past is
narrated following the research proposal.
The experimental materials used in the study such as subject
plants and animals (with scientific names), tools and equipment,
reagents and chemicals should be properly presented and
described in detail. It is also necessary to explain the methods or
how the experiment was conducted to ensure you meet the
research objectives. The methods constitute all the steps and
procedures followed in order to achieve the research objectives,
including the experimental design and data analysis with
reference to the original source. When well established methods
are used, the detailed description of each and every step may not
be needed at least for the sake of space economy but when new
methods that have not been cited anywhere are used, then the
details should be given.
Statistical analysis led to the valid conclusions of the data, clearly
showing the magnitudes, trends, patterns, models, and
relationships using quantitative data, should be presented in the
report as detailed in the initial proposal.
Results and discussion
The function of the results section is to objectively present key
results, without interpretation, in an orderly and logical sequence
using both text and illustrative materials like figures and tables.
The use of visual aids is believed to help the audience to better
conceptualize and understand the results. The results sections
[381]
qualitatively or quantitatively presents what was found from the
study. Results should better be presented in the same order as the
list of objectives in the introduction or they should follow orders
of headings and subheadings in the materials and methods.
Results should be stated in simple and clear language focusing on
the representative data based on statistical parameters like the
mean, standard error, standard deviation, etc. in a way that avoid
repetitiveness. Narrations should not entirely repeat the visual
aids like table and figure. Only data that related to subject of the
study as stated in the introduction should be presented and
properly referred to the visual aids in the text by number. Include
only tables (numerical values or text displayed in rows and
columns) and figures (any type of illustrations like chart, graph,
photograph, drawing maps, etc.) that are necessary, clear and
worth reproducing. Use past tense for results and present tense
when referring to visual aids.
The discussion section offers your interpretations and conclusions
about your findings. Discussion shows how do your results relate
to the objectives of the study, and how do they relate to the results
that might have been expected from background information and
motivation stated in the introduction as supported by evidence
based synthesis and analysis, evidence based evaluations,
interpretations and reasoning. The discussion should also explain
key limitations, discuss agreement or contrast with previously
published works.
Discussion, like any story, has also a beginning, middle and the
end. The beginning states answer and summarize main findings,
whereas the middle explains answer and how it fits in with
previous works and, finally, the end gives final conclusions in
[382]
terms of the significance of the study and need for follow up
endeavors.
Past tense should be used to summarize findings, with present
tense to interpret results and explain significance of the results.
The results and discussion part should be presented in the same
order as the methods. Likewise, the discussion section should be
clearly linked with the results.
In regard to the use of visual aids, tables usually show numerical
value or textual information and are almost always characterized
by a row-column structure (any type of illustration other than a
table is referred to as a figure). Tables should be numbered
sequentially and each table must be referred to in the text. Caption
title should be placed directly above the table itself and below or
next to the table number. Caption title shows what the table is
about. Note that footnotes (if any) should be placed directly
below the table to explain abbreviations, symbols, etc. Do not
forget to acknowledge the source of the table if it is not your own
original data.
A figure may be a chart, a graph, a photograph, a drawing, or any
other illustration or non-textual depiction. Capital title should be
place directly below the figure itself and below or next to the
figure number. A caption is a concise explanation of the figure;
i.e. a brief but descriptive phrase includes copyright information.
Use a capital F for Figure and sequential numbering (if you have
more than one Figure). When you use a figure that has been
adapted or copied directly from another source, you need to refer
to the original source. This reference appears as a caption
underneath the figure. Put a legend which explains the symbols
used in the figure. It should have the same kind and proportion of
[383]
lettering that appears in the rest of the figure. Place the legend
within the figure (it may already be there if you have copied the
graph from elsewhere). Ensure image clarity and label all
important parts of the figure. As a rule, number all figures with
Arabic numerals in the order in which they are first mentioned in
text, regardless of whether a more detailed discussion of the
figure occurs later in the paper.
With regards to the use of different types of figures, it is advisable
to use bar charts when discrete (not continuous) items are
compared; line graphs to show trends and relationships between
two factors; pie chart to show proportion of the whole taken by
various parts; and photographs and drawings to illustrate what is
being presented in the text.
Conclusions and recommendations
Conclusions are simply the interpretations given to the research
findings by the investigator whereas recommendations are the
follow up actions to be taken as suggested by the investigator
based on the conclusions. The conclusion section presents the
outcome of the work by interpreting the findings at a higher level
of consolidation than the discussion and by relating these findings
to the motivation stated in the introduction. Conclusions, like
discussion, restate the answer and then indicate the importance of
the study by stating implications, applications and suggested areas
of future research. Like discussion, a combination of tenses could
be used, i.e., past tense to summarize findings and present tense to
suggest the need for follow up studies.
It should be noted that good recommendations and conclusions do
not emanate from the researcher’s own opinion but they should be
based on logical analysis of the findings of the study. A good
[384]
conclusion avoids the audience from asking “so what”? It is
written focusing on the innovative findings as a home-take-away
message that the audience should retain after reading the report or
the paper.
Acknowledgements
Those who helped the author(s), granting funds, a laboratory or
institutions that supplied materials or services, and a person who,
one way or another, technically contributed in the process of
research and research publication, etc. should be acknowledged.
The writer should specifically mention the contribution(s) that
each organization or individual made to the research in the
acknowledgement.
References
The author should include a reference for all the sources of
information that are being used when writing. When you use
another person’s work in your own work, either by referring to
their ideas or by including a direct quotation, you must
acknowledge this in the text of your work. References are
important for a number of reasons including: supporting the
opinion of the author, adding credibility to the information
presented by the author, enabling the reader to trace the sources
referred, and avoiding possible accusation of plagiarism.
[385]
Thus, accurate and shorter or brief writing tends to be clear,
which readers can understand without a struggle. Therefore,
writers should write with reader orientation, not self-orientation.
This means they should write with a concern that readers can
understand their writing unambiguously.
[387]
Body: follows the introduction; discusses the controlling idea,
using facts, arguments, analysis, examples, and other information.
Conclusion: This final section summarizes the connections
between the information discussed in the body of the paragraph
and the paragraph’s controlling idea.
Another important issue is paragraph coherence. In a coherent
paragraph, each sentence relates clearly to the topic sentence or
controlling idea. If a paragraph is coherent, each sentence flows
smoothly into the next without obvious shifts or jumps. Use
transition words or phrases between sentences and between
paragraphs to maintain coherence.
Writing numbers
Spell out single-digit whole numbers (one to nine) in text except
when followed by units of measurement and except when they are
numerals of 10 and above. The same holds true when using ‘‘-
fold’’ to describe a magnitude of response, e.g. sevenfold (one
word), not 7-fold; but 19-fold (not ‘‘nineteen-fold’’). However, in
[388]
a mixed series containing some numbers more than 10 and others
less, authors should use numerals throughout: 2 goats, 5 horses,
and 25 cows. Use a word at the beginning of a sentence, not a
numeral. Thus, do not start a sentence with ‘‘50% of the
seedlings’’; Write ‘‘Fifty percent of the seedlings’’…… In
addition, use numerals when units of measurements are included:
2 g (not two g), 5 m (not five m), etc. Write 12 333, instead of
twelve thousand-three-hundred-and-thirty-three. If at the
beginning of a sentence, fractions of numbers such as one-
1 1 2
fourth(4); one-half(2); two-thirds(3), etc should be expressed in
words. When expressed with decimal points (0.25, 0.50, 0.67),
these fractions should be treated just like any other number in
tables and text. In the case of large numbers, group five or more
digits in blocks of three, divided by single spaces or by using a
comma.
Write four and less digit numbers without a space and a comma,
unless they form part of tabulation. Example, in text, four-digit
numbers (1000 to 9999) should be written without any space,
comma, or period (1267, 3492, etc.). However, in a table or
column with various values, four-or more digit numbers should be
written with a space or a comma before the last three digits.
[389]
Example, 3 000; 3 000 000; 30 000 000, etc.
Or 3,000; 3,000,000; 30,000,000, etc.
In a text, use a word to replace several zeros. Thus write 30
million instead of 30 000 000. Similarly, units should be adjusted
for numbers less than one to avoid a string of zeros after the
decimal point (25 mg instead of 0.025 g or 0.000 025 kg).
Dashes
In writing, there are three different symbol punctuation marks that
most people refer to as dashes. These are the hyphen (-), the en
dash (–), and the em dash (—).
Hyphen
The hyphen closely resembles the two other types of dashes.
However, these three punctuation marks are not used
interchangeably.
A hyphen resembles a small horizontal line (-). It is used to form
compound words.
Examples:
Use a hyphen to join two or more words together to form a
compound word. Examples, a two-week study, large-sized fruit,
Sister-in-law, left-handed, thirty-two, Editor-in-chief, eye-
opening (event, for example) or eye-opener, sub-Saharan etc and
in prefixes such as pre-Industrial era, anti-Progress, pro-Western,
etc
Use a hyphen after the unit when it is an adjective. Example, it is
a 12-month study. We had an agroforestry-based coffee
[390]
Production system. However, the system is agroforestry based (no
hyphen required here).
Hyphens are also used for writing words that state fractions of
numbers and compound numbers. Sentence examples, to bake a
cake, you need one-fifth of a tin of milk. Hyphens are also used
when writing out the numbers 21 through 99: twenty-five, forty-
seven, sixty-one, eighty-eight, fifty-two, thirty-three, one hundred
twenty-five, etc.
En dash (–)
The en dash is approximately the length of the letter n. The en
dash (–) is used to mark ranges (e.g Pages 23–29) or results are
discussed on pages 45–53; It is also used to express units in
exponential form (e.g. 50 kg ha–1) or as a minus sign 30 – 10 =
20. However, when the hyphen is used as a minus sign, there
should be space between the symbol and the numbers on both
sides. The en dash is also used with the meaning “to” in phrases
like “Addis Ababa–Adama Express Road.” Or the Addis Ababa–
[391]
Dire Dawa flight ... ... such as a Newton–Raphson algorithm ... ...
the DNA–enzyme interactions, etc.
However, most writers inappropriately us the hyphen to express
ranges, for example 56-60, or to express exponential units of
measurement such as kg ha-1 or as a minus sign as 30-20=10.
Use an en dash for such purposes. Use also an en dash to signify a
minus sign in a mathematical statement. In this case, use the en
dash (–) with a space between the en dash and each of the
numbers on both sides joined. Example, write Height = 30.7 m –
7.2 m = 23.5 m or Height = (30.7 – 7.2) m = 23.5 m.
Tus, use an en dash (–), not a hyphen (-), between two numbers in
a table or a figure, which usually indicates a range (i.e. 12–16
means 12 to 16). However, in a text, write as 12 to 16. A
negative exponential should be used instead of a slash (/) as in
a/b. Similarly, write values as 100 kg ha–1 (instead of 100 kg/ha)
or 20 ml L–1 (instead of 20 ml/L), 10 g m–2 (instead of 10 g/m2),
etc. Not that the minus negative symbol is not written as a
hyphen, but it should be en dash. While writing probability level
(P) with the ‘‘<”, “>’’, and “=” symbols, give space after those
symbols (P < 0.05 level, P > 0.05 and P = 0.05). There are some
SI units that are extensively used in science such as ‘‘y’’ or ‘‘yr’’
(for year; SI unit: ‘‘a’’ for annum), and (for ton; SI unit” t”: Mg
for megagram). It is common to use these non-SI units or the
corresponding SI units. Give equivalent SI units for traditional
non-SI units (e.g., quintal, which means 100 kg) such as kg or
ton, etc. Use parentheses
( ) as one way of referring to tables, figures and probability levels.
Example, application of the fertilizer had a significant (P < 0.05)
[392]
effect on the yield of the crop (Table 3). To avoid having round
brackets one within the other, use square bracket [ ]. The
numbers [six hundred (600) units] have been indicated in the
Table.
Em dash (—).
The longer em dash (—) is used to separate extra information or
mark a break in a sentence. The em dash is often used in places of
colon (), semi-colon (;), comma (,), and brackets. But, this use is
mostly done for stylistic purposes in literature other than
scientific literature. Examples, I have two excellent books — by
the way it was my brother who bought those books for me —
which I will read in preparation for my exams.
The en dash is sometimes also used in the same way as an em
dash; in this case, it takes a space on either side. Examples, I have
two excellent books – by the way it was my brother who bought
those books for me – which I will read in preparation for my
exams.
Both the em dash and the en dash can be inserted from symbol
menu of your personal computer. However, the hyphen can be
written directly by typing the hyphen key. It is also possible to
write the en dash by pressing the control key and then typing the
hyphen key.
[393]
SECTION VII. RESEARCH ETHICS
22. Research Ethics
The term ethics was originated from a Greek word ethos, which
means character or custom or convention, or the spirit of
community. Ethics is defined as moral principles that govern a
person’s behavior or his/her conduct of activity or it is the branch
of philosophy that deals with morality.
Research ethics is the application of moral rules and professional
codes of conduct to the collection, analysis, reporting, and
publication of information about research subjects, in particular
active acceptance of subjects' right to privacy, confidentiality, and
informed consent. In short, research ethics is doing what is
morally and legally right in research.
[394]
22.1. General ethical principles that guide research
The general ethical principles that guide research include mainly
the following:
Honesty
Honesty is being good and truthful, which included not lying,
stealing, or cheating; not hiding the truth about someone or
something, not meant to deceive someone, showing or suggesting
a good and truthful character. Therefore, researchers should be
honest in reporting data, results, methods, and procedures, and
publication status. Researchers should not fabricate, falsify, or
misrepresent data. They should not deceive colleagues, research
sponsors, or the public.
Objectivity
Objectivity is striving to avoid bias or prejudices or subjective
decisions or evaluations in experimental design, data analysis,
data interpretation, peer review, personnel decisions, grant
writing, expert testimony, and other aspects of research where
objectivity is expected or required. In this connection, researchers
should avoid or minimize bias or self-deception. They should
disclose personal or financial interests that may affect research.
Integrity
Integrity is strict adherence to a moral code reflected in
transparent honesty and complete harmony in what one thinks,
does, says, and does. (no double standard).
Researchers should keep their promise and agreements; they
should act with sincerity, strive for consistency of thought and
action.
[395]
Carefulness
Carefulness is the responsibility to avoid careless errors and
negligence, carefully and critically examining one’s own work
and the work of one’s peers. It also implies that researchers
should keep good records of research activities, such as data
collection, research design, and correspondence with agencies or
journals.
Openness
Openness in the text of research ethics is sharing data, results,
ideas, tools, resources. It is also being open to criticism and new
ideas.
Transparency
Transparency in the contact of research ethics refers to the
responsibility of disclosing methods, materials, assumptions,
analyses, and other information needed to evaluate your research.
Accountability
Accountability in research ethics refers to the responsibility for
one’s part in research and being prepared to give an account (i.e.
an explanation or justification) of what one did on a research
project and why. It is taking responsibility for one’s actions,
decisions and their consequences.
Intellectual property
Intellectual property in the context of research ethics refers to
honouring patents, copyrights, trademarks, and other forms of
intellectual property. Researchers should not use unpublished
[396]
data, methods, or results without permission. They should give
proper acknowledgement or credit for all contributions to
research. Researchers should never plagiarize.
Confidentiality
Confidentiality refers to the requirement that information supplied
to you in confidence will not be disclosed directly to third parties.
It is the responsibility of pprotecting confidential
communications, such as papers or grants submitted for
publication, personnel records, trade secrets, patient records, etc.
Anonymity
Anonymity in the context of research ethics refers to taking steps
to ensure that what participants have said cannot be traced back to
them when the final report is produced. It also refers to the
responsibility of going to categories and store the information. It
also refers to the responsibility of how you are going to make sure
that the information is not easily accessible to anyone with
unscrupulous intentions.
Informed consent
This refers to the responsibility of the researcher that he/she must
inform participants of the research in advance in such a way that
the participants understand the various issues involved and that
might affect their decision to participate in an experiment. The
researcher should get informed consent from the participants
including, but not limited to, the purpose of the research, its
duration, potential risks and potential benefits to participants as
well as the probability of such risks and benefits.
[397]
Responsible publication
This refers to publishing in order to advance research and
scholarship, not to advance just your own career. It is also
avoiding wasteful and duplicative publication such as publishing
in predatory (non-peer-reviewed) journals.
Responsible mentoring
This refers to helping to educate, mentor, and advise colleagues,
students, etc. It also includes promoting the welfare mentees
under one’s supervision and allowing them to make their own
decisions.
Social responsibility
This means that researchers should conduct research not only to
advance their own career but also for the good of society as a
whole. Therefore, researchers should promote social good and
prevent or mitigate social or environmental harms through
research, public education, and advocacy.
Non-discrimination
This refers to avoiding discrimination against colleagues or
students on the basis of sex, ethnicity, clan, race, religion,
nationality, place of origin, or other factors not related to
scientific competence and integrity.
[398]
Competence
This refers to maintaining and improving your own professional
competence and expertise through lifelong education and
learning; it is important that researchers take steps to promote
competence in science as a whole.
Legality
This refers to knowing and obeying relevant laws and institutional
and governmental policies.
Animal Care
This refers to the responsibility of showing proper respect and
caring for animals when using them in research. Researchers
should not conduct unnecessary or poorly designed animal
experiments.
[399]
Conflict of interest
This refers to the responsibility for avoiding relationships that
could reasonably impair your professional performance or could
exploit or harm others.
[400]
“predatory “or dubiously peer-reviewed journals or publishers has
also recently emerged as a research misconduct.
[401]
issues of research misconduct, authorship, plagiarism, peer
review, publication in “fake” or predatory journals, partial or
duplicate publication and self-citation, etc.
22.2.1. Irresponsible publication
Irresponsible publication refers to the practice of submitting
results of the same study to more than one journal or publishing
more or less the same material in more than one journal.
Irresponsible publication also includes what is called “redundant
publication” (also described as ‘salami publishing’), which a
situation in which the result of one study is split into several parts
and submitted to two or more journals. Irresponsible publication
also included publishing in “fake” or “predatory” journals or
publishers, which has recently emerged as research misconduct
22.2.2. Misconduct in authorship
Authorship is the process of deciding whose names should be
listed on a research paper. All of the following three criteria
should be fulfilled to qualify as an author:
[403]
22.2.4. Fabrication and falsification
Fabrication is faking up data or results and recording or reporting
them. Falsification is manipulating research material, equipment
or process or changing, omitting data such that research is not
accurately represented in research record.
22.2.5. Plagiarism
Plagiarism is an inappropriate act of claiming credit or ownership
of someone else’s ideas or unfair annexation of another’s work
and entitling it as your own. Plagiarism maybe a copypaste type,
paraphrasing type, translated plagiarism, artistic plagiarism, idea
plagiarism, style plagiarism, code plagiarism or misinformation of
references.
Several types of plagiarism are known in research. These include
the following:
[404]
Patchwork or mosaic plagiarism
Patchwork or mosaic plagiarism involves interweaving
paraphrasing of sources with some of the author’s own ideas or
arguments. Because the stolen and original material is mixed
together, it can be more difficult for a reader to recognize which
words or ideas have been copied from which sources.
Patchwork or mosaic plagiarism may also occur when an author
writer writes by fetching contents by copying from several
different sources and then modifies and stitches the relevant
contents from various documents, books, online sources, web
pages and repositories to make them fit together.
Collusion or sharing plagiarism
This kind of plagiarism involves two or more people working
together to pass off one person’s work as another’s, hence the
implication of collusion (“a secret agreement, especially for
fraudulent or treacherous purposes”). This type of plagiarism can
be common in schools or colleges, where students will share
essays or complete each other’s assignments. Even though a
person may have another’s consent to use their work, it is still
considered plagiarism because a person is trying to deceive
someone (their teacher or professor) by claiming another’s work
as one’s own.
Paid or hired plagiarism
Similar to collusion plagiarism, paid plagiarism involves paying
someone to create something and then passing it off as one’s own
work. Hired plagiarism can involve paying or hiring another
researcher or a freelance writer to complete the write up of a
research paper. Again, this type of plagiarism is becoming
[405]
common in schools or colleges where students pay money to get
cooked reports for submission as their own.
Improper citation and accidental plagiarism
Depending on the organization, poor or incorrect citations may be
treated the same as other types of plagiarism. e.g., Citing Gomez
and Gomez (1984) instead of Fisher (1890–1962) as the
originator of the ideas for ANOVA. Thus, this type of plagiarism
is more likely to be the case when it involves major errors such as
unattributed quotations.
Self-plagiarism or self-citation
Self-plagiarism is the use of one’s own previous work in another
new context without citing that it was used previously. Writing up
and submitting a manuscript for peer-review that has used the
same data or drawn the same conclusions as work that one has
already presented either in a previous publication or as a podium
or poster presentation at a conference also constitute self-
plagiarism.
Reusing the content of a literature review performed for
one dissertation or thesis directly within another dissertation or
thesis without referencing back to this is also self-plagiarism.
Readers should know that this was not the first use of the
material. Therefore, republished text work is considered as self-
plagiarism and the credit received from previous work is
considered as corrupt.
Related to self-plagiarism is self-citation. Self-citation is defined
as occurrences in which the citing and cited papers share at least
one author in common or as excessive reliance on research papers
from the same research lab or center.
[406]
Even if excessive self-citation can be considered rather unethical
and as a research misconduct, particularly unethical when
researchers cite their own paper at the expense of original
sources, a moderate amount of self-citation maybe inevitable
under certain conditions.
Sometimes self-citation maybe an indicative of a cohesive
research program in which authors refer to their previous relevant
works in order to enhance their subsequent contributions to
knowledge, particularly if one is working in a highly specialized
field where there is simply little other research effort.
To minimize or control self-citation as a research misconduct,
there is a need for confirmation when one is applying for
scientific positions, promotions or awards based on report of
“citation factor” without self-citations; report of “citation factor”
with self-citations; and ratio of the two “citation factors”.
Methods of avoiding plagiarism
There are several methods of avoiding plagiarism. These include
the following:
Direct quoting
Using a quotation-someone's exact words-can have a dramatic
and powerful effect in your paper, for you are displaying verbatim
(word for word). Special benefits of direct quoting include getting
direct support for our arguments, preserving the original expert
declaration, effective language, historical flavour, specific
example, controversial statement, material for analysis.
The following are examples of quotations done to preserve the
original expert declaration
[407]
a) Example 1: “There are two kinds of people, those who do
the work and those who take the credit. Try to be in the
first group, there is less competition there”, Ghandi.
b) Example 2: “Injustice anywhere is injustice everywhere. If
you do not speak against oppression, you will soon be the
oppressed. If you sit unconcerned while others are
trampled on, it will soon be your turn. Until everyone is
safe, no one is. Injustice against others is a warning to
you. Fight it before it knocks you down”, Martin Luther
King.
However, quoting sources should be done with prudence. It is
important that researchers avoid quoting too often because too
many quotations in a paper will push the researcher’s idea your
ideas into the background rather than supporting or
complementing the paper being written.
It is also important to avoid quoting one source too many times.
There is a rule of thumb that one source should not be quoted
more than three times per 2500 words. A four- to six-lines
quotation might be okay, but a quotation of a ten or more lines
may be boring for readers to continue reading. Too many quotes
in a scientific writing may also put the research work into the
background and may clutter the writing with quotations.
Therefore, it is not common to use quotes in writing research
reports.
Paraphrasing
Another way of avoiding plagiarism is to paraphrase the source.
A paraphrase is a restatement or rewriting of a source in order to
present the source's idea or meaning without actually quoting the
source's words. A paraphrase should convert a source's words into
[408]
about the same number of your own words. Thus, a writer should
keep the paraphrase to about the same number of words as the
original, not omitting any significant features of the source
material. In paraphrasing, it is important to preserve the author's
original meaning and avoid taking the ideas out of context. What
the author stressed as the main points of the passage should be
kept as the main points of the paraphrase. The author's
conclusions, point of view, and even attitude should be preserved.
However, technical words should be maintained. For examples,
plants, animals, height, weight, flower, colour, etc. However,
paraphrasing alone will not free a researcher or writer from
plagiarism unless he/she cites the source appropriately.
Summarizing
Summarizing is the third method of avoiding plagiarism and
incorporating a source into your own writing is to summarize it.
Summarizing possesses a flexibility that allows for highly
creative uses of source material.
While a paraphrase must contain about the same number of words
as the source, a summary can be created with many fewer or only
somewhat fewer words.
A summary is a condensed restatement or rewriting of a source in
order to present the source's idea in a more focused or shorter way
than quoting or paraphrasing would allow. In other words, a
summary reduces a source's words into fewer of your own words
and is used for simplifying the source and eliminating extras such
as digressions, or explanations and keeping only the essential
parts of the discussion or the main argument.
[409]
Use of plagiarism checkers
There are a number of plagiarism checker software developed by
different companies and freely availed too users. Plagiarism
checking with the use of these software is basically based on
uploading the paper to be tested or entering the content into the
text box; scanning for plagiarism (checking all internet pages and
databases housing many million academic works); and receiving
plagiarism report which contains information about sections of
the scan that have been plagiarized and a list of sources.
Likewise, anyone can also check content from your own article to
make sure nobody else has been ripping you off!
What to cite and what not to cite
One requirement to avoid plagiarism is that the source must be
cited. Any source of information refers to any producer of
observation, knowledge, or experience other than you. The source
needs citation. However, in order to cite a reference appropriately,
it is important to understand the difference between common
knowledge, statements, facts, and opinions.
Common knowledge includes whatever an educated person is
expected to know. It represents the kind of general information
found in many sources and remembered by many people.
Common knowledge does not need to be cited. Example of
common knowledge: “Plants manufacture their own food using
sunlight, water, and carbon dioxide”; “certain types of trees in the
tropics and sub-tropics shed their leaves in the dry season”;
“ruminant animals cud their food”, etc.
Concerning opinions, if an author formulates a positive, negative
or neutral opinion based on a report or some other research work,
it is required to give due credit to the sources based on the author
[410]
that articulated his/her opinion. Thus, it is imperative to
understand and distinguish between facts, lesser known facts and
opinions during the process of citation.
In a number of sources, common knowledge can be found mixed
with interpretation, facts, analysis, and opinion. All such
commentary on common knowledge should be cited. For
example, if a source states that “installing the irrigation system is
an expensive project, it does not need citation because it is
common knowledge. However, if the source uses the word
uneconomical instead or in addition to expensive, that is
interpretation. Therefore, it would need a citation. It is not always
easy to know what common knowledge is and what is not. If you
come across a fact that you think may be common knowledge, but
you are not sure about it, it is good to follow the rule of
uncertainty to be on the safe side. Thus, it is better to cite
unnecessarily than to neglect citing something that should have
been cited. If there is a large amount of common knowledge in a
source, it is easier to summarize a single source and cite it than to
assemble the many pieces from various references.
Differences between reference list, bibliography, and citation
Reference, bibliography, and citation are often used
interchangeably. However, this is not quite right. A reference is
the list of the sources explicitly used in completing the write-up
of a manuscript, book, etc. It includes detailed descriptions of the
author, journal/proceeding/book, publisher, publication year,
volume, issue no., and page number (or date of download in case
of multimedia sources).
Bibliography, on the other hand, is a list of all the sources that
were used in writing a manuscript or any other document but may
[411]
have not been directly used in the contents of the paper. In other
words, it is the list of all the references published/unpublished
which have provided background information and better
understanding of the topic/concept but are not explicitly
mentioned in the manuscript.
Citation is an act or practice of mentioning/attributing/indicating a
specific source or quote material in the body of your paper.
Harvard Citation system, MLA (Modern Language Association)
citation system, Vancouver citation style, and American
Psychological Association (APA) citation style are common
styles or formats of citation.
23.2.5. Publishing in “predatory” journals
Publishing in the so-called “Predatory” journals (non-peer-
reviewed journals) has recently been recognized as a major
research misconduct in the world as a whole.
Before the advent of the Internet, disseminating journals was
possible only in print forms. This method of disseminating
publications was slow and costlier. The Internet has simplified
scientific communication and created the opportunity of
disseminating publications through the open access (OA) model
faster and more efficiently. As a result, open access publication
has increased visibility of scientific journals and other published
material. The advent of Internet has also reduced costs of printing
and dissemination.
Publishing scientific journals in both open access and print
models incurs costs of editorial decision making, peer review,
copy editing, production, archiving, website maintenance, etc.
For this purpose, journals or publishers use several payment
[412]
models for maintaining scientific publications. These include
publisher Pay Model through advertising and society
memberships, reader pay model through journal subscriptions and
per article fee, and author pay model through submission or
publication fees.
A lot of genuine OA journals and publishers that use author pay
model have proliferated with the advent of the Internet. However,
this opportunity has also contributed to the rise of for-profit,
scam-like, publishing industry that exploits the Open Access
model and engage in what is described as “predatory” practices.
Predatory refers specifically to a practice in which open access
publications exploit the author-pay model by setting up bogus
publishing operations and tricking authors into thinking that they
are legitimate scholarly publishing outlets” (Bornemann, 2013, p.
13). Predatory publishers trick unsuspecting authors with a
promise of rapid publication to submit their manuscripts to their
journals in exchange for payment of publication fee.
The major concerns with predatory journals or publishers include
that they accept manuscripts and publish them with little or no
peer review or quality control (Bohannon, 2013), resulting in poor
quality publications. They usually notify academics of article fees
only after papers are accepted (Stratford, 2012).
In fact, merely charging a fee for publishing a paper is not a
marker of a predatory practice: many reputable OA journals use
article-processing charges (APCs) to cover costs. Many
subscription-based journals also charge authors fees, sometimes
per page or illustration. However, predatory journals are primarily
fee-collecting operations with no genuine rigorous peer review.
[413]
Currently, it is important to realize that there are a lot of online
predatory publishers that trick authors into submitting their hard-
won research results to their “predatory” journals. These journals
are fake and live only to make money from unsuspecting authors
by publishing manuscripts in exchange for publication fee without
subjecting the papers to any peer-review processes. Therefore,
researchers should remain vigilant and protect themselves from
such scam or deception and publish their manuscripts only in
genuinely peer-reviewed journals.
There are two general ways of addressing unethical open access
publishing (predatory publishing). The first method is
Blacklisting. The second one is Whitelisting. Usually, there is a
fuzzy line between low-quality and predatory publishers. Thus,
whitelisting, or listing publishers and journals that have been
vetted and verified as satisfying certain standards, may be a better
solution than blacklisting. The central player in the whitelisting
movement is the Directory of Open Access Journals (DOAJ).
In addition to the above methods, authors can use different other
strategies to identify high quality open access journals for
submitting their manuscripts for publications.
There are strategies to identify and avoid submitting ones hard-
won research data to predatory journals and identify and using
only genuinely peer-reviewed journals. The major strategy for
avoiding predatory publications and identifying genuinely peer-
reviewed journals is using the following major criteria: the
journal is indexed by at least one legitimate abstracting, indexing,
and database services/agents (e.g. SCOPUS, DOAJ, PubMED,
Springer, SCI, Medline, Web of Science, RePEc, ProQuest,
EBSCO, Thomson Reuters, Taylor & Francis, BIOSIS, Agricola,
[414]
ScienceDirect, or any other proven legitimate abstracting,
indexing, and database services/agents) or in journals that are
listed in one or more of the Journal Citation Report (JCR),
Directory of Open Access Journals (DOAJ), Open Access
Scholarly Publishers Association (OASPA), Committee on
Publication Ethics (COPE), etc.; the journal has a genuine peer-
review process, assigning at least two reviewers of relevant
competence that complete a blind peer-review process per article;
the journal has a transparent publication process: clear author
instructions, ethical guidelines, and clear policies on copyright;
the journal clearly indicates journal editor(s), editorial staff and
review/editorial board members, with full names, correspondence
addresses including their institutional affiliation, who directly
respond to author queries; the journal or publisher has "contact
us" page with clearly identified detailed contact addresses: name
of institution and person, telephone numbers, email, P. O. Box,
street address, and other relevant information for direct contact;
the journal has well maintained website, with no dead links;
The second strategy through which researchers can ensure peer-
reviewed publication is submitting their manuscripts to journals
that have institutional affiliations (Homebase) in any country such
as a university or a research institution or a recognized scholarly
society.
The third strategy to use especially for local (Ethiopian) journals
is submitting manuscripts to journals in the country (no matter
what their affiliation or Homebase is) that are regularly (usually
every three years) revaluated and accredited for the genuineness
of their peer review system by Ministry Education.
[415]
Such Journals are professionally based and have definite peer-
review process although the rigour of the peer review process
may vary from journal to journal or from institution to institution.
23. Bibliography
[417]
Schneider, C. 2000. Safeguarding good scientific practice: new
institutional approaches in Germany. Science and engineering
ethics,6 (1), 49–56.
Sheikh, F. A., Khan, M. N., Sofi, P. A., Dar, Z. A., Sofi, N. R. and
Bhat, M. A. 2017. Farmers’ Preference Ranking in Pole type of
Common Bean (Phaseolus vulgaris L.): Participatory Varietal
Selection. Int. J. Pure App. Biosci. 5 (1): 703-711.
Shoja, M.M., Arynchyna, A., Loukas, M., D'Antoni, A.V., Buerger,
S.M., Karl, M. and Tubbs, R.S. eds., 2019. A Guide to the
Scientific Career: Virtues, Communication, Research, and
Academic Writing. John Wiley & Sons, pp742.
Thomas, C.G., 2021. Research methodology and scientific writing.
Thrissur: Springer., 2nd Edn, [Link]
64865-7, p611.
Wehrmeijer, M. 2014. Exposing the predators. Methods to stop
predatory journals Publishing.
[418]
[419]