RESEARCH INSTRUMENTS
The research instruments that are widely used include
Questionnaires
Interviews
Observations
QUESTIONNAIRES
Each item in the questionnaire is developed to address a specific objective, research question or
hypothesis of the study. The researcher must also know how information obtained from each
questionnaire item will be analysed.
Types of questions used questionnaires
1 Structured or closed-ended questions
They are questions, which are accompanied by a list of possible alternatives from which
respondents select the answer that best describes their situation.
Advantages of Structured or closed-ended questions
They are easier to analyse since they are in an immediate usable form
They are easier to administer
They are economical to use in terms of time and money
Disadvantages of Structured or closed-ended questions
They are more difficult to construct
Responses are limited and the respondent is compelled to answer questions according to
the researcher's choices
2. Unstructured or open - ended questions
They refer to questions, which give the respondent complete freedom of response. The amount,
of space provided is always an indicator of whether a brief or lengthy answer is desired.
Advantages of Unstructured or open - ended questions
They permit a greater depth of response
They are simple to formulate
The respondent's responses may give an insight into his feelings, background, hidden
motives, interest and. decisions.
Disadvantages of Unstructured or open - ended questions
There is a tendency of the respondents providing information, which does not answer the
stipulated, research-questions or objectives.
The responses given may be difficult to categorize and hence difficult to analyze
quantitatively
Responding to open ended questions is time consuming, which may put some respondent
off.
3. Contingency questions
In particular cases, certain questions are applicable to certain groups of respondents. In such
cases, follow-up questions are needed to get further information from the relevant sub-group
only. These subsequent questions, which are asked after the initial questions, are called
'contingency questions' or ' filter questions'. The purpose of these kinds of questions is to probe
for more information. They also simplify the respondent's task, in that they will not be required
to answer questions that are not relevant to them.
4. Matrix Questions
These are questions, which share the same set of response categories. They are used whenever
scales like likert scale are being used.
Advantages of matrix questions
When questions or items are presented in matrix form, they are easier to complete and
hence the respondent is unlikely not to be put off.
Space is used efficiently
It is easy to compare responses given to different items.
Disadvantages of matrix questions
Some respondents, especially the ones that may not be too keen to give right responses,
might form a pattern of agreeing or disagreeing with statements.
Some researchers use them when in fact the kind of information being sought could better
be obtained in another format.
Rules for constructing questionnaires and questionnaire items
1. List the objectives that you want the questionnaire to accomplish before constructing the
questionnaire.
2. Determine how information obtained from each questionnaire item will be analyzed.
3. Ensure clarity and avoid ambiguity.
4. If a concept has several meanings and that concept must be used in a question, the
intended meaning must be defined.
5. Construct short questions.
6. Items should be stated positively as possible.
7. Double-barreled items should be avoided.
8. Leading and biased questions should be avoided.
9. Very personal and sensitive questions should be avoided.
10. Simple words that are easily understandable should be used.
11. Questions that assume facts with no evidence should be avoided.
12. Avoid psychologically threatening questions.
13. Include enough information in each item so that it is meaningful to the respondent.
Tips on how to organize or order items in a questionnaire
1. Begin with non-threatening, interesting items.
2. It is not advisable to put important questions at the end of a long questionnaire.
3. Have some logical order when putting items together.
4. Arrange the questions according to themes being studied.
5. If the questionnaire is arranged into content sub-sections, each section should be
introduced with a short statement concerning its content and purpose.
6. Socio-economic questions should be asked at the end because respondents may be put off
by personal questions at the beginning of the questionnaire.
Presentation of the questionnaire
1. Make the questionnaire attractive by using quality paper. It increases the response rate.
2. Organize and lay out the questions so that the questionnaire is easy to complete.
3. All the pages and items in a questionnaire should be numbered.
4. Brief but clear instruction must be included.
5. Make your questionnaire short.
Pretesting the questionnaire
The questionnaire should be pretested to a selected sample, which is similar to the actual sample,
which the researcher plans to study. This is important because:-
Questions that are vague will be revealed in the sense that the respondents will interpret
them differently.
Comments and suggestions made by respondents during pretesting should be seriously
considered and incorporated.
Pretesting will reveal deficiencies in the questionnaire.
It helps to test whether the methods of analysis are appropriate
Ways of administering questionnaires
i. Self administered questionnaires
Questionnaires are send to the respondents through mail or hand-delivery, and they
complete on their own.
ii. Researcher administered questionnaires
The researcher can decide to use the questionnaire to interview the respondents. This is
mostly done when the subjects may not have the ability to easily interpret the questions
probably because of their educational level.
iii. Use of the internet
The people sampled for the research receive and respond to the questionnaires through
their web sites or e-mail addresses.
The letter of transmittal / Cover letter
The letter of transmittal / Cover letter should accompany every questionnaire.
Contents of a letter of transmittal
It should explain the purpose of the study.
It should explain the importance and significance of the study.
A brief assurance of confidentiality should be included in the letter.
If the study is affiliated to a certain institution or organisation, it is advisable to have an
endorsement from such an institution or organisation.
In a sensitive research, it may be necessary to assure the anonymity of respondents.
The letter should contain specific deadline dates by which the completed questionnaire is
to be returned.
Follow-up techniques
Sending a follow-up letter which should be polite, and asking the subjects to respond
A questionnaire and a follow-up letter
Response rate
It refers to the percentage of subjects who respond to questionnaires. Many authors believe that a
response rate of 50% is adequate for analysis and reporting. If the response rate is low, the
researcher must question the representativeness of the sample.
INTERVIEWS
An interview is an oral (face to face) administration of a questionnaire or an interview schedule.
To obtain accurate information through interviews, a researcher needs to obtain the maximum
co-operation from respondents. Interviews are particularly useful for getting the story behind a
participant's experiences. The interviewer can pursue in-depth information around a topic.
Interviews may be useful as follow-up to certain respondents to questionnaires, e.g., to further
investigate their responses. Usually open-ended questions are asked during interviews.
Guidelines for preparation for Interview
1. Choose a setting with little distraction. Avoid loud lights or noises, ensure the
interviewee is comfortable (you might ask them if they are), etc. Often, they may feel
more comfortable at their own places of work or homes.
2. Explain the purpose of the interview.
3. Address terms of confidentiality. Note any terms of confidentiality. (Be careful here.
Rarely can you absolutely promise anything. Courts may get access to information, in
certain circumstances.) Explain who will get access to their answers and how their
answers will be analyzed. If their comments are to be used as quotes, get their written
permission to do so.
4. Explain the format of the interview. Explain the type of interview you are conducting and
its nature. If you want them to ask questions, specify if they're to do so as they have them
or wait until the end of the interview.
5. Indicate how long the interview usually takes.
6. Tell them how to get in touch with you later if they want to.
7. Ask them if they have any questions before you both get started with the interview.
8. Don't count on your memory to recall their answers. Ask for permission to record the
interview or bring along someone to take notes.
Types of Interviews approaches
(a) Informal, conversational interview - no predetermined questions are asked, in order to
remain as open and adaptable as possible to the interviewee's nature and priorities; during the
interview, the interviewer "goes with the flow".
(b) General interview guide approach - the guide approach is intended to ensure that the
same general areas of information are collected from each interviewee; this provides more focus
than the conversational approach, but still allows a degree of freedom and adaptability in getting
information from the interviewee.
(c) Standardized, open-ended interview - here, the same open-ended questions are asked to
all interviewees (an open-ended question is where respondents are free to choose how to answer
the question, i.e., they don't select "yes" or "no" or provide a numeric rating, etc.); this approach
facilitates faster interviews that can be more easily analyzed and compared
(d) Closed, fixed-response interview - where all interviewees are asked the same questions and
asked to choose answers from among the same set of alternatives. This format is useful for those
not practiced in interviewing.
Sequence of Questions
1. Get the respondents involved in the interview as soon as possible.
2. Before asking about controversial matters (such as feelings and conclusions), first ask
about some facts. With this approach, respondents can more easily engage in the
interview before warming up to more personal matters.
3. Intersperse fact-based questions throughout the interview to avoid long lists of fact-based
questions, which tends to leave respondents disengaged.
4. Ask questions about the present before questions about the past or future. It's usually
easier for them to talk about the present and then work into the past or future.
5. The last questions might be to allow respondents to provide any other information they
prefer to add and their impressions of the interview.
Wording of Questions
Wording should be open-ended. Respondents should be able to choose their own terms
when answering questions.
Questions should be as neutral as possible. Avoid wording that might influence answers,
e.g., evocative, judgmental wording.
Questions should be asked one at a time.
Questions should be worded clearly. This includes knowing any terms particular to (he
program or the respondents' culture.
Be careful asking "why" questions. This type of question infers a cause-effect relationship
that may not truly exist. These questions may also cause respondents to feel defensive,
e.g., that they have to justify their response, which may inhibit their responses to this and
future questions.
While Carrying Out Interview
Occasionally verify the tape recorder (if used) is working.
Ask one question at a time.
Attempt to remain as neutral as possible. That is, don't show strong emotional reactions to
their responses. Patton suggests to act as if "you've heard it all before."
Encourage responses with occasional nods of the head, "uh huh"s, etc.
Be careful about the appearance when note taking. That is, if you jump to take a note, it
may appear as if you're surprised or very pleased about an answer, which may influence
answers to future questions.
Provide transition between major topics, e.g., "we've been talking about (some topic) and
now I'd like to move on to (another topic)."
Don't lose control of the interview. This can occur when respondents stray to another
topic, take so long to answer a question that times begins to run out, or even begin asking
questions to the interviewer.
Immediately After Interview
Verify if the tape recorder, if used, worked throughout the interview.
Make any notes on your written notes, e.g., to clarify any scratching, ensure pages are
numbered, fill out any notes that don't make senses, etc.
Write down any observations made during the interview. For example, where did the
interview occur and when, was tire respondent particularly nervous at any time? Were
there any surprises during the interview? Did the tape recorder break?
Creating a non response sample and weighting results from this sample
Substituting another individual for the missing non-participant, (c)
Response error
Occurs when the data reported differ from the actual data. It can occur during the interview or
during preparation of data analysis.
Participant-initiated error occurs when the participant fails to answer fully and accurately
either by choice or because of inaccurate or incomplete knowledge. Can be solved by
using trained interviewers who are knowledgeable about such problems.
Interviewer error can be caused by:-
- Failure to secure full participant cooperation
- failure to consistently execute interview procedures
- Failure to establish appropriate interview environment
- Falsification of individual answers or whole interviews
- Inappropriate influencing behaviour
- Failure to record answers accurately and completely
- Physical presence bias.
Advantages of Personal interviews
Good cooperation from the respondents
Interviewer can answer questions about survey, probe for answers, use follow-up
questions and gather information by observation.
Special visual aids and scoring devices can be used.
Illiterate and functionally illiterate respondents can be reached
Interviewer can prescreen respondent to ensure he / she fits the population profile.
Responses can be entered directly into a portable microcomputer to reduce error and cost
when using computer assisted personal interviewing.
Disadvantages of Personal interviews
High costs
Need for highly trained interviewers
Longer period needed in the field collecting data
May be wide geographic dispersion
Follow-up is labour intensive
Not all respondents are available or accessible
Some respondents are unwilling to talk to strangers in their homes
Some neighbor hoods are difficult to visit
Questions may be altered or respondent coached by interviewers.
Telephone interviews
People selected to be part of the sample are interviewed on the telephone by a trained
interviewer.
Advantages of Telephone interviews
Lower costs than personal interviews
Expanded geographic coverage without dramatic increase in costs
Uses fewer, more highly skilled interviewers
Reduced interview bias
Personal interviews
People selected to be part of the sample are interviewed in person by a trained interviewer.
Requirements for success
Three broad conditions must be met in order to have a successful personal interview:
The participant must possess the information being targeted by the investigative
questions
The participant must understand his or her role in the interview as the provider of
accurate information
The participant must perceive adequate motivation to cooperate
Increasing the participant's receptiveness
The first goal in an interview is to establish a friendly relationship with the participant. Three
factors will help increase participant receptiveness. The participant must:
Believe that the experience will be pleasant and satisfying
Believe that answering the survey is an important and worthwhile use of his or her time
Dismiss any mental reservations that he or she might have about participation.
The technique of stimulating participants to answer more fully and relevantly is termed probing.
Since it presents a great potential for bias, a probe should be neutral and appear as a natural part
of the conversation. Appropriate probes should be specified by the designer of the data collection
instrument. There are several probing styles e.g.
A brief assertion of understanding and interest e.g. comments such as "I see" "yes".
An expectant pause
Repeating the question
Repeating the participant's reply
A neutral question or comment
Question clarification.
Problems likely to be encountered during personal interviews
In personal interviews, the researcher must deal with bias and cost. Biased results are as a result
of three types of errors:
(a) Sampling error
It's the difference between a sample statistic and its corresponding population parameter. The
sampling distribution of the sample means is a probability distribution of possible sample means
of a given sample size.
(b) Non-response error
This occurs when the responses of participants differ in some systematic way from the responses
of non-participants. It occurs when the researcher:
Cannot locate the person to be studied
Is unsuccessful in encouraging that person to participate Solutions to reduce errors of
non-response are
Establishing and implementing callback procedures
Fates completion time
Better access to hard-to-reach respondents through repeated callbacks
Can use computerized random digit dialing
Responses can be entered directly into a computer file to reduce error and cost when
using computer assisted telephone interviewing.
Disadvantages of Telephone interviews
Response rate is lower than for personal interview
Higher costs if interviewing geographically dispersed sample
Interview sample must be limited
Many phone numbers are unlisted or not working, making directory listings unreliable
Some target groups are not available by phone
Responses may be less complete
Illustrations cannot be used.
Respondents may not be honest with their responses since it is not a face to face situation
Rules pertaining to interviews
The interviewer must
Be pleasant
Show genuine interest in getting to know respondents without appearing like spies.
Be relaxed and friendly.
Be very familiar with the questionnaire or the interview guide.
Have a guide which indicates what questions arc to be asked and in what order.
Interact with the respondent as an equal.
Pretest the interview guide before using it to check for vocabulary, language level and
how well the questions will be understood.
Inform the respondent about the confidentiality of the information given.
Not ask leading questions
Remain neutral in an interview situation in order to be as objective as possible.
An interview schedule
It's a set of questions that the interviewer asks when interviewing. It makes it possible to obtain
data required to meet specific objectives of the study.
Note taking during interviews
It refers to the method of recording in which the interviewer records the respondent's responses
during the interview.
Advantages
It facilitates data analysis since the information is readily accessible and already classified
into appropriate categories.
If taken well, no information is left out.
Disadvantages of note taking
It may interfere with the communication between the respondent and the interviewer.
It might upset the respondent if the answers are personal and sensitive.
If it is delayed, important details may be forgotten.
It makes the interview lengthy and boring.
Tape recording
The interviewer's questions and the respondent's answers are recorded either using a tape
recorder or a video tape.
Advantages
It reduces the tendency for the interviewer to make unconscious selection of data in the
course of the recording.
The tape can be played back and studied more thoroughly.
A person other than the interviewer can evaluate and categorize responses.
It speeds up the interview.
Communication is not interrupted.
Disadvantages
It changes the interview situation since respondents get nervous.
Respondents may be reluctant to give sensitive information if they know they are being
taped.
Transcribing the tapes before analysis is time consuming and tedious.
Advantages of interviewers
It provides in-depth data, which is not possible to get using a questionnaire.
It makes it possible to obtain data required to meet specific objectives of the study.
Are more flexible than questionnaires because the interviewer can adapt to the situation
and get as much information as possible.
Very sensitive and personal information can be extracted from the respondent.
The interviewer can clarify and elaborate the purpose of the research and effectively
convince respondents about the importance of the research.
They yield higher response rates
Disadvantages of interviews
They are expensive - traveling costs
It requires a higher level of skill
Interviewers need to be trained to avoid bias
Not appropriate for large samples
Responses may be influenced by the respondent's reaction to the interviewer.
OBSERVATION
Observation is one of the few options available for studying records, mechanical processes, small
children and complex interactive processes. Data can be gathered as the event occurs.
Observation includes a variety of monitoring situations that cover non-behavioural and
behavioural activities.
The observer-participant relationship
Interrogation presents a clear opportunity for interviewer bias. The problem is less
pronounced with observation but is still real. The relationship between observer and
participant may be viewed from three perspectives:
Whether the observation is direct or indirect
Whether the observer's presence is known or unknown to the participant
What role the observer plays
Guidelines for the qualification and selection of observers
Concentration: Ability to function in a setting full of distractions
Detail-oriented: Ability to remember details of an experience
Unobtrusive: Ability to blend with the setting and not be distinctive
Experience level: Ability to extract the most from an observation study
Advantages of observation
Enables one to:
Secure information about people or activities that cannot be derived from experiment or
surveys
Reduces obtrusiveness
Avoid participant filtering and forgetfulness
Secure environmental context information
Optimize the naturalness of the research setting
Limitations of observation
Difficulty of waiting for long periods to capture the relevant phenomena
The expense of observer costs and equipment
Reliability of inferences from surface indicators
The problem of quantification and disproportionately large records
Observation forms, schedules or checklists
The researcher must define the behaviours to be observed and then develop a detailed list of
behaviours. During data collection, the researcher checks off each as it occurs. This permits
the observer to spend time thinking about what is occurring rather than on how to record it
and this enhances the accuracy of the study.