SAMPLING & DATA

COLLECTION
QSB3933 RESEARCH METHODLOGY
BACHELOR OF QUANTITY SURVEYING (HONS.) 1
QSB3933_MAK_SAMPLING & DATA COLLECTION
 What is Sampling?
Sampling is selecting a sub-set of a whole
population.
Sampled population & target population
should be similar to one another.

Reasons for sampling?

Cost & Practicality.

SAMPLING 2
QSB3933_MAK_SAMPLING & DATA COLLECTION
 SAMPLING PLANS
A method or procedure for specifying how a sample will
be taken from a population.

TYPES OF SAMPLING

SIMPLE STRATIFIED
CLUSTER
RANDOM RANDOM

SAMPLING PLANS 3
QSB3933_MAK_SAMPLING & DATA COLLECTION
 A sample selected in such a way that every possible
sample of the same size is equally likely to be chosen.
Example:
Drawing three names from a hat containing all the
names of the students in the class. Any group of three
names is as equally likely as picking any other group of
three names!
VERY EASY TO DEFINE!
EXTREMELY DIFFICULT TO DO!
Random sample of 100 cokes bottles today at the coke
plant.
Random sample of 50 pine tress in a 1000 acre forest.
Random sample of 5 deer in a national forest.

SIMPLE RANDOM SAMPLING 4

QSB3933_MAK_SAMPLING & DATA COLLECTION
 Obtained by separating the population into mutually
exclusive sets, or strata and then drawing simple
random samples from each stratum.
STRATA 1: GENDER STRATA 2: AGE STRATA 3:
Male < 20 OCCUPATION
Female 20 30 Professional
31 40 Clerical
41 50 Blue Collar
51 60 Other
> 60

We can acquire about the total population, make

inferences (suggestions) within a stratum or make
comparisons across data.

STRATIFIED RANDOM SAMPLING 5

QSB3933_MAK_SAMPLING & DATA COLLECTION
 After the population has been stratified, we can use simple
random sampling to generate the complete sample:
INCOME POPULATION SAMPLE SIZE
CATEGORY PROPORTION N = 400 n=1000
Under $25,000 25% 100 250
$25,000 - $39,999 40% 160 400
$40,000 - $60,000 30% 120 300
Over $60,000 5% 20 50

If we only have sufficient resources to sample 400 people in total,

we would draw 100 of them from the low income group.

..if we are sampling 1000 people, we would draw 50 of them

from the high income group.

STRATIFIED RANDOM SAMPLING 6

QSB3933_MAK_SAMPLING & DATA COLLECTION
 A cluster sample is a simple random sample of groups
or clusters of elements (vs. a simple random sample of
individual objects)

This method is useful when it is difficult or costly to

develop a complete list of the population members or
when the population elements are widely dispersed
geographically.

Cluster sampling may increase sampling error due to

similarities among cluster members.

CLUSTER SAMPLING 7
QSB3933_MAK_SAMPLING & DATA COLLECTION
 DATA
COLLETION

FIELDWORK DESK STUDY

(Primary) (Secondary)

Problem
Survey Case Study
solving

DATA COLLECTION 8
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Data derived from a large number of respondents
Within a limited time frame
Concern with generalized results
Data is abstracted from a particular sample or population

SURVEY

DESCRIPTIVE ANALYTICAL

SURVEY APPROACH 9
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Aims to answer questions such as: HOW
MANY, WHO? WHAT IS HAPPENING?
WHEN? WHERE?
Counts the number of respondents with
certain opinion/ view towards a specific
object/ concern.
Example: Number of respondents that answer
YES to a question posed.

DESCRIPTIVE SURVEY 10
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Aims at establishing relationship and
association between the attributes/
objects of questionnaire.
Example: Workers motivation and site
productivity
YES answers given by the workers
No answers given by site managers

ANALYTICAL SURVEY 11
QSB3933_MAK_SAMPLING & DATA COLLECTION
 May be administered through:

INTERVIEW QUESTIONNAIRE OBSERVATION

SURVEYS 12
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Decide who Pilot test the
should be questionnaire Think about
involved in the and other analysis
process materials

Communicate
Define survey Develop the
about your survey
content questionnaire
and its results

Develop budget,
Identify your Decide on the timeline and
respondents survey method management
process

STEPS IN PLANNING A SURVEY 13

QSB3933_MAK_SAMPLING & DATA COLLECTION
 The proportion of people who respond:
Divide the number of returned surveys by
the total number of surveys distributed.

Example: If you distribute 50 questionnaires

and you get 25 questionnaires back, your
response rate is 50%.

RESPONSE RATE 14
QSB3933_MAK_SAMPLING & DATA COLLECTION
RESPONSE RATE = # that responded/ answered the survey
# you contacted

RESPONSE RATE 15
QSB3933_MAK_SAMPLING & DATA COLLECTION
 High response rate promotes
confidence in results.

Lower response rate increases the

likelihood of biased results.

RESPONSE RATE 16
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Generate positive publicity for your survey
Over sample
Ensure that respondents see the value of participating
Use a combination of methods
Make multiple follow up contacts
Provide incentives
Provide 1st class postage/ return postage
Set return deadlines
Make the survey easy to complete

HOW TO INCREASE RESPONSE

RATE 17
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Use language that is suggestive rather than
decisive

Example:
The data suggests vs. These data show
It appears vs. We can conclude

Avoid generalize findings to the entire group

Clearly describe who the data represents

IF RESPONSE RATE IS LOW 18

QSB3933_MAK_SAMPLING & DATA COLLECTION
 Observing people, programs, events, communities, etc

Involves all 5 senses: sight, hearing, smell, touch and

taste

Observation includes more than just seeing

OBSERVATION 19
QSB3933_MAK_SAMPLING & DATA COLLECTION
 To provide information about real life
situations and circumstances
To assess what is happening
Because you cannot rely on
participants willingness and ability
to furnish information

OBSERVATION 20
QSB3933_MAK_SAMPLING & DATA COLLECTION
 When you want direct information

When you are trying to understand an ongoing behavior,

process, unfolding situation or event

When there is physical evidence products, or outcomes

that can be readily seen

When written or other data collection methods seem

inappropriate

WHEN IS OBSERVATION
USEFUL? 21
QSB3933_MAK_SAMPLING & DATA COLLECTION
 ADVANTAGES DISADVANTAGES

Most direct measure May require training

of behavior Observers presence
Provides direct may create artificial
information situation
Easy to complete Potential for bias
Saves time Potential to overlook
Can be used in meaningful aspects
natural or experiment Potential for
settings misinterpretation
Difficult to analyze

OBSERVATION 22
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Potential for bias
Effect of culture on what you observe and interpret

Reliability
Ease of categorization

Do not rely on observation alone, combine

observations with another method to provide a more
thorough account of your program

OBSERVATION -
LIMITATIONS 23
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Train the observers
Determine who/ what Collect the
and have them
will be observed information
practice

Determine aspects
Pilot test the Analyze & interpret
that will be observed
observation record the collected
(characteristics/
sheet information
attributes/ behaviors)

Determine where and Develop the

Write up & use your
when observations observation record
findings
will be made sheet

STEPS IN PLANNING FOR

OBSERVATION 24
QSB3933_MAK_SAMPLING & DATA COLLECTION
 People (individuals, groups & communities)
i. Characteristics
ii. Interactions
iii. Behaviors
iv. Reactions
Physical settings
Environment features
Products/ physical artifacts

WHO & WHAT TO OBSERVE? 25

QSB3933_MAK_SAMPLING & DATA COLLECTION
 Observations need to be recorded to be
credible. You might use:
1. Observation guide
2. Recording sheet
3. Checklist
4. Field note
5. Picture
6. Combination of the above

RECORDING YOUR OBSERVATIONS 26

QSB3933_MAK_SAMPLING & DATA COLLECTION
 WRITTEN DESCRIPTIONS
(written explanations of each gradation to observe)

PHOTOGRAPHS
(series of photos that demonstrate each of the grades on
the rating scale)

DRAWINGS, SKETCHES, ETC

(other visual representations of conditions to be observed)

OBSERVATIONAL RATING SCALES 27

QSB3933_MAK_SAMPLING & DATA COLLECTION
 Talking & listening to people
Verbally asking program participants the program
evaluation questions & hearing the participants point
of view in his or her own words.
Interviews: structured or unstructured
In person or over the phone
Individual or group

INTERVIEWING 28
QSB3933_MAK_SAMPLING & DATA COLLECTION
 The subject is sensitive
People are likely to be inhibited in speaking about
the topic in front of others
People have a low reading ability
Bringing a group of people together is difficult (e.g
in rural areas)

INTERVIEWS ARE USEFUL

WHEN. 29
QSB3933_MAK_SAMPLING & DATA COLLECTION
 ADVANTAGES DISADVANTAGES

Deep and free Costly in time &

response personnel
Flexible & adaptable Requires skill
Glimpse into May be difficult to
respondents tone, summarize
gestures responses
Ability to probe, Possible biases:
follow up interviewer,
respondent,
situation

INTERVIEWS 30
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Uses script & questionnaire
No flexibility in wording or order of
questions
Closed response option
Open response option

STRUCTURED INTERVIEW 31
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Outline of topics or issues to cover

May vary wording or order of questions

Fairly conversational and informal

SEMI STRUCTURED
INTERVIEW 32
QSB3933_MAK_SAMPLING & DATA COLLECTION
 May not know that an interview is taking place
Spontaneous
Questions emerge from the situation and what is
said
Topics or questions are not predetermined
Individualized and relevant to situation

NON STRUCTURED
INTERVIEW 33
QSB3933_MAK_SAMPLING & DATA COLLECTION
 INTERVIEW QUESTION:
What did you like best about this program?
Response: I liked everything
Probe 1: What one thing stood out?
R: Being with my friends
Probe 2: What about the program activities?
R: I liked it when we worked as a team
Probe 3: How come?
R: It was neat to hear each others perspectives. I heard
some things I hadnt considered before
Probe 4: What is one thing that you learned?

PROBING 34
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Keep language pitched to that of respondent
Avoid long questions
Create comfort
Establish time frame for interview
Avoid leading questions
Sequence topics
Be respectful
Listen carefully

INTERVIEWING TIPS 35
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Write down response

Tape record

Key in computer

Work in pairs

Complete notes after interview

RECORDING RESPONSES 36
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Data collection instruments used to collect standardized
information that can be expressed numerically or through
short answers.
Basic instruments of surveys and structured interviews.
Appropriate when:-
1. You want information form many people.
2. You have some understanding of the situation and can
ask meaningful questions.
3. Information is sensitive or private anonymous
questionnaires may reduce bias.

QUESTIONNAIRES ARE 37
QSB3933_MAK_SAMPLING & DATA COLLECTION
 ADVANTAGES DISADVANTAGES
- Can reach large - Might not get careful
numbers feedback
- Provide anonymity - Wording can bias
- Relatively inexpensive clients response
- Easy to analyze Response rate is often
low
Literacy demands

QUESTIONNAIRES 38
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Respondents can provide useful information about the
topic.
You know what it is you want to know & are
reasonably sure that you can ask standardized
questions to get the information.
Respondents can be relied upon to provide the
information you need (perhaps with incentives).
Meaning, they can comprehend the questions and
respond properly, they are truthful & motivated
enough to respond carefully.

WHEN SHOULD A QUESTIONNAIRE BE

USED? 39
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Developing a good questionnaire, takes time, time and
more time!

Multiple (even dozen!) drafts may be involved before

questionnaire is ready.

It is important to involve other in writing the

questionnaire.

GOOD QUESTIONNAIRES ARE NOT

EASY! 40
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Adopted when there is a need to support a
researchers argument by an in-depth analysis of a
person, a group of persons, an organization or a
particular project.

Conclusion drawn not generalized, but rather related

to one particular event (the case) chosen

CASE STUDY APPROACH 41

QSB3933_MAK_SAMPLING & DATA COLLECTION
 CASE STUDY

DESCRIPTIVE ANALYTICAL EXPLANATORY

Counting
Counting,
concept is Asks why things
association &
applied on happened
relationship
detailed case

CASE STUDY APPROACH 42

QSB3933_MAK_SAMPLING & DATA COLLECTION
 Data are obtained form other sources, not first

hand.

Stored either in a statistical or descriptive

format.

SECONDARY DATA
COLLECTION 43
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Refers to official statistics collected by the
government and its agencies.

Available in libraries (public/ universities)

Example: CIDB reports, NIOSH, DOSH, Ministries

reports

Data compiled through registration or self-survey

STATISTICAL FORMAT 44
QSB3933_MAK_SAMPLING & DATA COLLECTION
 Using information that already exists in records,
receipts, meeting minutes, reports, budgetsrather
than collecting new data.

There is a wealth of information available on the web.

CHECK- what information is already available?

DOCUMENT REVIEW 45
QSB3933_MAK_SAMPLING & DATA COLLECTION
 ADVANTAGES ISSUES

Available Dont have to Missing or incomplete

collect data data
Low cost Confidentiality issues
Minimum staff required Unknown, different, or
Comparative / changing definitions of
Longitudinal data may be data make comparison
available difficult
May not match what you
need in terms of
geographic location,
same time period or
population, may be too
aggregated.

DOCUMENT REVIEW 46
QSB3933_MAK_SAMPLING & DATA COLLECTION
What you must ask yourself:
Will the data answer my research question?

To answer that
You must first decide what your research
question is
Then you need to decide what data/ variables
are needed to scientifically answer the
question

DATA COLLECTION CHOICE 47

QSB3933_MAK_SAMPLING & DATA COLLECTION
 If that data exist in secondary form,
then use them to the extent you can,
keeping in mind limitations.
But if it does not, and you are able
to find primary collection, then it is
the method of choice.

DATA COLLECTION CHOICE 48

QSB3933_MAK_SAMPLING & DATA COLLECTION
SO HOW MANY SAMPLES DO
I NEED FOR SENDING OUT
QUESTIONNAIRES?

49
QSB3933_MAK_SAMPLING & DATA COLLECTION
S = X NP(1-P)/d (N-1)+X P(1-P)
2 2 2
S= required sample

X2= 3.841, obtained form the table value of chi-square

for 1 degree of freedom at the desired confidence level

N= population size

P=population proportion, always fixed at 0.50 as this

would provide the maximum sample size

D= degree of accuracy expressed as a proportion at

0.05 50
QSB3933_MAK_SAMPLING & DATA COLLECTION