Data Processing and Analysis Techniques
Data Processing and Analysis Techniques
Research Methods
Data Processing & Analysis
Learning Objectives
—) Identify elements of data processing.
—) Outline the data analysis methods & tools.
—) Select appropriate research software.
—) Understand the features of qualitative &
quantitative research.
1
06/02/2023
Editing
– Editing of data is a process of examining the collected raw
data (specially in surveys) to detect errors & omissions and
to correct these when possible.
Editing
– Editing should be done as soon as possible
• Preferable on the very day or on next day if it is an
interview.
• Use recording device
2
06/02/2023
Coding
– Coding refers to the process of assigning numerals or
other symbols to answers so that responses can be put
into a limited number of categories or classes.
Coding
– Another rule to be observed is that of uni-
dimensionality by which is meant that every class is
defined in terms of only one concept.
3
06/02/2023
Classification
– Classification is the process of arranging data in groups or
classes on the basis of common characteristics.
Classification
– Classification According to Class-intervals: Unlike
descriptive characteristics, the numerical
characteristics refer to quantitative phenomenon
which can be measured through some statistical units.
4
06/02/2023
Tabulation
– When a mass of data ‘Big Data’ has been assembled, it
becomes necessary for the researcher to arrange it in
some kind of concise & logical order. This procedure is
referred to as tabulation.
Tabulation
– Tabulation can be done by hand or by mechanical or
electronic devices.
• Examples:
–MS-Excel Classification (sorting, filtering, grouping,
coding…..)
–Writing a Code/Machine Learning/Artificial Intelligence
5
06/02/2023
- Example:
- Cutoff value
- >50% of missing value…..
- Imputation technique
- Replacement value – median, mean….
- Assign 2 Variable Responses’
- Yes & No - > Code it with 0 & 1
6
06/02/2023
Data Analysis
– Is the process of inspecting, transforming, and modeling
data with the goal of discovering useful information
suggesting conclusions, & supporting decision making.
7
06/02/2023
8
06/02/2023
Descriptive Statistics
Measures of Central Measures of Dispersion
Other Methods
Tendency
Percentiles Z scores
9
06/02/2023
Mode
– Mode can be defined as the most frequently occurring
value in a group of observations.
Median
– Median is defined as the middle value in an ordered
arrangement of observations.
10
06/02/2023
Mean
– The arithmetic mean is the most commonly used &
accepted measure of central tendency.
Measure of Dispersion
– The measure of dispersion is as important as the
measure of location for data description and whenever
researchers describe the measure of location, they
should also specify the spread of distribution, which is
measured by measure of dispersion.
11
06/02/2023
Range
– Range is the difference between the highest & lowest
value.
– It is based solely on extreme values. Thus, it cannot truly
reveal the body of measurement.
Variance
– The squared deviation of a random variable from its mean.
Standard Deviation
– The standard deviation provides the best measure of
dispersion for interval/ratio measurements and is the
most widely used statistical measure after mean.
12
06/02/2023
Example:
– The owner of a cafe is interested in how much people
spend at her cafe.
Example:
– Below is the table for getting the standard deviation:
X (X- 49.2) (X-49.2)2
44 -5.2 27.04
50 0.8 0.64
38 11.2 125.44
96 46.8 2190.24
42 -7.2 51.84
47 -2.2 4.84
50 -9.2 84.64
39 -10.2 104.04
46 -3.2 10.24
50 0.8 0.64
Total 2,600.4
13
06/02/2023
Example:
– Hence, the variance is 289 & the standard deviation is
the square root of 289 = 17.
– The mean for this example was about 49.2 and the
standard deviation was 17.
– We have:
49.2 - 17 = 32.2
49.2 + 17 = 66.2
– What this means is that most of the patrons probably
spend between 32.20 and 66.20.
Empirical Rule
– For a Normal (Symmetric) distribution approximately:
—) 68% of the measurements fall within one standard
deviation (1SD) around the mean.
14
06/02/2023
Standard Deviation
Skewness
15
06/02/2023
Research Software
– Statistical software are specialized computer programs
for statistical & econometric analysis.
What is SPSS?
– Originally it is an acronym of Statistical Package for the
Social Science, now it stands for Statistical Product and
Service Solutions.
16
06/02/2023
Qualitative Research
– Qualitative research is a research technique that allow a
researcher to obtain elaborate interpretations of phenomena
without depending on numerical measurements.
17
06/02/2023
Qualitative Research
– Qualitative technique in business is usually undertaken in
the form of case study.
– Case study is a documented history of a particular person,
group, organization, or event.
– It is an intense examination of one or a few situations
typically:
—) Involves in-depth investigation and careful study
—) Requires cooperation from the investigated subjects
(cases)
– Case analyses are used to develop themes that can help
explain a phenomenon.
Quantitative Research
– Relate to numbers
– Data must be able to be enumerated & presented in
terms of statistical patterns/associations
– Example:
• Cost growth calculations were determined as
positive or negative percentages using Equation 1
(Migliaccio et al. 2010):
𝐶𝑜𝑠𝑡 𝐺𝑟𝑜𝑤𝑡ℎ
𝐹𝑖𝑛𝑎𝑙 𝐶𝑜𝑛𝑠𝑡𝑟𝑢𝑐𝑡𝑖𝑜𝑛 𝑐𝑜𝑠𝑡 − 𝑂𝑟𝑖𝑔𝑖𝑛𝑎𝑙 𝐶𝑜𝑛𝑡𝑟𝑎𝑐𝑡 𝐶𝑜𝑠𝑡
=
𝑂𝑟𝑖𝑔𝑖𝑛𝑎𝑙 𝐶𝑜𝑛𝑡𝑟𝑎𝑐𝑡 𝐶𝑜𝑠𝑡
18
06/02/2023
Summary
– Data Processing is the process of editing, coding,
classification and tabulation of collected data so that they
are amenable to analysis.
– Descriptive analysis includes calculating measures of central
tendency (Mean, Mode and Median) and Measures of
variation (Rang, Variance and Standard Deviation).
– Qualitative research is a research technique that allow a
researcher to obtain elaborate interpretations of phenomena
without depending on numerical measurements as in
Quantitative research.
– There are many statistical software that help in data
analysis. Common software includes SPSS and STATA.
Research Methods
Hypothesis Testing
19
06/02/2023
Learning Objectives
—) Describe the features of hypothesis.
—) Test research hypothesis using parametric test.
—) Test research hypothesis using non-parametric test.
—) Use correlation and regression in data analysis.
Hypothesis Testing
– Basic concepts in hypothesis testing
—) Generally in hypothesis testing, it is based on null
hypothesis.
—) Significance level is the maximum value of the probability
of rejecting the null hypothesis when it is true & usually
determined in advance before testing hypothesis.
—) A significance level of 5% or less is usually taken in
research.
—) Given a null hypothesis H0 and an alternative hypothesis
Ha, we make a rule which is known as decision rule
accept H0 (i.e., Reject Ha) or reject H0 (i.e., Accept
Ha).4
20
06/02/2023
Hypothesis Testing
– Two tailed test is appropriate when we have H0 : µ =
µH0 and Ha : µ ≠ µH0, which may mean µ > µH0 or µ <
µH0 . Thus, in a two-tailed test, there are two rejection
regions, one on each tail of the curve
21
06/02/2023
t-Test
– t-test is based on t-distribution and is considered an
appropriate for:
—) Judging the significance of a sample mean or for judging
the significance of difference between the means of two
samples in case of small sample(s) when population variance
is not known.
—) In case two samples are related, we use paired t-test for
judging the significance of the mean of difference between
the two related samples.
—) It can also be used for judging the significance of the
coefficients of simple and partial correlations.
22
06/02/2023
X1 X 2
t
2 2
(n1 1) s1 (n2 1) s2 n1 n2
n1 n2 2
n1n2
Illustration:
– Samples of daily sales of similar coffee shops in Bedele and
Agaro towns are taken for a new product with the following
results.
Towns Mean Variance Sample size
Bedele 57 5.3 5
Agaro 61 4.8 7
– Is there any evidence of difference in sales in the two towns?
– Use 5% level of significance for testing this difference
between the means of two samples.
– Table value of t (10,5%) = 2.228
23
06/02/2023
Solution:
– Hypothesis
Ho : 𝑋 = 𝑋 , Ha : 𝑋 ≠𝑋
X1 X2 57 61
t 3.053
2 4x5.3 6x4.8
(n1 1)s1 (n2 1)s2 n1 n2
2
12
n1 n2 2 35
n1n2
10
24
06/02/2023
Types of ANOVA
– There are many types of ANOVA:
—) One way ANOVA
—) Two way ANOVA
—) Repeated measure ANOVA
—) Analysis of Covariance (ANCOVA)
—) Multivariate Analysis of Variance (MANOVA)
One-Way ANOVA
– One-way analysis of variance is used to test the claim that
three or more population means are equal.
– This is an extension of the two independent samples t-test.
– The response variable is the variable you’re comparing.
– The factor variable is the categorical variable being used to
define the groups.
– The one-way is because each value is classified in exactly
one way
—) Examples include comparisons by gender, race, political
party, color and so on.
25
06/02/2023
Illustration
– Table below presents units of production per day by
three machines in four days. Test if the average unit of
production per day by the three machines are
statistically different at significant level of 5%.
Per day production by three machines in unit
Days
Machine A Machine B Machine C
1 6 5 5
2 7 5 4
3 3 3 3
4 8 7 4
Total 24 20 16
26
06/02/2023
Solution
Hypothesis Source SS df MS F P(2,9)
Ho: μA =μB= μC, H1: μA ≠μB Between 8 2 4 1.5 4.26
≠ μC Within 24 9 2.67
Total 32 11
𝑋 = (6+7+3+8)/4 =6
𝑋 = (5+5+3+7)/4 =5 Decision Rule: Reject Ho if
𝑋 = (5+4+3+4)/4 =4 F>P
𝑋 = (6+5+4)/4 =5
SSW = (6-6)2+(7-6)2+(3- Conclusion: There is no
significant difference
6)2+(8-6)2
among the mean of the
+(5-5)2+(5-5)2+(3- three machines.
5)2+(7-5)2
+(5-4)2+(4-4)2+(3-
4)2+(4-4)2
27
06/02/2023
28
06/02/2023
29
06/02/2023
30
06/02/2023
Illustration
– Table below shows the data obtained during accounting
research from 250 firms. Test the association between
tax payers category and the choice of recording systems
using 2 at 5% level of significance and determine the
degree of association.
Solution
– Ho: There is no association between tax payers category
and the choice of recording systems.
– Ha: There is an association between tax payers category
and the choice of recording systems.
O E O-E (O-E)2 (O-E)2/E
10 20 -10 100 5.0
40 30 10 100 3.3
30 32 -2 4 0.1
Decision Rule: Reject Ho if 2 > 5.991
50 48 2 4 0.1
60 48 12 144 3.0
Conclusion: 60 72 -12 144 2.0
Reject Ho and Accept Ha 2 13.5
There is an association between tax
payers category and the choice of
recording systems.
31
06/02/2023
Regression Analysis
– Regression analysis is used for prediction.
– It can be simple or multiple regression.
– The different types of multiple regression are given
below. Multiple
Regression
Models
Non-
Linear
Linear
Dummy Inter-
Linear action
Variable
Poly- Square
Log Reciprocal Exponential
Nomial Root
32
06/02/2023
Multivariate Analysis
– Multivariate statistics are increasingly popular
techniques used for analyzing complicated data sets.
– They provide analysis when there are many
independent or many dependent variables that are
correlated with one another to varying degrees.
Multivariate Analysis
– Multivariate statistics are an extension of uni-variate
and bivariate statistics.
– The trick in multivariate statistics is not in
computation; that is easily done by computer.
– The trick is to select
• Reliable & valid measurements
• Choose the appropriate program
• Use it correctly
• Know how to interpret the output
33
06/02/2023
Other Analysis
– Artificial Neural Network (ANN)
– Fuzzy Logic
– Structural Equation Modeling (SEM)
– Time Series Analysis
– Optimization
• Queuing Theory, Linear & non-linear Programing, Ant Colony,
Genetic…..
– Root Cause
• Fault Tree Analysis (FTA), Failure Mode Effect Analysis
(FMEA)….
– Artificial Intelligence (AI)
–
34
06/02/2023
Summary
– Researchers usually formulate two types of hypothesis
in their study. This includes null hypothesis and
alternative hypothesis
Summary
– Non parametric tests do not make any assumption about
the parameters of the population such as U-test, W–
test, two-sample sign test, Fisher-Irwin test, Rank sum
test and so on.
35
06/02/2023
Research Methods
Interpretation
Learning Objectives
—) Understand the methods of interpreting result.
—) Outline elements of research report.
—) Communicate research result through different
means.
—) Understand how to be ethical in research
undertaking.
36
06/02/2023
Data Interpretation
– Data interpretation is adding meaning to the result by
making connections and comparisons and exploring
causes and consequences.
– Things to consider when interpreting your data:
—) Interpret findings based on the purpose/objectives
of your study.
—) Relate the findings to real life context.
—) Use persuasive language to convince your readers to
see the research from your point of view.
—) Order your interpretation to highlight important
findings.
37
06/02/2023
Unanticipated Findings
– Unpredicted relation may be an important key to a
deeper understanding of the theory.
38