DATA PRE-
PROCESSING IN ML
KSI Microsoft AEP [Link]
DATA PRE-PROCESSING
• Data pre-processing is one of the most
important steps when we create any
ML model.
• There are different data pre-processing
tools and we use them depending upon
the data set we have.
• Our first implementation will be with
all the tools.
KSI Microsoft AEP [Link]
IMPORTING LIBRARIES
• These are the generic libraries
which we are going to use in all
the ML models.
KSI Microsoft AEP [Link]
IMPORTING DATA SET
• The next step in data pre-
processing is to import you
data set.
• All the data set contains
features and the dependent
variable thus it is divided
into the matrix of
independent
variable(features) and a
vector of dependent
variable.
KSI Microsoft AEP [Link]
TAKING CARE OF MISSING DATA
• The missing data in your data set can
produce unwanted results therefore it
is very important to take care of the
missing data.
• There are two ways to do it:
1. to ignore the missing data
2. To replace the missing the data
KSI Microsoft AEP [Link]
ENCODING CATEGORIAL DATA(1/2)
• Most of the time in our data set
we have categorial data which
is to encoded and converted
into numerical values.
• This will prevent the ML
model from creating
unnecessary co-relation
between the features and the
dependent variable.
KSI Microsoft AEP [Link]
ENCODING CATEGORIAL DATA(2/2)
KSI Microsoft AEP [Link]
SPLITTING THE DATA SET INTO TRAINING SET
AND TEST SET
• The data set from the previous
steps is further divided into
training set and test set.
• The training set is the set on
which you will train your ML
model.
• The test set is assumed as the
future set on which you are
going to test your model.
KSI Microsoft AEP [Link]
FEATURE SCALING
• Feature scaling is the
process of scaling of our
variables/features to take
the same scale, and we do
this to prevent one feature
dominating the other.
KSI Microsoft AEP [Link]
THANK YOU
KSI Microsoft AEP [Link]