Classification: Applications
• Aka Pattern recognition
• Face recognition: Pose, lighting, occlusion
(glasses, beard), make-up, hair style
• Character recognition: Different handwriting
styles.
• Speech recognition: Temporal dependency. – Use of a dictionary or the syntax of the language. –
Sensor fusion: Combine multiple modalities; eg, visual
(lip image) and acoustic for speech
• Medical diagnosis: From symptoms to illnesses
• Web Advertizing: Predict if a user clicks on an ad
on the Internet.
17
Classification
• Everyday, all the time we classify things.
• Eg crossing the street: – Is there a car coming?– At what speed?– How far is it to the other side?–
Classification: Safe to walk or not!!!
Problems in classifying data
• Often high dimension of data.
• Hard to put up simple rules.
• Amount of data.
• Need automated ways to deal with the data.
• Use computers – data processing, statistical
analysis, try to learn patterns from the data
(Machine Learning)
Classification
• Here the goal is to learn a mapping from inputs x to outputs
y,
• Where
y ∈{ 1,...,C}, with C being the number of classes.
• If C =2, this is called binary classification (in which case we
often assume y ∈{ 0,1});
• if C>2, this is called multiclass classification .
• If the class labels are not mutually exclusive (e.g.,
somebody may be classified as tall and strong), we call it
multi-label classification, but this is best viewed as
predicting multiple related binary class labels (a so-called
multiple output model).
• When we use the term “classification”, we will mean
multiclass classification with a single output, unless we
state otherwise.