Classification and Model Evaluation Guide
Classification and Model Evaluation Guide
• xi 2 Rd , y i 2 {+1, 1}
Linear separator
Classification Illustration 1
x y f g k f I
I ti t f
0,0 4 x x
I I I
0,1
X
I ti t l z
1 0
I
4 4 I I I y
2 ti
3,43 l l I g
l l l
4,3
I i J
X X l
K
O I 2 3 4
f X X O
2 Loss
f
e
sign o
g x sign x 2K
Loss g
tch
Classification Illustration 2
Area Price Rooms
11 7.1 +1
was t
H l
Glx sign price f
h X sign Price 9
Evaluating Learned Models : Test Data
• But evaluating the learned model must not be done on the training data itself.
• Use test data that is not in the training data for model evaluation.
a fix Ii if f
4 x x 1
if X
x
9
3 1 other w
L
IX
I i J
X X l
X
O I 2 3 4
Model Selection : Validation Data