Scribd
Upload
8 views36 pages

Data Mining: Supervised vs. Unsupervised

The document outlines a lecture on data mining, focusing on supervised and unsupervised learning, classification, and regression. It details the classification process, including model construction, evaluation, and prediction, as well as decision tree induction and attribute selection measures. Additionally, it covers classifier evaluation metrics and classification measures.

Uploaded by

محمد عبد المحمود
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
8 views36 pages

Data Mining: Supervised vs. Unsupervised

The document outlines a lecture on data mining, focusing on supervised and unsupervised learning, classification, and regression. It details the classification process, including model construction, evaluation, and prediction, as well as decision tree induction and attribute selection measures. Additionally, it covers classifier evaluation metrics and classification measures.

Uploaded by

محمد عبد المحمود
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

‫‪Data Mining‬‬

‫تعدين البيانات‬
‫محاضرة رقم (‪)8 + 7‬‬

‫‪1‬‬
Outline:

2
Supervised vs. Unsupervised Learning

3
Example: Supervised vs. Unsupervised

4
Prediction Problems: Classification vs. Regression

5
Example: Supervised vs. Unsupervised

6
Typical applications of classification

7
Classification Process: 3 steps

8
Step 1 : Model Construction (Learning)

9
Step 2 : Model Evaluation

10
Step 3 : Using the Model in Prediction

11
Decision Tree Induction

12
Decision Tree Induction Example

13
Decision Tree Induction Example

14
Attribute Partitioning Scenario

15
Attribute selection measures

16
Attribute selection measures (1): Information Gain (ID3)

17
Entropy using one attribute Frequency: Expected
Information “Entropy”

18
Entropy using one attribute Frequency: Expected
Information “Entropy”

19
Entropy using two attribute Frequency
Information: Conditional Entropy

20
Entropy using two attribute Frequency
Information: Conditional Entropy

21
Information Gain:

22
Information Gain..

23
Information Gain..

24
Constructing Decision Tree: ID3

25
Constructing Decision Tree: ID3 ..

Sunny

Outlook

26
Constructing Decision Tree: ID3 ..
Decision Tree Rules:

27
Constructing Decision Tree: ID3 ..
Final Results:

28
Prediction using Classification Model: Example

29
Model Evaluation and Selection:

30
Classifier Evaluation Metrics: Confusion Matrix

31
Classifier Evaluation Metrics: Accuracy and Error Rate

32
Classifier Evaluation Metrics:

33
Classification measures:

(TP + TN )/(P + N)

TP/P

TP/(TP + FP)

34
Classification measures..

35
THE END..

36

You might also like