Chapter 4: Classification – Complete Summary
1. Definition
Classification is a supervised learning technique that assigns data instances to predefined classes
based on their features.
2. Main Classification Algorithms
1 Decision Tree: Rule-based, easy to interpret.
2 k-NN: Instance-based, uses distance measures.
3 Naive Bayes: Probabilistic, based on Bayes theorem.
4 SVM: Finds optimal separating hyperplane.
5 Neural Networks: Inspired by human brain.
3. Algorithm Comparison
Algorithm Advantages Disadvantages
Decision Tree Easy to understand Overfitting
k-NN Simple, no training Slow prediction
Naive Bayes Fast, scalable Independence assumption
SVM High accuracy Complex tuning
ANN Powerful Needs large data
4. Mind Map (Textual)
Classification → Supervised Learning → Algorithms → {Decision Tree, k-NN, Naive Bayes, SVM,
ANN} → Evaluation → {Accuracy, Precision, Recall, F1-score}
5. Short Exam
1 Q1: Define classification.
2 Q2: What is the main assumption of Naive Bayes?
3 Q3: Which algorithm uses distance measures?
4 Q4: Give one advantage and one disadvantage of Decision Trees.
5 Q5: What metric is best when data is imbalanced?