Machine Learning Notes
UNIT-I: Introduction to Machine Learning
• Evolution of Machine Learning
• Paradigms for ML
• Learning by Rote, Induction, and Reinforcement
• Types of Data
• Matching
• Stages in Machine Learning
• Data Acquisition
• Feature Engineering
• Data Representation
• Model Selection
• Model Learning
• Model Evaluation
• Model Prediction
• Search and Learning
• Data Sets
UNIT-II: Nearest Neighbor-Based Models
• Introduction to Proximity Measures
• Distance Measures
• Non-Metric Similarity Functions
• Proximity Between Binary Patterns
• Different Classification Algorithms Based on Distance Measures
• K-Nearest Neighbor Classifier
• Radius Distance Nearest Neighbor Algorithm
• KNN Regression
• Performance of Classifiers
• Performance of Regression Algorithms
UNIT-III: Models Based on Decision Trees
• Decision Trees for Classification
• Impurity Measures
• Properties of Decision Trees
• Regression Based on Decision Trees
• Bias–Variance Trade-off
• Random Forests for Classification and Regression
The Bayes Classifier
• Introduction to the Bayes Classifier
• Bayes’ Rule and Inference
• The Bayes Classifier and its Optimality
• Multi-Class Classification
• Class Conditional Independence
• Naive Bayes Classifier (NBC)
UNIT-IV: Linear Discriminants for Machine Learning
• Introduction to Linear Discriminants
• Linear Discriminants for Classification
• Perceptron Classifier
• Perceptron Learning Algorithm
• Support Vector Machines
• Linearly Non-Separable Case
• Non-linear SVM
• Kernel Trick
• Logistic Regression
• Linear Regression
• Multi-Layer Perceptrons (MLPs)
• Backpropagation for Training an MLP
UNIT-V: Clustering
• Introduction to Clustering
• Partitioning of Data
• Matrix Factorization
• Clustering of Patterns
• Divisive Clustering
• Agglomerative Clustering
• Partitional Clustering
• K-Means Clustering
• Soft Partitioning
• Soft Clustering
• Fuzzy C-Means Clustering
• Rough Clustering
• Rough K-Means Clustering Algorithm