Machine Learning and Data Science
Module 08: Machine Learning with Python
Section Topics
Background of Machine Learning
8.1.1 Overview of Machine Learning
8.1.2 Categories of Machine Learning Algorithm
8.1.3 Parametric and Non-Parametric Machine Learning Algorithm
8.1.4 Supervised, Unsupervised and Semi-supervised Learning
[Link] Difference among Regression, Classification, Clustering and
8.1
Dimensionality Reduction Technique in Machine Learning
8.1.5 The Bias-Variance Trade-Off
8.1.6 Overfitting and Underfitting
8.1.7 How to Detect Overfitting and Underfitting?
8.1.8 Reasons for Overfitting anf Underfitting
8.1.9 How to Prevent Overfitting and Underfitting?
Popular Machine Learning Algorithms
Linear Machine Learning Algorithms
[Link] Linear Regression
8.2.1
[Link] Logistic Regression
[Link] Linear Discriminant Analysis
Non-Linear Machine Learning Algorithms
[Link] Classification and Regression Trees
8.2 [Link] Naive Bayes
8.2.2 [Link] K Nearest Neighbour
[Link] K-Means
[Link] Linear Vector Quantization
[Link] Support Vector Machine
Ensemble Algorithms
8.2.3 [Link] Bagging and Random Forest
[Link] Boosting and AdaBoost
Implementation of Machine Learning Algorithms in Python
How To Load Machine Learning Data
8.3.1 [Link] Load CSV File with NumPy
[Link] Load CSV File with Pandas
Understand Your Data with Descriptive Statistics
[Link] Peek the Data
[Link] Dimensions of the Data
[Link] Data Type of Each Attribute
8.3.2
[Link] Descriptive Statistics
[Link] Number of Class Distribution
[Link] Correlations between Attributes
[Link] Skew of Univariate Distributions
Understand Your Data with Visualization
Univariate Plots
[Link] [Link].1 Histogram
8.3.3 [Link].2 Density Plots
[Link].3 Box and Whisker Plots
8.3 Multivariate Plots
[Link] [Link].1 Correlation Matrix Plot
[Link].2 Scatter Plot Matrix
Data Pre-processing
[Link] Needs for Data Pre-processing
[Link] Rescale Data
8.3.4
[Link] Standardize Data
[Link] Normalize Data
[Link] Binarize Data (Make Binary)
Feature Selection for Machine Learning
[Link] Needs for Feature Selection
[Link] Univariate Selection
8.3.5
[Link] Recursive Feature Elimination
[Link] Principal Component Analysis
[Link] Feature Importance using Bagged decision trees
Train and Test Dataset Split
8.3.6
[Link] Split into Train and Test Sets
[Link] K-fold Cross Validation
[Link] Leave One Out Cross Validation
[Link] Repeated Random Test-Train Splits
Performance Matrix
Classification Metrics
[Link].1 Classification Accuracy
[Link] [Link].2 Logarithmic Loss
[Link].3 Area Under ROC Curve
8.3.7 [Link].4 Confusion Matrix
[Link].5 Classification Report
Regression Metrics
[Link] [Link].1 Mean Absolute Error
[Link].2 Mean Squared Error
[Link].3 R Squared Metric
Spot-Check Classification Algorithms
Linear Classification Algorithms
[Link] [Link].1 Logistic Regression
[Link].2 Linear Discriminant Analysis
8.3.8 Non-linear Classification Algorithms
[Link].1 k-Nearest Neighbors
[Link] [Link].2 Naive Bayes
[Link].3 Classification and Regression Trees
[Link].4 Support Vector Machines
Spot-Check Regression Algorithms
Linear Regression Algorithms
[Link].1 Linear Regression
[Link] [Link].2 Ridge Regression
8.3.9 [Link].3 LASSO Linear Regression
[Link].4 Elastic Net Regression
Non-linear Regression Algorithms
[Link] [Link].1 k-Nearest Neighbors
[Link].2 Classification and Regression Trees
[Link].3 Support Vector Machines
8.3.10 Compare Machine Learning Algorithms
Automate Machine Learning Workflows with Pipelines
8.3.11 [Link] Data Preparation and Modeling Pipeline
[Link] Feature Extraction and Modeling Pipeline
Performance Improvement with Ensembles
8.3.12
[Link] Combine Models Into Ensemble Predictions
[Link].1 Bagging Algorithms
[Link].1.1 Concepts of Begging Algorithm
[Link].1.2 Random Forest
Boosting Algorithms
[Link].2 [Link].2.1 Concepts of Boosting Algorithm
[Link].2.2 AdaBoost
[Link].3 Voting Ensemble
Performance Improvement with Algorithm Tuning
8.3.13 [Link] Grid Search Parameter Tuning
[Link] Random Search Parameter Tuning