Scribd
Upload
5 views12 pages

Ensemble Learning Techniques Explained

Ensemble Learning is a supervised machine learning technique that enhances performance by combining predictions from multiple models. Key methods include Voting, Bootstrap Aggregation (Bagging), Random Forests, Boosting, and Stacked Generalization (Blending). Each method aims to improve accuracy and stability while addressing issues like overfitting and variance.

Uploaded by

madhura gangaiah
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
5 views12 pages

Ensemble Learning Techniques Explained

Ensemble Learning is a supervised machine learning technique that enhances performance by combining predictions from multiple models. Key methods include Voting, Bootstrap Aggregation (Bagging), Random Forests, Boosting, and Stacked Generalization (Blending). Each method aims to improve accuracy and stability while addressing issues like overfitting and variance.

Uploaded by

madhura gangaiah
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd

ENSEMBLE LEARNING MODULE 3

ENSEMBLE
LEARNING
ENSEMBLE LEARNING

• Ensemble Learning is a Supervised learning technique used in machine


learning to improve overall performance by combining the predictions
from multiple models
ENSEMBLE LEARNING • Voting(Averaging)
– TYPES OF ENSEMBLE • Bootstrap Aggregation(Bagging)
METHODS
• Random Forests
• Boosting
• Stacked Generalization
(Blending)
ENSEMBLE LEARNING-
VOTING(AVERAGING)
Voting is an ensemble Machine Learning
algorithm that involves making a prediction that
is average (regression) or the sum(classification)
of multiple machine learning models
ENSEMBLE
LEARNING –
BOOTSTRAPPIN
G
AGGREGATION
(BAGGING)
ENSEMBLE LEARNING – BOOTSTRAPPING
AGGREGATION (BAGGING)
• Bootstrap Aggregating, also known as bagging, is a machine learning ensemble
meta algorithm designed to improve the stability and accuracy of the machine
learning algorithms like classification and regression.
• It decreases the variance and helps to avoid overfitting.
• It is usually applied to decision tree methods
• Bagging is a special case of the model averaging approach.
ENSEMBLE
LEARNING
– RANDOM
FOREST
ENSEMBLE LEARNING – RANDOM
FOREST
• Random Forest is a commonly used Machine Learning algorithm
• A Random forest is an ensemble learning method where multiple decision trees
are constructed and then they are managed to get a more accurate prediction
ENSEMBLE LEARNING – BOOSTING

• Boosting is an Ensemble modeling technique that attempts to build a strong


classifier from the number of weak classifiers
• It is done by building a model using weak model in series
• At first, a model is built from the training data
• Then the second model is built which tries to correct the errors present in the
first model
• This procedure is continued and models are added until either the complete
dataset is predicted correctly or the maximum number of models are added
ENSEMBLE
LEARNING
–
BOOSTING
ENSEMBLE LEARNING –
STACKED
GENERALIZATION(BLENDIN
G)

You might also like