Machine
Learning
S. Sridhar and M. Vijayalakshmi
© Oxford University Press 2021. All rights reserved
Chapter 8
Bayesian Learning
© Oxford University Press 2021. All rights reserved
Bayesian Learning
© Oxford University Press 2021. All rights reserved
Fundamentals of Bayes Theorem
© Oxford University Press 2021. All rights reserved
Classification Using Bayes Model
© Oxford University Press 2021. All rights reserved
Maximum A Posteriori (MAP) Hypothesis, hMAP
© Oxford University Press 2021. All rights reserved
Maximum Likelihood (ML) Hypothesis, hML
© Oxford University Press 2021. All rights reserved
Naïve Bayes Algorithm
ZERO PROBABILITY ERROR
Zero-probability error can be solved by applying a smoothing technique called Laplace correction which means
given 1000 data instances in the training dataset, if there are zero instances for a particular value of a feature we
can add 1 instance for each attribute value pair of that feature which will not make much difference for 1000 data
instances and the overall probability does not become zero.
© Oxford University Press 2021. All rights reserved
Brute Force Bayes Algorithm
© Oxford University Press 2021. All rights reserved
Bayes Optimal Classifier
© Oxford University Press 2021. All rights reserved
Gibbs Algorithm
© Oxford University Press 2021. All rights reserved
Naïve Bayes Algorithm For Continuous Attributes
GAUSSIAN NAIVE BAYES ALGORITHM
IN GAUSSIAN NAIVE BAYES, THE VALUES OF CONTINUOUS FEATURES ARE ASSUMED TO BE
SAMPLED FROM A GAUSSIAN DISTRIBUTION.
© Oxford University Press 2021. All rights reserved
Other Popular Types of Naive Bayes Classifiers
© Oxford University Press 2021. All rights reserved
Summary
© Oxford University Press 2021. All rights reserved