Savitribai Phule Pune University
Honours* in Data Science
Third Year of Engineering (Semester VI)
310503: Statistics and Machine Learning
Teaching Scheme Credit Scheme Examination Scheme and Marks
Lecture: 04 Hours/Week 04 Mid_Semester(TH): 30 Marks
End_Semester(TH): 70 Marks
Prerequisites: Date Science and Visualization
Companion Course :Machine learning
Course Objectives:
1. To understand basis of statistics and mathematics for Machine Learning
[Link] understand basis of descriptive statistics measures and hypothesis
[Link] learn various statistical inference methods
4. To introduce basic concepts and techniques of Machine Learning
5. To learn different linear regression methods used in machine learning
6. To learn Classification models used in machine learning
Course Outcomes:
On completion of the course, learner will be able to–
CO1: Apply appropriate statistical measure for machine learning applications
C02: Usage of appropriate descriptive statistics measures for statistical analysis
C03: Usage of appropriate statistics inference for data analysis
CO4: Identify types of suitable machine learning techniques
CO5: Apply regression techniques to machine learning problems
CO6: Apply decision tree and Naïve Bayes model to solve real time applications
Course Contents
Unit I Statistical Inference I (07 Hours)
Types of Statistical Inference, Descriptive Statistics, Inferential Statistics, Importance of Statistical
Inference in Machine Learning. Descriptive Statistics, Measures of Central Tendency: Mean, Median,
Mode, Mid-range, Measures of Dispersion: Range, Variance, Mean Deviation, Standard Deviation.
One sample hypothesis testing, Hypothesis, Testing of Hypothesis, Chi-Square Tests, t-test, ANOVA
and ANOCOVA. Pearson Correlation, Bi-variate regression, Multi-variate regression, Chi-square
statistics.
#Exemplar/Case For a payroll dataset create Measure of central tenancy and its measure of
Studies dispersion for statistical analysis of given data.
Unit II Statistical Inference II (07 Hours)
Measure of Relationship: Covariance, Karl Pearson’s Coefficient of Correlation, Measures of Position:
Percentile, Z-score, Quartiles, Bayes’ Theorem, Bayes Classifier, Bayesian network, Discriminative
learning with maximum likelihood, Probabilistic models with hidden variables, Linear models,
regression analysis, least squares.
#Exemplar/Case Create a probabilistic model for credit card fraud detection
Studies
Unit III Linear Algebra and Calculus (07 Hours)
Linear Algebra: Matrix and vector algebra, systems of linear equations using matrices, linear
independence, Matrix factorization concept/LU decomposition, Eigen values and eigenvectors.
Understanding of calculus: concept of function and derivative, Multivariate calculus: concept, Partial
Derivatives, chain rule, the Jacobian and the Hessian
#Exemplar/Case Explore statistical inference for Financial Statement Fraud Detection
Studies
Unit IV Introduction to machine learning (07 Hours)
What is Machine Learning? Well posed learning problems, Designing a Learning system,Machine
Learning types-Supervised learning, Unsupervised learning, and Reinforcement Learning, Applications
of machine learning, Perspective and Issues in Machine Learning
#Exemplar/Case Explore use of machine learning in NETFLIX as case study
Studies
Unit V Regression Model (07 Hours)
Introduction, types of regression. Simple regression- Types, Making predictions, Cost function,
Gradient descent, Training, Model evaluation.
Multivariable regression : Growing complexity, Normalization, Making predictions, Initialize weights,
Cost function, Gradient descent, Simplifying with matrices, Bias term, Model evaluation
#Exemplar/Case Machine Learning for Health Data Analytics: A Few Case Studies of
Studies Application of Regression Machine Learning for Health Data Analytics by
Iyyanki Murali krishna ,Prisilla Jayanthi and Valli Manickam
Unit VI Classification Models (08 Hours)
Decision tree representation, Constructing Decision Trees, Classification and Regression Trees,
hypothesis space search in decision tree learning
Bayes' Theorem, Working of Naïve Bayes' Classifier, Types of Naïve Bayes Model, Advantages,
Disadvantages and Application of Naïve Bayes Model
#Exemplar/Case Explore decision tree model for customer churns
Studies
Learning Resources
Text Books:
1. Tom M. Mitchell, Machine Learning, India Edition 2013, McGraw Hill Education.
2. S.P. Gupta, Statistical Methods, Sultan Chand and Sons, New Delhi, 2009,
3. Kothari C.R., “Research Methodology. New Age International, 2004, 2nd Ed; ISBN:13: 978-
81-224-1522-3.
Reference Books:
1. Peter Harrington, Machine Learning In Action, DreamTech Press [Link]: 9781617290183
2. Alpaydin, Ethem. Machine learning: the new AI. MIT press, 2016, ISBN: 9780262529518
3. Stephen Marsland, Machine Learning An Algorithmic Perspective, CRC Press, ISBN: :
978-1-4665-8333-7
e-Books/ Articles:
1. Johan Perols (2011) Financial Statement Fraud Detection: An Analysis of Statistical and
Machine Learning Algorithms. AUDITING: A Journal of Practice & Theory: May 2011,
Vol. 30, No. 2, pp. 19-50.
2. Panigrahi, Suvasini, et al. "Credit card fraud detection: A fusion approach using
Dempster–Shafer theory and Bayesian learning." Information Fusion 10.4 (2009): 354-
363.
MOOC/ Video Lectures available at:
[Link]
[Link]