Introduction to the course
Two-Day Weekend Training Programme
on
Introduction to Machine Learning
Instructors: Prof. Pawan Goyal and Prof. Sourangshu Bhattacharya
What Is Machine Learning?
• Automating automation
• Getting computers to program themselves
• Writing software is the bottleneck
• Let the data do the work instead!
Traditional Programming
Data
Computer Output
Program
Machine Learning
Data
Computer Program
Output
Magic?
No, more like gardening
• Seeds = Algorithms
• Nutrients = Data
• Gardener = You
• Plants = Programs
Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging
• [Your favorite area]
ML in a Nutshell
• Tens of thousands of machine learning
algorithms
• Hundreds new every year
• Every machine learning algorithm has three
components:
• Representation
• Evaluation
• Optimization
Representation
• Decision trees
• Sets of rules / Logic programs
• Instances
• Graphical models (Bayes/Markov nets)
• Neural networks
• Support vector machines
• Model ensembles
• Etc.
Evaluation
• Accuracy
• Precision and recall
• Squared error
• Likelihood
• Posterior probability
• Cost / Utility
• Margin
• Entropy
• K-L divergence
• Etc.
Optimization
• Combinatorial optimization - E.g.: Greedy search
• Convex optimization - E.g.: Gradient descent
• Constrained optimization - E.g.: Linear programming
Types of Learning
• Supervised (inductive) learning
• Training data includes desired outputs
• Unsupervised learning
• Training data does not include desired outputs
• Semi-supervised learning
• Training data includes a few desired outputs
• Reinforcement learning
• Rewards from sequence of actions
Supervised Learning
3
H 2.5
e
i 2.2
g 2
h
t
Cat Dog Dog Cat …..
Classification
Regression
Unsupervised Learning
Group1
Group2
Clustering
Similarity between data points. No labels
What will we cover in this course?
• Supervised Learning
– Classification and Regression, generalization
– Methods: Neural Networks, Support Vector
Machines, Probabilistic Graphical Models
– Ensemble Methods: Bagging, Boosting, Random
Forests
• Unsupervised Learning
– Clustering and Dimensionality Reduction