Introduction to Machine
Learning
Outcome: Identify a Machine Learning technique for the
given problem and understand the concepts of Training Error,
Generalization Error, Overfitting and Underfitting.
- Neha Surti
[Link]
What is Machine Learning?
Automated Analytics
Machines build analytical models
Pattern Recognition
Identify trends from data
Intelligent Decisions
Make choices based on learning
Machine learning enables systems to learn from data, identify hidden
patterns, and make informed decisions without explicit programming.
Common applications include spam detection and personalized
recommendations.
[Link]
Types of Machine Learning
Supervised Learning Unsupervised Semi-supervised Reinforcement
Learning Learning Learning
• Labeled data trains
models • Finds patterns in • Small labeled + large • Agent learns through
• Classification, unlabeled data unlabeled data rewards/punishments
Regression tasks • Clustering, Association
rules
Different learning types address varied problem sets, from predicting outcomes with labeled data to enabling agents to learn
optimal behaviors through trial and error.
[Link]
Issues in Machine Learning
[Link]
Applications of Machine Learning
Healthcare Finance Marketing
Disease prediction Fraud detection Customer segmentation
Manufacturing Autonomous Vehicles
Predictive maintenance Object recognition
Machine learning transforms industries by automating complex tasks and extracting valuable insights from vast datasets across
diverse sectors.
[Link]
Developing a Machine Learning Application
Define Problem Evaluate Model
Clearly state objective Assess performance metrics
Collect & Prepare Data Tune Parameters
Gather, clean, transform Optimize model settings
Choose Model Deploy Model
Select appropriate algorithm Integrate into system
Train Model Monitor & Maintain
Fit model to data Ensure ongoing performance
A structured development lifecycle ensures thoroughness, from initial problem definition to continuous model monitoring and
maintenance in production. [Link]
Training Error vs. Generalization Error
Training Error Generalization Error
Model's performance on known data Model's performance on unseen data
• Calculated during learning • True measure of model utility
• Reflects model fit to seen examples • Indicates real-world applicability
A robust machine learning model aims to minimize both training error and generalization error, ensuring it performs well on
both familiar and novel data.
[Link]
Overfitting and Underfitting
1 Underfitting
Model is too simple
• Fails to capture patterns
• High training and test error
2 Overfitting
Model is too complex
• Fits training data too well
• Poor performance on new data
These two common issues highlight the challenge of finding the right
model complexity to achieve optimal predictive power.
[Link]
Bias-Variance Trade-off
Striking the optimal balance between bias and variance is key to building accurate and robust machine learning models.
Optimal Balance
Best performance
High Bias
Underfitting risk
High Variance
Overfitting risk
[Link]
Thank You
[Link]