0% found this document useful (0 votes)
2 views9 pages

Notes - Underfitting, Overfitting, Generalization

The document explains the concepts of generalization, overfitting, and underfitting in machine learning. Generalization refers to a model's ability to perform well on unseen data, while overfitting occurs when a model memorizes training data, leading to poor performance on new data. Underfitting happens when a model is too simple to learn patterns, resulting in low accuracy on both training and test data.
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
2 views9 pages

Notes - Underfitting, Overfitting, Generalization

The document explains the concepts of generalization, overfitting, and underfitting in machine learning. Generalization refers to a model's ability to perform well on unseen data, while overfitting occurs when a model memorizes training data, leading to poor performance on new data. Underfitting happens when a model is too simple to learn patterns, resulting in low accuracy on both training and test data.
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Generalization, Overfitting, Underfitting

Generalization
Simple Meaning:
Generalization means how well a model performs on new, unseen
data.
• If a student studies concepts properly, they can solve new
questions in the exam.
• If a machine learning model learns patterns properly, it can
predict new data correctly.
Example:
If we train a model to predict student marks:
• It performs well on training data ✔
• It also performs well on new test data ✔
➡ That means the model has good generalization.
One-line definition:
Generalization is the ability of a model to perform well on new,
unseen data.

Overfitting
Simple Meaning:
Overfitting happens when the model memorizes the training data
instead of learning patterns.
• Like a student who memorizes answers instead of
understanding concepts.
What happens?
• Very high training accuracy
• Poor test accuracy
• Model becomes too complex
Real-life Example:
A student memorizes last year’s question paper.
In the exam, questions are slightly changed → student fails.
Visual Idea:
• Model fits training data too perfectly
• Even fits noise and small errors
One-line definition:
Overfitting means the model learns the training data too well,
including noise, and fails on new data.

Underfitting
Simple Meaning:
Underfitting happens when the model is too simple and cannot
learn the pattern properly.
• Like a student who didn’t study enough.
What happens?
• Low training accuracy
• Low test accuracy
• Model is too simple
Real-life Example:
Student studies only headings, not details → fails in both practice test
and final exam.
One-line definition:
Underfitting means the model is too simple and fails to learn the
pattern of the data.

Quick Comparison Table (Very Easy to Explain)


Training Test
Concept Problem
Accuracy Accuracy
Good
Good Model High High
Generalization

Overfitting Very High Low Memorizing


Underfitting Low Low Not learning

• Underfitting → Didn't study


• Good Fit → Studied properly
• Overfitting → Memorized only answers

Bias–Variance Curve (Graphical Explanation)


Underfitting (High Bias)
Simple Explanation
• The model is too simple
• It cannot capture the real pattern
• Training error = High
• Test error = High
Example: Using a straight line to fit curved data.
Concept:
• High Bias
• Low Variance
• Model makes strong assumptions
One-line:
Underfitting = Model is too simple to learn the pattern.

High Bias
What is Bias?
Bias means wrong assumptions.
If a model has high bias, it:
• Assumes things are very simple
• Ignores the real pattern
• Oversimplifies the problem
It is like forcing a straight line on curved data.
Student Analogy:
A student studies only basic definitions and ignores detailed concepts.
So in the exam, they cannot solve application-based questions.
One-line:
High Bias = Model is too simple and makes strong wrong assumptions.

Low Variance
What is Variance?
Variance means how much the model changes when the data changes.
If a model has low variance, it:
• Does not change much with different training data
• Gives almost similar results
• Is stable but maybe too simple
A straight line model will always look similar even if data slightly changes.
Student Analogy:
A student always writes the same basic answer format, no matter what
question is asked.
One-line:
Low Variance = Model does not change much even if training data changes.

Together: High Bias + Low Variance


This combination means:

• Model is too simple

• It does not learn enough

• It consistently performs poorly


This leads to Underfitting

In short Explanation
High Bias means the model is too simple.
Low Variance means the model is very stable and doesn’t change much.
Together, this causes Underfitting.

Super Simple Memory Trick


• Bias → Simplicity problem
• Variance → Stability problem

Overfitting (High Variance)


• Model fits every data point perfectly
• Even fits noise
• Training error = Very low
• Test error = High

Example: Very wavy curve touching every point.


• Concept:
• Low Bias
• High Variance
• Too complex model

• One-line:
• Overfitting = Model memorizes training data including noise.

Perfect Balance (Good Generalization)


Model captures real pattern
Ignores noise
Training error = Low
Test error = Low

This is called:

Bias–Variance Tradeoff

The Actual Bias–Variance Tradeoff Curve


Graph Explanation
• X-axis → Model Complexity
• Y-axis → Error
Then explain:
1. Left side → Model too simple → Underfitting
2. Right side → Model too complex → Overfitting
3. Middle point → Optimal model → Best generalization

Super Simple Memory Trick for Students


When model complexity increases, training error always
decreases.
But test error first decreases and then increases.
Left side = Underfitting (High Bias)
Right side = Overfitting (High Variance)
Middle = Best Model (Balanced Bias & Variance)

High Bias → Underfitting


High Variance → Overfitting
Balanced → Good Model

You might also like