Scribd
Upload
4 views3 pages

Model Evaluation Using Confusion Matrix

The document explains the confusion matrix, a tool for evaluating model performance by comparing predicted outcomes to actual results. It details four categories: True Positive, True Negative, False Positive, and False Negative, and introduces key metrics derived from the confusion matrix, including Accuracy, Precision, Recall, F1-Score, and Specificity. Each metric provides insights into different aspects of model performance, particularly in the context of classification tasks.

Uploaded by

athiraatraju06
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
4 views3 pages

Model Evaluation Using Confusion Matrix

The document explains the confusion matrix, a tool for evaluating model performance by comparing predicted outcomes to actual results. It details four categories: True Positive, True Negative, False Positive, and False Negative, and introduces key metrics derived from the confusion matrix, including Accuracy, Precision, Recall, F1-Score, and Specificity. Each metric provides insights into different aspects of model performance, particularly in the context of classification tasks.

Uploaded by

athiraatraju06
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Model evaluation using Confusion Matrix

Confusion matrix is a simple table used to measure how well a model is performing. It compares
the predictions made by the model with the actual results and shows where the model was
right or wrong. This helps to understand where the model is making mistakes so we can
improve it. It breaks down the predictions into four categories:

• True Positive (TP): The model correctly predicted a positive outcome i.e the actual
outcome was positive.

• True Negative (TN): The model correctly predicted a negative outcome i.e the actual
outcome was negative.

• False Positive (FP): It occurs when the model incorrectly predicts a positive instance but
the actual instance is negative. It is also known as a Type I error. Type 1 Errors affect
the precision of a model which measures the accuracy of positive predictions.

• False Negative (FN): This occurs when the model fails to predict a positive instance even
though it is actually positive. This is also known as a false negative. It is also known as a
Type II error. Type 2 Errors impact the recall of a model which measures how well the
model identifies all actual positive cases.

Metrics based on Confusion Matrix Data

1. Accuracy

• Accuracy shows how many predictions the model got right out of all the
predictions. It gives idea of overall performance but it can be misleading when
one class is more dominant over the other. For example, a model that predicts
the majority class correctly most of the time might have high accuracy but still
fail to capture important details about other classes. It can be calculated using
the below formula:
𝑇𝑃 + 𝑇𝑁
Accuracy =
𝑇𝑃 + 𝑇𝑁 + 𝐹𝑃 + 𝐹𝑁

2. Precision

• Precision focus on the quality of the model’s positive predictions. It tells us


how many of the "positive" predictions were actually correct. It is important in
situations where false positives need to be minimized such as detecting spam
emails or fraud. The formula of precision is:
𝑇𝑃
Precision =
𝑇𝑃 + 𝐹𝑃

3. Recall

• Recall measures how good the model is at predicting positives. It shows the
proportion of true positives detected out of all the actual positive instances.
High recall is essential when missing positive cases has significant
consequences like in medical tests.
𝑇𝑃
Recall =
𝑇𝑃 + 𝐹𝑁

4. F1-Score

• F1-score combines precision and recall into a single metric to balance their
trade-off. It provides a better sense of a model’s overall performance
particularly for imbalanced datasets. It is helpful when both false positives and
false negatives are important though it assumes precision and recall are
equally important but in some situations one might matter more than the
other.
2 ⋅ 𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 ⋅ 𝑅𝑒𝑐𝑎𝑙𝑙
F1-Score =
𝑃𝑟𝑒𝑐𝑖𝑠𝑖𝑜𝑛 + 𝑅𝑒𝑐𝑎𝑙𝑙
5. Specificity

• Specificity is another important metric in the evaluation of classification


models particularly in binary classification. It measures the ability of a model to
correctly identify negative instances. Specificity is also known as the True
Negative Rate Formula is given by:
𝑇𝑁
Specificity =
𝑇𝑁 + 𝐹𝑃

You might also like