Regression
After this video you will be able to..
• Define what regression is
• Explain the difference between regression
and classification
• Name some applications of regression
Classification Review
Sunny
Input
Windy
Model Output
Variables Rainy
Cloudy
Classification:
Given input variables,
predict category
Regression
Input
Variables
Model Output
number
Regression:
Given input variables,
predict numeric value
Regression Examples
• Forecast high temperature for
next day
• Estimate average house price
for a region
• Determine demand for a new
product
• Predict power usage
Regression is Supervised
Input Variables Target Variable Target is
provided
Today’s Today’s Month Tomorrow’s
High Low High
79 64 July 81
60 45 October 58
68 49 May 65
57 47 January 54
Training vs. Testing Phases
Training
Data Build
Model
Model
Learning
Algorithm Training Phase
Test
Data Apply
Results
Model
Model
Testing Phase
Datasets
Training Validation Test
Data Data Data
Adjust model Determine Evaluate
parameters when to stop performance
training (avoid on new data
overfitting)
Estimate
generalization
performance
Regression Main Points
• Predict number from input variables
• Regression is a supervised task
• Target variable is numerical
Input
Variables Model Output
number