• Data is growing at a phenomenal rate
• Users expect more sophisticated information
• UNCOVER HIDDEN INFORMATION – Data Mining
• Finding hidden information in a database
• Fit data to a model
• Similar terms
• Exploratory data analysis
• Data driven discovery
• Deductive learning (Instructer centred approach)
Traditional
WAYS Data mining access
database access
QUERY Might not be well Miner needs exact
formed or precisely data
stated
DATA Different version Data to be cleansed
and modified to
better support
OUTPUT Not a subset of data Output of some
analysis of the
contents of database
Database
• Find all credit applicants with last name of Smith.
• Identify customers who have purchased more than $10,000 in the last month
• Find all customers who have purchased milk
Data Mining
• Find all credit applicants who are poor credit risks. (classification)
• Identify customers with similar buying habits. (Clustering)
• Find all items which are frequently purchased with milk. (association rules)
• Involves algorithm to accomplish different tasks.
Data Mining Algorithm
• Objective: Fit Data to a Model
• Descriptive-Identifies patterns or relationship in data
• Predictive-Prediction about values of data using known results
from different data ,based on historical data (past data)
• Preference – Technique to choose the best model
• Search –Technique to search the data– “Query “
DATA MINING
PREDICTIVE DESCRIPTIVE
CLASSIFICATION CLUSTERING
REGRESSION SUMMARIZATION
TIME SERIES ANALYSIS ASSOCIATION RULES
PREDICTION SEQUENCE DISCOVERY
Classification maps data into predefined groups or classes
• Supervised learning – learn from the previous data with human assistance
• Pattern recognition – type of classification ,data is classified based on the
predefined classes
• Example: Predicting terrorists among the passengers by the patterns
Regression is used to map a data item to a real valued prediction variable.
Example: linear regression explains the relationship between age and height of
the person
Value of an attribute changes over time
Type of classification ,for predicting the flood ,speech recognition
• Similar to classification ,except groups are not predefined ,but defined by the data
• Accomplished by determining the similarity among the data
• Alternatively called as unsupervised learning or segmentation .(makes data
as segments )
• Expert need to interpret the meaning of clusters
• Summarization maps data into subsets with associated simple descriptions.
• Characterization
• Generalization
• Example : Calculating mean ,median ,mode in the data
Link Analysis uncovers relationships among data.
• – Affinity Analysis
• – Association Rules
• Example – Market basket analysis
Sequential Analysis determines sequential patterns
Patterns based on time sequence of actions
Example – buying foods in summer and winter/rainy season