MODULE-II

DATA MINING: INTRODUCTION - STEPS IN KDD - SYSTEM ARCHITECTURE – TYPES OF DATA -

DATA MINING FUNCTIONALITIES - CLASSIFICATION OF DATA MINING SYSTEMS -
INTEGRATION OF A DATA MINING SYSTEM WITH A DATA WAREHOUSE - ISSUES - DATA
PREPROCESSING - DATA MINING APPLICATION

Ashwini S
Assistant Professor
 Ashwini S Data Warehousing & Mining 26-09-2024

2 WHAT IS DATA?

• Collection of data objects and their attributes

• An attribute is a property or characteristic of an object –
Examples: eye color of a person,
temperature, etc. – Attribute is also known as variable, field,
characteristic, or feature
• A data object represents an entity—in a sales database, the
objects may be customers, store items, and sales; in a medical
database, the objects may be patients; in a university database, the
objects may be students, professors, and courses.
 Ashwini S Data Warehousing & Mining 26-09-2024

• Data objects are typically described by attributes.

• Data objects can also be referred to as samples, examples, instances, data points, or
objects.
• If the data objects are stored in a database, they are data tuples.
 Ashwini S Data Warehousing & Mining 26-09-2024

4 ATTRIBUTE

• It can be seen as a data field that represents characteristics or features of a data object. For a
customer object attributes can be customer Id, address etc.
• We can say that a set of attributes used to describe a given object are known as attribute
vector or feature vector.
Type of attributes:
• This is the First step of Data Data-preprocessing. We differentiate between different types of
attributes and then pre process the data. So here is description of attribute types.
• 1. Qualitative (Nominal (N), Ordinal (O), Binary (B)).
• 2. Quantitative (Discrete, Continuous)
 Ashwini S Data Warehousing & Mining 26-09-2024

5 DATA PREPROCESSING

• Pre-processing refers to the transformations

applied to our data before feeding it to the
algorithm.
• Data preprocessing is a technique that is used to
convert the raw data into a clean data set.
• In other words, whenever the data is gathered
from different sources it is collected in raw
format which is not feasible for the analysis.
 Ashwini S Data Warehousing & Mining 26-09-2024

6 TYPES OF ATTRIBUTES:
 Ashwini S Data Warehousing & Mining 26-09-2024

7 QUALITATIVE ATTRIBUTES:

1. Nominal Attributes :
• Nominal attributes, as related to names, refer to categorical data where the values
represent different categories or labels without any inherent order or ranking. These
attributes are often used to represent names or labels associated with objects, entities, or
concepts.
 Ashwini S Data Warehousing & Mining 26-09-2024

8 2. BINARY ATTRIBUTES:

• Binary attributes are a type of qualitative attribute where the data can take on only two distinct
values or states. These attributes are often used to represent yes/no, presence/absence, or
true/false conditions within a dataset.
• Symmetric: In a symmetric attribute, both values or states are considered equally important
or interchangeable. For example, in the attribute “Gender” with values “Male” and “Female,”
neither value holds precedence over the other, and they are considered equally significant for
analysis purposes.
 Ashwini S Data Warehousing & Mining 26-09-2024

• Asymmetric: An asymmetric attribute indicates that the two values or states are not
equally important or interchangeable. For instance, in the attribute “Result” with values
“Pass” and “Fail,” the states are not of equal importance; passing may hold greater
significance than failing in certain contexts, such as academic grading or certification
exams
 Ashwini S Data Warehousing & Mining 26-09-2024

10 3. ORDINAL ATTRIBUTES :

• Ordinal attributes are a type of qualitative attribute where the values possess a
meaningful order or ranking, but the magnitude between values is not precisely
quantified.
 Ashwini S Data Warehousing & Mining 26-09-2024

11 QUANTITATIVE ATTRIBUTES:

1. Numeric: A numeric attribute is quantitative because, it is a measurable quantity,

represented in integer or real values. Numerical attributes are of 2 types: interval , and
ratio-scaled.
An interval-scaled attribute has values, whose differences are interpretable, but the
numerical attributes do not have the correct reference point, or we can call zero points. Data
can be added and subtracted at an interval scale but can not be multiplied or divided.
Consider an example of temperature in degrees Centigrade. If a day’s temperature of one day
is twice of the other day we cannot say that one day is twice as hot as another day.
 Ashwini S Data Warehousing & Mining 26-09-2024

12

• A ratio-scaled attribute is a numeric attribute with a fix zero-point. If a measurement is

ratio-scaled, we can say of a value as being a multiple (or ratio) of another value. The values
are ordered, and we can also compute the difference between values, and the mean, median,
mode, Quantile-range, and Five number summary can be given.
2. Discrete : Discrete data refer to information that can take on specific, separate values rather
than a continuous range. These values are often distinct and separate from one another, and they
can be either numerical or categorical in nature.

• Example:
 Ashwini S Data Warehousing & Mining 26-09-2024

13

3. Continuous : Continuous data, unlike discrete data, can take on an infinite number of
possible values within a given range. It is characterized by being able to assume any value
within a specified interval, often including fractional or decimal values.

• Example :
 Ashwini S Data Warehousing & Mining 26-09-2024

14 WHAT IS DATA MINING?

• Data mining is the process of extracting knowledge or insights from large

amounts of data using various statistical and computational techniques.
• In the context of computer science, “Data Mining” can be referred to as
knowledge mining from data, knowledge extraction, data/pattern analysis,
data archaeology, and data dredging.
• Data Mining also known as Knowledge Discovery in Databases, refers to
the nontrivial extraction of implicit, previously unknown and potentially
useful information from data stored in databases.
 Ashwini S Data Warehousing & Mining 26-09-2024

15

• The need of data mining is to extract useful information from large datasets and use it to
make predictions or better decision-making. Nowadays, data mining is used in almost all
places where a large amount of data is stored and processed.

• For examples: Banking sector, Market Basket Analysis, Network Intrusion Detection.
 Ashwini S Data Warehousing & Mining 26-09-2024

16 KDD PROCESS IN DATA MINING

• KDD (Knowledge Discovery in Databases) is a

process that involves the extraction of useful,
previously unknown, and potentially valuable
information from large datasets.
• The KDD process is an iterative process and it
requires multiple iterations of the above steps to
extract accurate knowledge from the data.
 Ashwini S Data Warehousing & Mining 26-09-2024

17 KDD PROCESS STEPS

1. Data Cleaning: Data cleaning is defined as removal of noisy and irrelevant data from
collection.
• Cleaning in case of Missing values.
• Cleaning noisy data, where noise is a random or variance error.
• Cleaning with Data discrepancy detection and Data transformation tools.
 Ashwini S Data Warehousing & Mining 26-09-2024

18

2. Data Integration: Data integration is defined as heterogeneous data from multiple

sources combined in a common source (Data Warehouse).
• Data integration using Data Migration tools.
• Data integration using Data Synchronization tools.
• Data integration using ETL (Extract-Load-Transformation) process.
 Ashwini S Data Warehousing & Mining 26-09-2024

19

3. Data Selection: Data selection is defined as the process where data relevant to the analysis is decided
and retrieved from the data collection.
• Data selection using Neural network.
• Data selection using Decision Trees.
• Data selection using Naive bayes.
• Data selection using Clustering, Regression, etc.
4. Data Transformation: Data Transformation is defined as the process of transforming data into
appropriate form required by mining procedure. Data Transformation is a two-step process:
• Data Mapping: Assigning elements from source base to destination to capture transformations.
• Code generation: Creation of the actual transformation program.
 Ashwini S Data Warehousing & Mining 26-09-2024

20

5. Data Mining: Data mining is defined as clever techniques that are applied to extract
patterns potentially useful.
• Transforms task relevant data into patterns.
• Decides purpose of model using classification or characterization.
6. Pattern Evaluation: Pattern Evaluation is defined as as identifying strictly increasing
patterns representing knowledge based on given measures.
• Find interestingness score of each pattern.
• Uses summarization and Visualization to make data understandable by user.
 Ashwini S Data Warehousing & Mining 26-09-2024

21

7. Knowledge representation: Knowledge representation is defined as technique which

utilizes visualization tools to represent data mining results.
• Generate reports.
• Generate tables.
• Generate discriminant rules, classification rules, characterization rules, etc.
 Ashwini S Data Warehousing & Mining 26-09-2024

22 DATA MINING ARCHITECTURE

Basic Working:

1. It all starts when the user puts up certain data mining

requests, these requests are then sent to data mining
engines for pattern evaluation.
2. These applications try to find the solution to the query
using the already present database.
3. The metadata then extracted is sent for proper analysis
to the data mining engine which sometimes interacts with
pattern evaluation modules to determine the result.
4. This result is then sent to the front end in an easily
understandable manner using a suitable interface.
 Ashwini S Data Warehousing & Mining 26-09-2024

23 A DETAILED DESCRIPTION OF PARTS OF DATA

MINING ARCHITECTURE:
 Ashwini S Data Warehousing & Mining 26-09-2024

24
 Ashwini S Data Warehousing & Mining 26-09-2024

TYPES OF DATA MINING

25

There are several data mining

functions or activities that one
performs. All these activities
can be divided into two
categories – descriptive and
predictive data mining.
Descriptive data mining
includes association rule
mining, clustering, visualization,
sequence, and path analysis.
 Ashwini S Data Warehousing & Mining 26-09-2024

26 DESCRIPTIVE DATA MINING

 Ashwini S Data Warehousing & Mining 26-09-2024

27 ASSOCIATION RULE MINING

 Ashwini S Data Warehousing & Mining 26-09-2024

28

• Association rule mining focuses on discovering interesting

relationships or patterns among a set of items in
transactional or market basket data. It helps identify
frequently co-occurring items and generates rules such as
"if X, then Y" to reveal associations between items. This
simple Venn diagram shows the associations between
item sets X and Y of a dataset.
 Ashwini S Data Warehousing & Mining 26-09-2024

29 CLUSTERING
 Ashwini S Data Warehousing & Mining 26-09-2024

30

• Clustering is a technique used to group similar

data instances together based on their intrinsic
characteristics or similarities. It aims to discover
natural patterns or structures in the data without
any predefined classes or labels.
 Ashwini S Data Warehousing & Mining 26-09-2024

31 VISUALIZATION
 Ashwini S Data Warehousing & Mining 26-09-2024

32 SEQUENCE AND PATH ANALYSIS

 Ashwini S Data Warehousing & Mining 26-09-2024

33 PREDICTIVE DATA MINING

 Ashwini S Data Warehousing & Mining 26-09-2024

34 CLASSIFICATION
 Ashwini S Data Warehousing & Mining 26-09-2024

35

• Classification is a technique used to categorize

data into predefined classes or categories based
on the features or attributes of the data
instances. It involves training a model on labeled
data and using it to predict the class labels of new,
unseen data instances.
 Ashwini S Data Warehousing & Mining 26-09-2024

36 REGRESSION
 Ashwini S Data Warehousing & Mining 26-09-2024

37
 Ashwini S Data Warehousing & Mining 26-09-2024

38

• Regression is employed to predict numeric

or continuous values based on the
relationship between input variables and a
target variable. It aims to find a mathematical
function or model that best fits the data to
make accurate predictions.
 Ashwini S Data Warehousing & Mining 26-09-2024

39 DECISION TREE
 Ashwini S Data Warehousing & Mining 26-09-2024

40

• Decision trees are graphical models that use a

tree-like structure to represent decisions and
their possible consequences. They recursively
split the data based on different attribute
values to form a hierarchical decision-making
process.
 Ashwini S Data Warehousing & Mining 26-09-2024

41 NEURAL NETWORKS
 Ashwini S Data Warehousing & Mining 26-09-2024

42

• Neural networks are a type of machine learning

or AI model inspired by the human brain's
structure and function. They are composed of
interconnected nodes (neurons) and layers that
can learn from data to recognize patterns,
perform classification, regression, or other tasks.
 Ashwini S Data Warehousing & Mining 26-09-2024

43 DATA MINING FUNCTIONALITIES

 Ashwini S Data Warehousing & Mining 26-09-2024

44 INTEGRATION OF DATA MINING SYSTEM WITH A DATA

WAREHOUSE

• The data mining system is integrated with a database or data warehouse system so that it can do its
tasks in an effective mode. A data mining system operates in an environment that needs to communicate
with other data systems like a Database or Datawarehouse system.

• There are different possible integration (coupling) schemes as follows:

• No Coupling

• Loose Coupling

• Semi-Tight Coupling

• Tight Coupling
 Ashwini S Data Warehousing & Mining 26-09-2024

45
 Ashwini S Data Warehousing & Mining 26-09-2024

46 NO COUPLING

• No coupling means that a Data Mining system will not utilize any function of a Data Base or Data
Warehouse system.
• It may fetch data from a particular source (such as a file system), process data using some data
mining algorithms, and then store the mining results in another file.
• Drawbacks of No Coupling
• First, without using a Database/Data Warehouse system, a Data Mining system may
spend a substantial amount of time finding, collecting, cleaning, and transforming data.
• Second, there are many tested, scalable algorithms and data structures implemented in
Database and Data Warehouse systems.
 Ashwini S Data Warehousing & Mining 26-09-2024

47 LOOSE COUPLING

• In this Loose coupling, the data mining system uses some facilities / services of a database or
data warehouse system. The data is fetched from a data repository managed by these (DB/DW)
systems.
• Data mining approaches are used to process the data and then the processed data is saved
either in a file or in a designated area in a database or data warehouse.
• Loose coupling is better than no coupling because it can fetch any portion of data stored in
Databases or Data Warehouses by using query processing, indexing, and other system facilities.
Drawbacks of Loose Coupling
• It is difficult for loose coupling to achieve high scalability and good performance
with large data sets.
 Ashwini S Data Warehousing & Mining 26-09-2024

48 SEMI-TIGHT COUPLING

• Semi tight coupling means that besides linking a Data Mining system to a Data
Base/Data Warehouse system, efficient implementations of a few essential data
mining primitives can be provided in the DB/DW system. These primitives can include
sorting, indexing, aggregation, histogram analysis, multi way join, and precomputation
of some essential statistical measures, such as sum, count, max, min, standard
deviation.
• Advantage of Semi-Tight Coupling
• This Coupling will enhance the performance of Data Mining systems
 Ashwini S Data Warehousing & Mining 26-09-2024

49 TIGHT COUPLING

• Tight coupling means that a Data Mining system is smoothly integrated into
the Data Base/Data Warehouse system. The data mining subsystem is treated
as one functional component of information system. Data mining queries and
functions are optimized based on mining query analysis, data structures,
indexing schemes, and query processing methods of a DB or DW system.
 Ashwini S Data Warehousing & Mining 26-09-2024

50 DATA MINING APPLICATIONS

 Ashwini S Data Warehousing & Mining 26-09-2024

51
 Ashwini S Data Warehousing & Mining 26-09-2024

52
 Ashwini S Data Warehousing & Mining 26-09-2024

53
 Ashwini S Data Warehousing & Mining 26-09-2024

54 COMPANY USES
 Ashwini S Data Warehousing & Mining 26-09-2024

55
 Ashwini S Data Warehousing & Mining 26-09-2024

56
 Ashwini S Data Warehousing & Mining 26-09-2024

57

THANK YOU