0% found this document useful (0 votes)
17 views2 pages

Data Mining Functionalities Explained

The document outlines an assignment with multiple questions related to data mining functionalities, including definitions and examples of characterization, discrimination, association, classification, regression, clustering, and outlier analysis. It also discusses the importance of data mining for business success, methods for handling missing values, and techniques for data smoothing and normalization. Additionally, it includes calculations for similarity measures and normalization methods for a given dataset of ages.

Uploaded by

divinexhumane
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
17 views2 pages

Data Mining Functionalities Explained

The document outlines an assignment with multiple questions related to data mining functionalities, including definitions and examples of characterization, discrimination, association, classification, regression, clustering, and outlier analysis. It also discusses the importance of data mining for business success, methods for handling missing values, and techniques for data smoothing and normalization. Additionally, it includes calculations for similarity measures and normalization methods for a given dataset of ages.

Uploaded by

divinexhumane
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Assignment-1

Q1. Define each of the following data mining functionalities: characterization,


discrimination, association and correlation analysis, classification, regression, clustering, and
outlier analysis. Give examples of each data mining functionality, using a real-life database
that you are familiar with.

Q2. Present an example where data mining is crucial to the success of a business. What data
mining functionalities does this business need (e.g., think of the kinds of patterns that could
be mined)? Can such patterns be generated alternatively by data query processing or simple
statistical analysis?

Q3. Briefly outline how to compute the dissimilarity between objects described by the
following:
(a) Nominal attributes
(b) Asymmetric binary attributes
(c) Numeric attributes
(d) Term-frequency vectors

Q4. For the following vectors, x and y, calculate the indicated similarity or dis-
tance measures.
(a) x = (1, 1, 1, 1), y = (2, 2, 2, 2) cosine, correlation, Euclidean
(b) x = (0, 1, 0, 1), y = (1, 0, 1, 0) cosine, correlation, Euclidean, Jaccard
(c) x = (0, −1, 0, 1), y = (1, 0, −1, 0) cosine, correlation, Euclidean

Q5. In real-world data, tuples with missing values for some attributes are a common
occurrence. Describe various methods for handling this problem.

Q6. Given the following data (in increasing order) for the attribute age:
13, 15, 16, 16, 19, 20,
20, 21, 22, 22, 25, 25, 25, 25, 30, 33, 33, 35, 35, 35, 35, 36, 40, 45, 46, 52, 70.
(a) Use smoothing by bin means to smooth the above data, using a bin depth of 3. Illustrate
your steps. Comment on the effect of this technique for the given data.
(b) How might you determine outliers in the data?
(c) What other methods are there for data smoothing?

Q7. Using the data for age given in Q6 , answer the following:
(a) Use min-max normalization to transform the value 35 for age onto the range [0.0, 1.0].
(b) Use z-score normalization to transform the value 35 for age, where the standard deviation
of age is 12.94 years.
(c) Use normalization by decimal scaling to transform the value 35 for age.

Q8. What are the value ranges of the following normalization methods?
(a) min-max normalization
(b) z-score normalization
(c) z-score normalization using the mean absolute deviation instead of standard deviation
(d) normalization by decimal scaling

Common questions

Powered by AI

Cosine similarity measures the cosine of the angle between two vectors. For x and y, cosine similarity is calculated as (1*2 + 1*2 + 1*2 + 1*2) / (sqrt(4)*sqrt(16)) = 1, indicating x and y are in the same direction, thus very similar. This measure helps in high-dimensional positivity when magnitude varies .

A supermarket chain could utilize data mining for market basket analysis to identify product associations for impactful promotions. Association analysis and classification might be essential functionalities for uncovering purchasing patterns. Simple statistical analysis or data queries may not uncover complex relationships such as non-obvious associations or predictions about future purchasing behaviors based on past data .

Characterization provides a summary of the general characteristics of a target class of data tuples, while discrimination compares the target class with one or more contrasting classes. For instance, in a retail database, characterization can summarize average spending behaviors of loyal customers, while discrimination could compare spending patterns between loyal and non-loyal customers to identify distinctive features .

Smoothing by bin means replaces data within a bin by the mean value of that bin. For the given age data, this reduces variance and highlights prominent trends by reducing noise, making it easier to identify overall patterns. Other techniques, such as smoothing by bin median or bin boundaries, may preserve central tendency or limit value range adjustments, respectively .

Jaccard distance focuses on the ratio of unmatching to total non-zero attributes and results in 1 due to no common presence. Euclidean distance considers actual magnitudes, resulting in sqrt(4)=2. Practical implications involve context; Euclidean is sensitive to scale, useful when magnitude matters, while Jaccard is suitable for presence-based binary attributes .

Min-max normalization typically scales data within a specified range [min, max], often [0, 1]. Z-score normalization generates a mean-centered distribution where values range based typically on standard deviations, theoretically unbounded. Normalization by decimal scaling scales data to fall within [-1, 1] based on the maximum absolute value .

Methods include data imputation using mean or median values, deletion of tuples with missing values, or prediction of missing values using algorithms. Imputation maintains dataset size but may introduce bias, while deletion simplifies data at the risk of losing valuable information. Predictive modeling is computationally intensive yet can be highly accurate if robust models are used .

Z-score normalization using mean absolute deviation is less sensitive to outliers than standard deviation, making it preferable for datasets with anomalous values or non-normally distributed data. This allows more representative scaling across the dataset, which might be skewed by extreme outliers if using standard deviation .

Bin means can mask outliers by compressing them toward bin averages. Alternative strategies like using interquartile range to flag outliers based on distance from typical range or employing machine learning models to detect anomalies better preserve outlier identification .

For nominal attributes, dissimilarity is calculated using a simple matching coefficient, counting mismatches. In contrast, dissimilarity for asymmetric binary attributes removes influence from the absence of both attributes, often computed using the Jaccard coefficient to reflect inherent asymmetry .

You might also like