0% found this document useful (0 votes)
28 views2 pages

Data Analytics and Statistics Notes

The document provides an overview of data analytics, including the distinction between big data and small data, and outlines the four types of analytics: descriptive, diagnostic, predictive, and prescriptive. It also covers descriptive statistics, detailing scale types, univariate analysis, and common probability distributions, as well as data visualization techniques. Additionally, it discusses bivariate analysis methods for analyzing relationships between two attributes.

Uploaded by

ayesha
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
28 views2 pages

Data Analytics and Statistics Notes

The document provides an overview of data analytics, including the distinction between big data and small data, and outlines the four types of analytics: descriptive, diagnostic, predictive, and prescriptive. It also covers descriptive statistics, detailing scale types, univariate analysis, and common probability distributions, as well as data visualization techniques. Additionally, it discusses bivariate analysis methods for analyzing relationships between two attributes.

Uploaded by

ayesha
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Notes on Data Analytics and Descriptive Statistics

1. Introduction to Data Analytics


 Big Data and Data Science: Big Data refers to datasets that are extremely large and
complex, requiring advanced storage, management, and analysis techniques. Data
Science combines statistical methods, algorithms, and computational tools to derive
insights from both big and small data.
 Small Data: Refers to datasets that are small enough to be managed and analyzed on a
personal computer or with simple statistical tools. Though small in size, small data is
often rich in context and detail.
 A Short Taxonomy of Data Analytics:
 - Descriptive Analytics: Summarizes past data to understand what has happened.
 - Diagnostic Analytics: Explains why something happened.
 - Predictive Analytics: Uses models and historical data to predict future outcomes.
 - Prescriptive Analytics: Recommends actions to achieve desired outcomes.
 Examples of Data Use: Applications include healthcare, finance, marketing,
manufacturing, and social sciences.
 Breast Cancer in Wisconsin: A famous dataset used for classification tasks, helping to
distinguish between benign and malignant tumors using attributes of cell nuclei.
 Polish Company Insolvency Data: Used for predicting company insolvency based on
financial ratios and attributes.
 A Little History on Methodologies for Data Analytics: Evolution from traditional
statistics to data mining, machine learning, and modern AI-driven analytics.

2. Descriptive Statistics
 Scale Types:
 - Nominal: Categories without order (e.g., gender, colors).
 - Ordinal: Ordered categories (e.g., satisfaction ratings).
 - Interval: Numeric scale without true zero (e.g., temperature in Celsius).
 - Ratio: Numeric scale with a true zero (e.g., weight, height).
 Descriptive Univariate Analysis: Focuses on analyzing one attribute at a time.
 Univariate Frequencies: Counting how often each value or category occurs.
 Contents of Univariate Analysis: Measures of central tendency (mean, median, mode),
measures of dispersion (range, variance, standard deviation), and distribution shape
(skewness, kurtosis).
 Univariate Statistics: Statistics describing one variable at a time.
 Common Univariate Probability Distributions: Normal, Binomial, Poisson, Exponential,
Uniform.

3. Data Visualization
Data Visualization is the graphical representation of data to make trends, patterns, and
insights easier to understand. Common techniques include histograms, bar charts, scatter
plots, box plots, and heatmaps.

4. Descriptive Bivariate Analysis


 Two Quantitative Attributes: Scatter plots, correlation coefficients, regression analysis.
 Two Qualitative Attributes: Cross-tabulation (contingency tables), Chi-square tests.
 At Least One Nominal Attribute: Bar charts, stacked bar charts, ANOVA for group
comparison.
 Two Ordinal Attributes: Spearman’s rank correlation, Kendall’s tau.

Common questions

Powered by AI

Big Data involves extremely large and complex datasets that require advanced storage, management, and analysis techniques, often using high-performance computing and distributed systems. It is particularly useful in fields like healthcare and finance where vast amounts of data need to be processed and analyzed. Small Data, on the other hand, consists of datasets that are small enough to be managed on a personal computer with simple statistical tools. Small data is often rich in context and detail, making it valuable for applications where detailed insights are needed without the complexity of large data processing .

The Breast Cancer in Wisconsin dataset is significant in data analytics for classification tasks as it helps distinguish between benign and malignant tumors using attributes of cell nuclei. In practice, this dataset is used to create predictive models that can aid medical professionals in making informed decisions about diagnosis and treatment plans, contributing to more accurate and timely interventions in breast cancer care .

Understanding scale types (nominal, ordinal, interval, ratio) is crucial in data analytics, particularly in descriptive statistics, as it dictates the types of analyses that can be conducted and the interpretations that can be made. For instance, nominal scales allow for frequency counts and mode calculation, while ordinal scales enable ranking and the use of medians. Interval scales allow for meaningful differences between measurements but lack a true zero, impacting how change is interpreted. Ratio scales, with a true zero, permit the full range of statistical operations, including ratios and coefficients. Proper recognition of these scales ensures appropriate analytical methods are applied, enhancing the validity and accuracy of analytical conclusions .

Univariate descriptive analytics typically use measures of central tendency (mean, median, mode) to identify a typical value in a dataset, and measures of dispersion (range, variance, standard deviation) to describe the spread of the data. Additionally, distribution shape (skewness, kurtosis) helps understand the asymmetry and peakedness of the data distribution. These statistics collectively provide a comprehensive overview of the dataset's characteristics, indicating how data is distributed around a central point .

Data analytics methodologies have evolved from traditional statistics, which focused on mathematical rigor and hypothesis testing, to data mining and machine learning, which emphasize pattern recognition and predictive modeling. The rise of modern AI-driven analytics has further transformed the field, enabling the analysis of unstructured data and the implementation of complex algorithms to derive deeper insights. This evolution allows for more scalable and flexible analysis, capable of handling the increasingly large and complex datasets seen in industries today, leading to more accurate and actionable results .

In bivariate analysis of two quantitative attributes, regression analysis is used to determine the relationship between the dependent and independent variables and to predict future values of the dependent variable based on this relationship. Correlation coefficients measure the strength and direction of a linear relationship between the two variables. Together, these tools help in understanding the interdependencies and predicting trends, making them useful in areas such as economics and epidemiology .

Cross-tabulation, or contingency tables, and Chi-square tests are used in analyzing relationships between two qualitative attributes. Cross-tabulation provides a simple way to display the frequency distribution of variables, enabling initial insights into the potential association between them. The Chi-square test then assesses the statistical significance of the association, determining whether observed frequencies differ from expected frequencies by chance. These tools are crucial for analyzing categorical data in fields such as marketing and social sciences to identify significant relationships between class variables .

Descriptive analytics summarizes past data to understand what has happened, making it useful for historical data review in industries like finance and marketing. Diagnostic analytics goes a step further to explain why certain events occurred, providing deeper insights and is highly beneficial in root cause analysis. Predictive analytics uses models and historical data to forecast future events, which is crucial in market trend analysis and risk assessment. Prescriptive analytics recommends actionable solutions to achieve desired outcomes, being particularly useful in strategic planning and operations management where decision-making guidance is needed .

ANOVA (Analysis of Variance) is applied to determine whether there are statistically significant differences between the means of three or more independent (unrelated) groups. When dealing with at least one nominal attribute, it helps in comparing group means to ascertain any significant effect due to categorical factors, making it valuable in experiments and industrial research. However, ANOVA assumes normality, homogeneity of variance, and independence of observations, which may not always be valid in practice, potentially limiting its applicability and the reliability of its conclusions if these assumptions are not met .

Data visualization enhances the understanding of trends and patterns by providing a graphical representation of data, making complex data relationships more accessible and easier to interpret. Common techniques include histograms, bar charts, scatter plots, box plots, and heatmaps. These visual tools allow analysts to quickly identify key relationships and insights, such as distribution shapes, correlations, and anomalies, which might be less obvious in raw data form .

You might also like