S. No.
Experiments Date Grade Signature
Case Study of different parameters
1 used in Data Analytic.
2 Study of data visualization and Steps of
data visualization.
Program to implementation of
3 SCATER PLOT on given sample
dataset by using python.
Program to implementation of LINE
4 GRAPH on given sample dataset by
using python.
Program to implementation of BAR
5 GRAPH on given sample dataset by
using python.
Program to implementation of
6 HISTOGRAM GRAPH on given
sample dataset by using python.
Program to implementation of PIE
7 CHART on given sample dataset by
using python.
Introduction of Data analytic tools
8 using the POWER BI framework.
Experiment No. 1
Case Study of different parameters used in Data Analytic.
Let's delve into each of these components within the context of a data analytic
framework:
1. Data Pre-processing:
Data Cleaning: Remove or correct errors, handle missing values, and deal with
outliers.
Data Integration: Combine data from multiple sources into a single dataset.
Data Transformation: Normalize or standardize data, encode categorical
variables, and perform feature engineering.
Data Reduction: Reduce dimensionality through techniques like PCA (Principal
Component Analysis) or feature selection.
2. Statistics:
Descriptive Statistics: Summarize and describe the main features of a dataset
using measures like mean, median, mode, variance, standard deviation, etc.
Inferential Statistics: Make predictions or inferences about a population based on
a sample from that population. This includes hypothesis testing, confidence
intervals, and regression analysis.
Correlation Analysis: Determine the strength and direction of relationships
between variables using correlation coefficients.
Probability Distributions: Understand the distribution of data using probability
distributions like Gaussian (normal), binomial, Poisson, etc.
3. Probability:
Fundamental Concepts: Understand basic concepts like sample space, events, and
probability axioms.
Conditional Probability: Calculate the probability of an event given that another
event has occurred.
Bayesian Probability: Update probabilities based on new evidence using Bayes'
theorem.
Random Variables: Understand discrete and continuous random variables and
their probability distributions.
4. Probability Distributions:
Continuous Distributions: Represent probabilities of continuous random
variables, such as the normal distribution for continuous data.
Discrete Distributions: Represent probabilities of discrete random variables, such
as the binomial distribution for binary outcomes.
Common Distributions: Understand commonly used distributions like the
uniform, exponential, Poisson, and beta distributions.
Probability Density Function (PDF) and Cumulative Distribution Function
(CDF): Understand the mathematical functions that describe the probability
distributions.
Certainly! Let's break down Bayes' Theorem and the Central Limit Theorem,
along with examples for each:
1. Bayes' Theorem:
Bayes' Theorem is a fundamental concept in probability theory that allows us to
update the probability of a hypothesis based on new evidence. It is expressed
mathematically as:
P(A|B) = frac{P(B|A) times P(A)}{P(B)}
Where:
P(A|B) is the probability of event A occurring given that event B has occurred.
P(B|A) is the probability of event B occurring given that event A has occurred.
P(A) and P(B) are the probabilities of events A and B occurring independently of
each other.
Example of Bayes' Theorem:
Let's say we have a medical test to detect a disease, and the test has a false
positive rate of 5% and a false negative rate of 2%. If 1% of the population
actually has the disease, what is the probability that a person who tests positive
actually has the disease?
P(A)= Probability of having the disease = 0.01
P(B|A)= Probability of testing positive given that the person has the disease = 1
False negative rate = 0.98
P(B|neg A) = Probability of testing positive given that the person does not have
the disease = False positive rate = 0.05
P(neg A) = Probability of not having the disease = 1 P(A) = 0.99
Using Bayes' Theorem:
P(A|B) = frac{P(B|A) times P(A)}{P(B|A) times P(A) + P(B|neg A) times P(neg
A)}
P(A|B) = frac{0.98 times 0.01}{(0.98 times 0.01) + (0.05 times 0.99)}
P(A|B) ≈ frac{0.0098}{0.0098 + 0.0495} ≈ frac{0.0098}{0.0593} ≈ 0.1654
So, the probability that a person who tests positive actually has the disease is
approximately 16.54%.
2. Central Limit Theorem (CLT):
The Central Limit Theorem states that the sampling distribution of the sample
mean approaches a normal distribution as the sample size increases, regardless of
the shape of the population distribution. It's a fundamental concept in statistics
and has important implications for hypothesis testing and confidence intervals.
Example of Central Limit Theorem:
Consider a population with an unknown distribution, and we want to study the
average height of individuals in this population. We take multiple random
samples from this population, each containing a different number of individuals,
and calculate the sample means for each sample.
According to the Central Limit Theorem:
The distribution of sample means will be approximately normal, regardless of the
shape of the population distribution.
As the sample size increases, the distribution of sample means becomes more
normal.
The mean of the sample means will be equal to the population mean.
The standard deviation of the sample means (standard error) will be equal to the
population standard deviation divided by the square root of the sample size.
This theorem is widely used in hypothesis testing and constructing confidence
intervals, especially when dealing with large sample sizes or unknown population
distributions.
Let's delve into each of these concepts within the context of data exploration and
preparation:
1. Data Exploration & Preparation:
Data Exploration: Investigating the dataset to understand its structure, patterns,
and relationships. This involves summary statistics, visualization techniques, and
understanding the distribution of variables.
Data Preparation: Cleaning, transforming, and preprocessing the data to make it
suitable for analysis. This includes handling missing values, encoding categorical
variables, and scaling or standardizing features.
2. Concepts of Correlation:
Correlation: A measure of the strength and direction of the linear relationship
between two variables. It ranges from -1 to 1, where -1 indicates a perfect
negative correlation, 0 indicates no correlation, and 1 indicates a perfect positive
correlation.
3. Regression:
Regression Analysis: A statistical method used to model the relationship between
a dependent variable and one or more independent variables. It helps predict the
value of the dependent variable based on the values of the independent variables.
Linear Regression: A type of regression analysis where the relationship between
the variables is assumed to be linear. It aims to find the best-fitting line that
minimizes the sum of squared differences between the observed and predicted
values.
4. Covariance:
Covariance: A measure of the degree to which two random variables vary
together. It indicates the direction of the linear relationship between two
variables. A positive covariance indicates a direct relationship, while a negative
covariance indicates an inverse relationship.
5. Outliers:
Outliers: Data points that significantly differ from the rest of the dataset. They
can skew statistical analyses and distort the results of data analysis. Outliers can
be identified using statistical methods like Z-score, IQR (Interquartile Range), or
visualization techniques like box plots.
6. Variance and Standard Deviation:
Variance: A measure of the dispersion or spread of a set of data points around the
mean. It is calculated as the average of the squared differences between each data
point and the mean.
Standard Deviation: The square root of the variance. It measures the average
distance of data points from the mean. A higher standard deviation indicates
greater variability in the data.
Experiment No. 2
Study of data visualization and Steps of data visualization.
Data visualization is the graphical representation of data and information using
visual elements such as charts, graphs, and maps. It enables analysts, researchers,
and decision-makers to understand complex datasets, identify patterns, and
communicate insights effectively. Here's a complete explanation of data
visualization along with steps involved in the process:
1. Understanding the Data:
Define Objectives: Clearly define the goals and objectives of the data
visualization. Understand what questions you want to answer or what insights
you want to gain from the data.
Explore the Data: Examine the dataset to understand its structure, variables, and
relationships. Identify key variables of interest and any patterns or trends present
in the data.
2. Data Preparation:
Cleanse the Data: Remove or correct errors, handle missing values, and deal with
outliers. Ensure that the data is accurate, complete, and reliable.
Transform the Data: Prepare the data for visualization by performing
transformations such as aggregation, filtering, or summarization. Normalize or
standardize the data if necessary.
3. Choose the Right Visualization Technique:
Select Appropriate Charts: Choose the right type of chart or graph based on the
nature of the data and the objectives of the visualization. Common types of
visualizations include bar charts, line charts, pie charts, scatter plots, histograms,
and heatmaps.
Consider Audience and Context: Tailor the visualization to the intended audience
and the context in which it will be presented. Ensure that the visualizations are
easy to understand and interpret.
4. Create the Visualization:
Use Visualization Tools: Utilize data visualization tools and software to create
the visualizations. Popular tools include Tableau, Power BI, matplotlib, seaborn,
ggplot2, and [Link].
Customize Visualizations: Customize the visualizations by adjusting colors,
labels, fonts, and other visual elements to enhance clarity and aesthetics.
Iterate and Refine: Iterate on the visualizations based on feedback and insights
gained from initial drafts. Refine the visualizations to improve their effectiveness
and accuracy.
5. Interpret and Communicate Insights:
Interpret Results: Analyze the visualizations to derive insights and identify
patterns, trends, and outliers in the data.
Communicate Findings: Present the visualizations to stakeholders using reports,
dashboards, presentations, or interactive tools. Clearly communicate key findings,
recommendations, and implications drawn from the data.
6. Iterate and Improve:
Seek Feedback: Gather feedback from stakeholders and users to identify areas for
improvement in the visualizations.
Update and Iterate: Update the visualizations based on feedback and new data.
Continuously iterate and refine the visualizations to ensure they remain relevant
and impactful.
Data visualization is an iterative process that involves careful planning,
preparation, and design to effectively communicate insights and drive decision-
making.
Experiment No. 3
Program to implementation of SCATER PLOT on given sample
dataset by using
python.
Output:-
In this code:
We import the `[Link]` module which provides a MATLAB-like
interface for creating plots.
We define sample data for the x and y coordinates.
We create a scatter plot using `[Link]()` function, specifying the x and y
coordinates, color, marker style, and label for the data points.
We set the title and labels for the x and y axes using `[Link]()`, `[Link]()`,
and `[Link]()` functions respectively.
We display the legend using `[Link]()` to label the data points.
We enable the grid using `[Link](True)` to add gridlines to the plot (optional).
Finally, we use `[Link]()` to display the plot.
You can replace the sample data `x` and `y` with your own dataset to create a
scatter plot for your specific data.
For Practice use more constrains/attributes in your lab practical.
Experiment No. 4
Program to implementation of LINE GRAPH on given sample dataset by
using python.
Output
In this code:
We import the `[Link]` module.
We define sample data for the x and y coordinates.
We create a line graph using the `[Link]()` function, specifying the x and y
coordinates, color, marker style, linestyle, linewidth, markersize, and label for
the data line.
We set the title and labels for the x and y axes using `[Link]()`, `[Link]()`,
and `[Link]()` functions respectively.
We display the legend using `[Link]()` to label the data line.
We enable the grid using `[Link](True)` to add gridlines to the plot (optional).
Finally, we use `[Link]()` to display the plot.
You can replace the sample data `x` and `y` with your own dataset to create a line
graph for your specific data.
Experiment No. 5
Program to implementation of BAR GRAPH on given sample
dataset by using python.
Output
In this code:
We import the `[Link]` module.
We define sample data for categories and their corresponding values.
We create a bar graph using the `[Link]()` function, specifying the categories and
their values, as well as color and transparency (alpha) of the bars.
We set the title and labels for the x and y axes using `[Link]()`, `[Link]()`,
and `[Link]()` functions respectively.
We optionally enable the grid for the y-axis using `[Link](axis='y')`.
Finally, we use `[Link]()` to display the plot.
You can replace the sample categories and values with your own dataset to create
a bar graph for your specific data.
Experiment No. 6
Program to implementation of HISTOGRAM GRAPH on given
sample dataset by using python.
Output
In this code:
We import the `[Link]` module.
We define sample data for the histogram.
We create a histogram using the `[Link]()` function, specifying the dataset,
number of bins, color, edgecolor, and transparency (alpha) of the bars.
We set the title and labels for the x and y axes using `[Link]()`, `[Link]()`,
and `[Link]()` functions respectively.
We optionally enable the grid for the y-axis using `[Link](axis='y')`.
Finally, we use `[Link]()` to display the plot.
You can replace the sample data with your own dataset to create a histogram for
your specific data. Adjust the number of bins to control the granularity of the
histogram.
Experiment No. 7
Program to implementation of PIE CHART on given sample
dataset by using python.
Output
In this code:
We import the `[Link]` module.
We define sample data for categories and their corresponding sizes.
We create a pie chart using the `[Link]()` function, specifying the sizes and labels
for each category, as well as the percentage format (`autopct`), starting angle
(`startangle`), and colors for each category.
We set the title using `[Link]()`.
We ensure that the pie chart is drawn as a circle by setting the aspect ratio to
'equal' using `[Link]('equal')`.
Finally, we use `[Link]()` to display the plot.
You can replace the sample categories and sizes with your own dataset to create a
pie chart for your specific data. Adjust the start angle and colors as needed to
customize the appearance of the pie chart.