Scribd
Upload
18 views2 pages

Basic Statistics for Data Science

Basic Statics of BDA

Uploaded by

Shruti Jatain
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
18 views2 pages

Basic Statistics for Data Science

Basic Statics of BDA

Uploaded by

Shruti Jatain
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

7 Basic Statistics Concepts for Data Science

Statistics is like the heart of Data Science that helps to analyze, transform and predict
data.

1. Descriptive Statistics

It is used to describe the basic features of data that provide a summary of the given data
set which can either represent the entire population or a sample of the population. It is
derived from calculations that include:
 Mean: It is the central value which is commonly known as arithmetic average.
 Mode: It refers to the value that appears most often in a data set.
 Median: It is the middle value of the ordered set that divides it in exactly half.

2. Variability

Variability includes the following parameters:


 Standard Deviation: It is a statistic that calculates the dispersion of a data set as
compared to its mean.
 Variance: It refers to a statistical measure of the spread between the numbers in a data
set. In general terms, it means the difference from the mean. A large variance indicates
that numbers are far apart from the mean or average value. Small variance indicates
that the numbers are closer to the average values. Zero variance indicates that the
values are identical to the given set.
 Range: This is defined as the difference between the largest and smallest value of a
dataset.
 Percentile: It refers to the measure used in statistics that indicates the value below
which the given percentage of observation in the dataset falls.
 Quartile: It is defined as the value that divides the data points into quarters.
 Interquartile Range: It measures the middle half of your data. In general terms, it is the
middle 50% of the dataset.

3. Correlation

It is one of the major statistical techniques that measure the relationship between two
variables. The correlation coefficient indicates the strength of the linear relationship
between two variables.
 A correlation coefficient that is more than zero indicates a positive relationship.
 A correlation coefficient that is less than zero indicates a negative relationship.
 Correlation coefficient zero indicates that there is no relationship between the two
variables.
4. Probability Distribution

It specifies the likelihood of all possible events. In simple terms, an event refers to the
result of an experiment like tossing a coin. Events are of two types dependent and
independent.
 Independent event: The event is said to be an Independent event when it is not
affected by the earlier events. For example, tossing a coin, let us consider a coin is
tossed the first outcome is head when the coin is tossed again the outcome may be
head or tail. But this is entirely independent of the first trial.
 Dependent event: The event is said to be dependent when the occurrence of the event
is dependent on the earlier events. For example when a ball is drawn from a bag that
contains red and blue balls. If the first ball drawn is red, then the second ball may be
red or blue; this depends on the first trial.
The probability of independent events is calculated by simply multiplying the probability of
each event and for a dependent event is calculated by conditional probability

5. Regression

It is a method that is used to determine the relationship between one or more independent
variables and a dependent variable. Regression is mainly of two types:
 Linear regression
 Logistic regression

6. Normal Distribution

Normal is used to define the probability density function for a continuous random variable
in a system. The standard normal distribution has two parameters – mean and standard
deviation that are discussed above. When the distribution of random variables is
unknown, the normal distribution is used.

7. Bias

In statistical terms, it means when a model is representative of a complete population.


This needs to be minimized to get the desired outcome.
The three most common types of bias are:
 Selection bias: It is a phenomenon of selecting a group of data for statistical analysis,
the selection in such a way that data is not randomized resulting in the data being
unrepresentative of the whole population.
 Confirmation bias: It occurs when the person performing the statistical analysis has
some predefined assumption.
 Time interval bias: It is caused intentionally by specifying a certain time range to favor
a particular outcome.

Common questions

Powered by AI

Normal distribution is essential for statistical analysis as it describes how data points cluster around a central mean value, and it is key for making probabilistic inferences. Its key characteristics include its bell-shaped curve, symmetry about the mean, and being defined by two parameters: mean and standard deviation, which determine its shape and spread .

In probability theory, independent events are those where the outcome of one does not affect the other, such as tossing a coin. Dependent events are those where the outcome of one event affects the outcome of another, like drawing balls from a bag without replacement, where the probability of the second draw depends on the first draw .

Correlation measures the strength and direction of a linear relationship between two variables. A positive correlation means that as one variable increases, so does the other, indicated by a correlation coefficient greater than zero. Conversely, a negative correlation means that as one variable increases, the other decreases, shown by a coefficient less than zero .

The role of probability in independent events is to quantify the likelihood of occurrences without considering prior outcomes, calculated by multiplying individual probabilities of each event. For dependent events, probability must account for previous outcomes, requiring the use of conditional probability, where each event's likelihood is recalculated based on prior results .

Linear regression is used to assess the relationship between a dependent variable and one or more independent variables by fitting a linear equation to the observed data. It predicts numerical outcomes. Logistic regression, however, is used when the dependent variable is categorical, and it models the probability of a binary outcome based on one or more predictor variables .

Descriptive statistics help summarize and describe the main features of a dataset. Key measures include mean (arithmetic average), mode (most frequent value), and median (middle value that divides the dataset in half).

Variance measures the spread between numbers in a data set by indicating how far each number lies from the mean. A large variance suggests data points are very spread out about the mean. The standard deviation, the square root of variance, provides a measure of dispersion that is in the same unit as the data, making it easier to interpret .

Percentile measures indicate the relative standing of a data point within the dataset, showing the percentage of data below it, useful for data variability assessment. Quartiles divide a dataset into quarters, helping to understand the spread and center of the dataset by categorizing the data into more manageable sections, offering easier interpretation of data trends .

Bias affects statistical results by causing systematic deviations from the true values, thus leading to inaccurate conclusions. Common types include selection bias, which involves non-random sampling leading to unrepresentative data; confirmation bias, which is analyzing data to confirm prior assumptions; and time interval bias, which occurs when specific time ranges are selected to produce desired outcomes .

Understanding the interquartile range is important as it measures the spread of the middle 50% of the data, providing a clear idea about the data's central tendency and dispersion, which helps in identifying outliers and the overall variability without being affected by extreme values .

You might also like