0% found this document useful (0 votes)
12 views5 pages

Data Science Concepts and Analysis Techniques

The document outlines various topics related to data analysis, including data processing challenges, the data science process, data warehousing architecture, exploratory data analysis, and types of variables. It also covers statistical concepts such as frequency distributions, relative frequencies, normal curves, z-scores, regression analysis, and visualization techniques using Python. Additionally, it includes practical exercises and examples for better understanding of the concepts discussed.

Uploaded by

Mageshms
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
12 views5 pages

Data Science Concepts and Analysis Techniques

The document outlines various topics related to data analysis, including data processing challenges, the data science process, data warehousing architecture, exploratory data analysis, and types of variables. It also covers statistical concepts such as frequency distributions, relative frequencies, normal curves, z-scores, regression analysis, and visualization techniques using Python. Additionally, it includes practical exercises and examples for better understanding of the concepts discussed.

Uploaded by

Mageshms
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

UNIT-1

PART-B
1. Examine the different facets of data with the challenges in their processing.
2. Explain the various steps associated with data science process and explain
any three steps of it with suitable diagrams.
3. Describe the architecture of a data warehouse with a diagram.
[Link] data analysis.
UNIT-2
PART-B
5. Explain the different types of variables used in data analysis with an example
for each.
6. The number of friends reported by Facebook users is summarized in the
following frequency distribution:

FRIENDS f
400-above 2
350-399 5
300-349 12
250-299 17
200-249 23
150-199 49
100-149 27
50-99 29
0-49 36
TOTAL 200
(a) What is the shape of this distribution?
(b) Find the relative frequencies.
(c) Find the approximate percentile rank of the interval 300–349
(d) Convert to a histogram
7. (i)What is frequency distribution? Customers who have purchased a particular
product rated the usability of the product on a 10-point scale, ranging from
1(poor) to10(excellent) as follows

3 7 2 7 8
3 1 4 10 3
2 5 3 5 8
9 7 6 3 7
8 9 7 3 6
Construct a frequency distribution for the above data.
8. (ii) What is the relative frequency distribution? The GRE scores for a group of
graduate school applicants are distributed as follows:

GRE f
725-749 1
700-724 3
675-699 14
650-674 30
625-649 34
600-624 42
575-599 30
550-574 27
525-549 13
500-524 4
475-499 2
Total 200
Explain the procedure to convert a frequency distribution into relative frequency
distribution and convert the data presented in the above table to a relative
frequency distribution. Do not round the numbers to two digits to the right of the
decimal point.
i. Explain normal curve and Z-score.
ii. Using standard normal curve table, find the proportion of the total area
identified with the following statements.
a) Above z score of 1.80
b) Between the mean and a z score of 1.65
c) Between z scores of 0 and -1.96
9. Describe the types of variable.
ii. Suppose a hospital tested the age and body fat data for randomly selected
adults with the following result:

AGE 23 27 39 49 50 52 54 56 57 58 60
%fat 9.5 17.8 31.4 27.2 31.2 34.6 42. 33. 30. 34. 41
5 4 2 1

Draw the boxplots for age.


10. ) Assume that SAT math scores approximate a normal curve with a mean of
500 and a standard deviation of 100.
ii) Sketch a normal curve and shade in the target area(s) described by each of
the following statements:
• More than 570
• Less than 515
• Between 520 and 540
11. Convert to z scores and find the target areas specific to the above values.
(iii) Assume that the burning times of electric light bulbs approximate a normal
curve with a mean of 1200 hours and a standard deviation of 120 hours. If a
large number of new lights are installed at the same time (possibly along a newly
opened freeway), at what time will
• 1 percent fails?
• 50 percent fail?
• 95 percent fail?
UNIT-3
1. Each of the following pairs represents the number of licensed drivers (X ) and
the number of cars (Y ) for seven houses in my neighborhood

Drivers(X) Cars(Y)
5 4
5 3
2 2
3 2
1 1
2 2

a) Construct a scatterplot to verify a lack of pronounced curvilinearity.


(b) Determine the least squares equation for these data. (Remember, you will
first have to calculate r, SS y and SS x)
(c) Determine the standard error of estimate, sy|x, given that n = 7.
(d) Predict the number of cars for each of two new families with two and five
drivers.
2. i) In studies dating back over 100 years, it’s well established that regression
toward the mean occurs between the heights of fathers and the heights of their
adult sons. Indicate whether the following statements are true or false.
(a) Sons of tall fathers will tend to be shorter than their fathers.
(b) Sons of short fathers will tend to be taller than the mean for all sons.
(c) Every son of a tall father will be shorter than his father.
(d) Taken as a group, adult sons are shorter than their fathers.
(e) Fathers of tall sons will tend to be taller than their sons.
(f) Fathers of short sons will tend to be taller than their sons but shorter than the
mean for all fathers.
ii) Explain the different types of relationships present.
3. Calculate the standard error of Estimate for the given X and Y values:

FRIEND SENT RECEIVED


A 5 10
B 7 12
C 13 14
D 9 18
E 1 6
4. The value of x and their corresponding values of y are presented below.

X 0.5 1.5 2.5 3.5 4.5 5.5 6.5


Y 2.5 3.5 5.5 4.5 6.5 8.5 10.5

Find the least square regression line y=ax+b


ii) Estimate the value of y when x=10
5. Consider the following dataset with one response variable y and two predictor
variable x1 and x2. Compute multiple linear regression equation.

Y X1 X2
140 60 22
155 62 25
159 67 24
179 70 20
192 71 15
200 72 14
212 75 14
215 78 11

Imagine you have a series of data that represents the amount of precipitation
each day for a year in a given city. Load the daily rainfall statistics for the city of
Chennai in 2021 which is given in a csv file Chennai [Link] using
Pandas generate a histogram for rainy days and find out the days that have high
rainfall.
UNIT-4
[Link] about fancy indexing with an example
[Link] about the methods for detecting, removing and replacing null values in
pandas data structure
3. Imagine you have a series of data that represents the amount of precipitation
each day for a year in a given city. Load the daily rainfall statistics for the city of
Chennai in 2021 which is given in a csv file Chennai [Link] using
Pandas generate a histogram for rainy days and find out the days that have high
rainfall.
4. What is broadcasting? Explain the rules of broadcasting with an example.
5. Demonstrate grouping in python with example.
UNIT-5
1 Explain about various visualization charts like line plots, scatter plots and
histograms using matplotlib with an example.
2. Describe any two three-dimensional plotting in matplotlib with an example
3. How text and image annotations are done using python? Give an example of
your own with appropriate python code.
4. Describe in detail about pivot table.
5. Appraise the following with appropriate Python code:
(i) Histograms
(ii) Binnings
(iii) Density

You might also like