(AUTONOMOUS)

INTERNAL TEST 1 - ANSWERKEY

Date of test: 16.09.2024 Time & Duration of Test: 11.00AM to 12.30 PM
Programme: BE-CSE/AIML/CS Year& Sem.: II & III [Link]
Course Code: CS3352 Course Name: Foundations of Data Science
PART A (2*5 =10 marks)
1. Define Data Science.
Data science is the study of working with a huge volume of data and enables data for
prediction, prescriptive, and prescriptive analytical models. Big data is the study of
collecting and analyzing a huge volume of data sets to find a hidden pattern that helps
in stronger decision-making.
2. What is Graph-based data?
Graph or network data is, in short, data that focuses on the relationship or adjacency of
objects. The graph structures use nodes, edges, and properties to represent and store
graphical data. Graph-based data is a natural way to represent social networks.
3. List an overview of common errors.
Data cleaning is the process of fixing or removing incorrect, corrupted, incorrectly
formatted, duplicate, or incomplete data within a dataset.
When combining multiple data sources, there are many opportunities for data to be
duplicated or mislabeled.

4. Explain the types of data.

Differentiate Discrete and Continuous variables.

Discrete Data Continuous Data
5.
Continuous data are measurable and
Discrete data are finite and countable.
cannot be counted.
Discrete data consists of integers and Continuous data consists of fractional
whole numbers values.
Any value cannot be taken between a Any value can be taken within a specific
specific range range.
They are generally represented by bar They can be represented by histograms,
graphs. line graphs, etc.
It is generally represented using It is represented using probability density
probability density functions. functions.

Example: Number of students, number Example: Height of a person,

of children in a family, number of cars temperature, weight of a person or object,
in a parking lot, etc. time, etc.
 PART B
6. A) Examine the different Facets of data with the challenges in their processing.
Facets of Data (12 marks)
It is used to represent the various forms in which the data could be represented
inside Big Data. The following are the various forms in which the data could be
represented.
[Link](Structured data is data that depends on a data model and resides
in a fixed field within a record. ) Example:Excel files. SQL , or Structured Query
Language [Link](Unstructured data is data that isn’t easy to fit into a
data model because the content is context-specific or varying.) Example: Email
[Link] Language(Natural language is a special type of unstructured data; it’s
challenging to process because it requires knowledge of specific data science
techniques and linguistics.)
[Link] Generated(Machine-generated data is information that’s automatically
created by a computer, process, application, or other machine without human
intervention.)
[Link] Based(In graph theory, a graph is a mathematical structure to model
pair-wise relationships between objects.)
[Link], Video & Image Audio, image, and video are data
types that pose specific challenges to a data scientist. Tasks that are trivial for humans,
such as recognizing objects in pictures, turn out to be challenging for computers.
Examples: Youtube videos, podcast, music and lots more to add up to.
[Link] Data
The data flows into the system when an event happens instead of being loaded into a
data store in a batch.

6. B) Demonstrate the different types of variables used in data Analysis with an

example for each.
TYPES OF VARIABLES
A variable is a characteristic or property that can take on different values.
 The weights can be described not only as quantitative data but also as observations
for a quantitative variable, since the various weights take on different numerical
values. By the same token, the replies can be described as observations for a
qualitative variable, since the replies to the Facebook profile question take on different
values of either Yes or No.  Given this perspective, any single observation can be
described as a constant, since it takes on only one value.
Discrete and Continuous Variables
Quantitative variables can be further distinguished as discrete or continuous.
A discrete variable consists of isolated numbers separated by gaps.
Discrete variables can only assume specific values that you cannot subdivide.
Typically, you count discrete values, and the results are integers.
Examples Counts- such as the number of children in a family. (1, 2, 3, etc., but never
1.5) The number of heads in a sequence of coin tosses. The result of rolling a die.
The number of patients in a hospital. The population of a country. While discrete
variables have no decimal places, the average of these values can be fractional. For
example, families can have only a discrete number of children: 1, 2, 3, etc. However,
the average number of children per family can be 2.2.
A continuous variable consists of numbers whose values, at least in theory, have no
restrictions. Continuous variables can assume any numeric value and can be
meaningfully split into smaller parts. Consequently, they have valid fractional and
decimal values. In fact, continuous variables have an infinite number of potential
values between any two points. Generally, you measure them using a scale.
Examples of continuous variables include weight, height, length, time, and
temperature.
Independent Variable
In an experiment, an independent variable is the treatment manipulated by the
investigator.  Independent variables (IVs) are the ones that you include in the model
to explain or predict changes in the dependent variable.
 Independent indicates that they stand alone and other variables in the model do not
influence them.  Independent variables are also known as predictors, factors,
treatment variables, explanatory variables, input variables, x-variables, and right-hand
variables—because they appear on the right side of the equals sign in a regression
equation. It is a variable that stands alone and isn't changed by the other variables
you are trying to measure. For example, someone's age might be an independent
variable. Other factors. The impartial creation of distinct groups, which differ only in
terms of the independent variable, has a most desirable consequence. Once the data
have been collected, any difference between the groups can be interpreted as being
caused by the independent variable.
Dependent Variable
When a variable is believed to have been influenced by the independent variable, it is
called a dependent variable. In an experimental setting, the dependent variable is
measured, counted, or recorded by the investigator.
 The dependent variable (DV) is what you want to use the model to explain or
predict. The values of this variable depend on other variables.
 It’s also known as the response variable, outcome variable, and left-hand variable.
Graphs place dependent variables on the vertical, or Y, axis.
 a dependent variable is exactly what it sounds like. It is something that depends on
other factors. For example the blood sugar test depends on what food you ate, at which
time you ate etc. Unlike the independent variable, the dependent variable isn’t
manipulated by the investigator. Instead, it represents an outcome: the data produced
by the experiment.
7. A) What is Data Warehousing? Outline the architecture of Data Warehousing
with neat diagram
Data Warehousing

Tier-1: The bottom tier is a warehouse database server that is almost always a
relational database system. Back-end tools and utilities are used to feed data into the
bottom tier from operational databases or other external sources (such as customer
profile information provided by external consultants).
Tier-2: The middle tier is an OLAP server that is typically implemented using either a
relational OLAP (ROLAP) model or a multidimensional OLAP. OLAP model is an
extended relational DBMS that maps operations on multidimensional data to standard
relational operations. A multidimensional OLAP (MOLAP) model, that is, a special
purpose server that directly implements multidimensional data and operations.
Tier-3: The top tier is a front-end client layer, which contains query and reporting
tools, analysis tools, and/or data mining tools
7. B) i) Differentiate Structured and Unstructured data.

ii) What is Data mining? Outline the architecture of Data Mining with neat
diagram
Database/Data Warehouse Server
The database/data warehouse server is the crucial element of the architecture of data
mining that contains the cleaned and integrated data, under a unified schema, and is
ready to be processed. The database/data warehouse server retrieves the relevant data
basis the user request.
Data Mining Engine
Data Mining Engine comprises modules or tools for performing various tasks like data
clustering, data classification, prediction, and correlation analysis, on the data stored in
Database/data warehouse server. These sets of tools include –
An interpreter to transmit commands to the computer
Gear between the engine and the data warehouse to produce and handle bidirectional
communication
Pattern Evaluation
The pattern evaluation module investigates a pattern using a threshold value. It works in
collaboration data mining engine and uses stake measures to find interesting and useful
patterns. Pattern evaluation may also coordinate with the mining module, basis data
mining techniques. It is suggested to push the evaluation of pattern stakes as much as
possible into the mining procedure to find the desirable patterns and ensure an effective
data mining process.
Graphical User Interface
GUI serves as the link between the user and the data mining system. GUI hides the
complex process of data interpretation and presents the data in an easy and readable
format. The main component of a GUI are –
Legend: Some visualization results need colors, icons, or labels. A legend at the bottom
of the visualizer page helps to interpret the results
Status bar:The status bar facilitates the visualization of textual information
Toolbar:Every view provides a specific toolbar to access the crucial features of the view
Knowledge Base: A knowledge base is defined as the repository of domain-specific or
general knowledge gathered from data sources. It stores large amounts of organized data
and follows a defined schema or “data model” that facilitates its storage, retrieval, and
modification and is powered by artificial intelligence and machine learning algorithms.
Knowledge Base gives inputs to the data mining engine and helps in pattern evaluation.

A) What is a frequency distribution? Customers who have purchased a particular

 product rated the usability of the product on a 10 point scale, ranging from 1
(poor) to 10 (excellent) as follow.
7
3 7 2 7 8
3 1 4 10 3
2 5 3 5 8
9 7 6 3 7
8 9 7 3 6

Frequency distribution Definition:

A frequency distribution is a visual representation of the number of times a value
occurs in a given interval, or the pattern of frequencies of a [Link]
distributions can be represented in a variety of ways, including:
Frequency tables: A table that shows the number of observations in each range
Charts: A visual representation of the frequency distribution

Product Purchased Point Scale Frequency

1 1
2 2
3 6
4 1
5 2
6 1
7 4
8 3
9 2
10 1
Note that the term frequency refers to the number of times an observation occurs or
appears in a data set. Hence, in case of repetitions, the frequency increases. The table
below will help you understand this better:
A frequency distribution such as the one above is called an ungrouped frequency
distribution table. It takes into account ungrouped data and calculates the frequency for
each observation singularly.
 B)The IQ Scores for a group of 35 high school drop outs are as follows:
a) Evaluate Frequency Distribution for grouped data.

b) Construct Mean, Median, Mode.

7.
91 85 84 79 80
87 96 75 86 104
95 71 105 90 77
123 80 100 93 108
98 69 99 95 90
110 109 94 100 103
112 90 90 98 89

SOLUTION :
First, we need to create a frequency distribution for the IQ scores. We’ll group the
data into intervals. Here are the scores sorted in ascending order:

Choosing Class Intervals

Let's choose intervals of width 10:

Frequency Count

Now we count how many scores fall into each interval:

Interval Frequency
60-69 1
70-79 4
80-89 10
90-99 11
100-109 8
110-119 2
120-129 1
Mean:
 Median

To find the median, we need to locate the middle score in the sorted list. Since there are
35 scores (an odd number), the median is the score at position 35+12=18\frac{35 + 1}{2}
= 18235+1=18.

The 18th score in the ordered list is 90.

Median = 90

Mode

The mode is the score that appears most frequently. From the sorted list, we see that 90
appears 4 times, which is more than any other score.

Mode = 90

PART-C (1*14=14marks)
A) Briefly explain the steps in data science process
Data Science Process
Data science is an interdisciplinary field which is focused on extracting knowledge
8. from Big Data, which are typically large, and applying the knowledge and actionable
insights from data to solve problems in a wide range of application domains.
Data science process consists of six stages :
1. Discovery or Setting the research goal
2. Retrieving data
3. Data preparation
4. Data exploration
5. Data modeling
6. Presentation and automation
• Step 1: Discovery or Defining research goal
This step involves acquiring data from all the identified internal and external sources,
which helps to answer the business question.
• Step 2: Retrieving data
It collection of data which required for project. This is the process of gaining a business
understanding of the data user have and deciphering what each piece of data means.
This could entail determining exactly what data is required and the best methods for
obtaining it. This also entails determining
what each of the data points means in terms of the company. If we have given a data set
from a client, for example, we shall need to know what each column and row represents.
• Step 3: Data preparation
Data can have many inconsistencies like missing values, blank columns, an incorrect
data format, which needs to be cleaned. We need to process, explore and condition data
before modeling. The clean data, gives the better predictions.
• Step 4: Data exploration
Data exploration is related to deeper understanding of data. Try to understand how
variables interact with each other, the distribution of the data and whether there are
outliers. To achieve this use descriptive statistics, visual techniques and simple
modeling. This steps is also called as Exploratory Data Analysis.
• Step 5: Data modeling
In this step, the actual model building process starts. Here, Data scientist distributes
datasets for training and testing. Techniques like association, classification and
clustering are applied to the training data set. The model, once prepared, is tested
against the "testing" data set.
• Step 6: Presentation and automation
Deliver the final base lined model with reports, code and technical documents in this
stage. Model is deployed into a real-time production environment after thorough
testing. In this stage, the key findings are communicated to all stakeholders. This helps
to decide if the project results are a success or a failure based on the inputs from the
model.
8. B) i) Compare and contrast Qualitative data and Quantitative data with an
example.
Qualitative Research Quantitative Research
A method for developing a better It is the method used to generate numerical
understanding of human and social sciences, data by using a lot of techniques such as
in understanding human behaviour and logical, statistical and mathematical
personalities better techniques
It employs a subjective approach It employs an objective approach
It is generally expressed using words It is expressed using graphs and numbers
It has open-ended questions It has multiple choice questions
Qualitative research needs only a few Quantitative research requires many
respondents respondents
The data collection methods involved are The data collection methods involved are
interviews, focus groups, literature review, experiments, surveys, and observations
ethnography expressed in numbers
Qualitative research is holistic in nature Quantitative Research is particularistic in
nature

The reasoning used to synthesise data in this The reasoning used to synthesise data in this
research is inductive research is deductive

This method involves a process-oriented This method does not involve a process-
inquiry oriented inquiry

B) ii) Evaluate the types of Cumulative Frequency Distribution for following grouped
data.
Marks No. of Students
10-19 08
20-29 07
30-39 05
40-49 12
50-59 28

Solution:
Cumulative Frequency Distribution are of two types : Less Cumulative Frequency
Distribution (Less CFD) and More Cumulative Frequency Distribution (More CFD)
Less Cumulative Frequency Distribution (Less CFD):
Marks No. of Students Less CFD
10-19 08 8
20-29 07 15
30-39 05 20
40-49 12 32
50-59 28 60

More Cumulative Frequency Distribution (More CFD):

Marks No. of Students More CFD
10-19 08 60
20-29 07 52
30-39 05 45
40-49 12 40
50-59 28 28

Staff In Charge HOD