Teenagers' Fizzy Drink Consumption Study
Teenagers' Fizzy Drink Consumption Study
v=RbyUuJNd50E
1. The number of cans of fizzy drinks consumed by teenagers each day is the subject of an empirical
study. The following data have been recorded:
Number of teenagers 2 3 26 20 1 10
Assume that no teenager drinks more than five cans per day.
(i) Calculate the mean, median and mode for this sample.
● Associate english sentence while writing each central tendency and dispersion like
“teenagers prefer drinking 2 cans each day”
● Observe variation in the consumption of fizzy drink with different methods
(ii) Comment on the symmetry of the observed data, using your answer to part (i) and without
making any further calculations.
1) Data collected on the eye colors (blue, brown, green, hazel) of a population represents which
type of data scale?
2) The most appropriate measure of central tendency for a highly skewed distribution with several
extreme outliers is the ________.
3) A dataset contains the annual salaries (in dollars) of all employees at a tech firm. Which
measure of dispersion, **Range** or **Interquartile Range (IQR)**, would be more robust to the
influence of a few executive salaries that are significantly higher than the rest?
4) Explain the primary difference in the visual insight gained from a **boxplot** compared to a
**histogram** when analyzing a univariate, continuous dataset.
5) When analyzing the relationship between two continuous variables, a **scatter plot** is
generally preferred over a **stacked bar chart**. (True/False) Justify your answer.
6) Which of the following data types supports the calculation of a meaningful **Mean** and
**Variance**?
a) Ordinal
b) Nominal
c) Interval
d) Categorical
7) You are tasked with analyzing the distribution of commute times (in minutes) for employees.
The resulting plot shows a long tail to the right. This suggests the distribution is exhibiting:
a) Negative skewness
b) Zero skewness
c) Positive skewness
d) Platykurtosis
8) Describe the calculation used to define the upper fence for outlier detection based on the
**Interquartile Range (IQR) rule**.
9) To visually compare the market share percentage of five different smartphone brands, the most
effective visualization is typically a **pie chart**.
10) A **stacked bar chart** is most effective for visualizing the relationship between:
a) Two continuous variables.
b) A nominal variable and a ratio variable.
c) Two categorical variables.
d) A time series variable and a continuous variable.
11) Explain the rationale for why the **median** is a more appropriate measure of central
tendency than the **mean** for describing house prices in a neighborhood where a few luxury
homes are disproportionately expensive compared to the majority.
12) A researcher is analyzing customer ratings (1 to 5 stars) for a product. These ratings constitute
an example of an **ordinal** data type. (True/False)
13) Consider a university dataset recording the temperature (in Celsius) of laboratory samples and
the type of experiment (A, B, C) performed. Justify the selection of a **heatmap** as a primary
visualization tool for exploring the relationship between these two attributes.
14) Describe a scenario where a **geographical heatmap** would be the optimal visualization
choice, specifying the attribute being mapped and the insight it aims to communicate to a research
audience.
15) A marketing team is comparing the distribution of purchase amounts (in dollars) for
customers acquired through two different campaigns (Campaign X and Campaign Y). Outline the
steps and appropriate visualizations/statistics required to synthesize a comprehensive summary of
both datasets' characteristics, variability, and structure for a research audience.
2) Given the following dataset of wait times (in minutes) at a clinic: 5,7,10,12,12,15,20. Calculate
the **range** and the **median** for this univariate dataset.
4) Describe a scenario where a **stacked bar chart** would be a more effective visualization for
communicating insights than a simple **bar chart** or a **pie chart**. Specify the type of data
attributes you would need.
5) A survey asks participants to rank their satisfaction with a new service on a scale of 1 (Very
Dissatisfied) to 5 (Very Satisfied). What data type is this, and why would the **Interquartile
Range (IQR)** be a preferred measure of dispersion over the **variance**?
6) Describe the steps and components required to construct a **boxplot** for a dataset. Explain
how a boxplot visually communicates the **skewness** of the data distribution.
7) You have a dataset of house prices. If you discover a strong positive skew, what does that
imply about the relationship between the **mean**, **median**, and **mode**, and how
should this affect your choice of a measure of central tendency for reporting?
8) A scientist records the temperature (in Celsius) of a chemical reaction at one-minute intervals.
What data type is this, and what is the most appropriate visualization (out of **histogram** and
**bar chart**) to display the frequency distribution of the temperature readings? Justify your
choice.
9) The Q1 (first quartile) for a list of student exam scores is 65, and the Q3 (third quartile) is 85.
Use the **$1.5 \times \text{IQR}$ rule** to calculate the lower and upper bounds for outlier
detection. Explain the significance of an outlier score of 120.
10) You are analyzing the relationship between advertising spend and sales revenue. Describe the
two variables and the appropriate visualization (**scatterplot**, **pie chart**, or
**histogram**) to determine if a linear relationship exists between them.
11) Explain the difference between **variance** and **standard deviation** as measures of
dispersion. Why is the standard deviation generally preferred over the variance when presenting
descriptive statistics to a general research audience?
12) Describe a research scenario involving two categorical variables where a **heatmap** would
be a superior visualization choice compared to a **bar chart**. Explain what the color intensity
in the heatmap would represent.
13) Imagine you have a dataset detailing COVID-19 case rates per capita for every county in a
state. Explain how you would generate a **geographical heatmap** by hand, detailing the
necessary data and the interpretation of the visual output for a spatial analysis.
14) A dataset contains customer ages, product preferences (low, medium, high), and annual
income. Select one measure of central tendency and one measure of dispersion for **annual
income** (ratio data). Justify your choices assuming the income distribution is roughly
symmetrical.
15) A political scientist uses a **pie chart** to display the percentage of voters for each of five
candidates in an election. Critically evaluate the appropriateness and effectiveness of the pie chart
for this purpose, proposing an alternative visualization and justifying the replacement.
2. Which of the following statement is TRUE about the Bayes classifier?
a. Bayes classifier works on the Bayes theorem of probability.
b. Bayes classifier is an unsupervised learning algorithm.
c. Bayes classifier is also known as maximum apriori classifier.
d. It assumes the independence between the independent variables or features.
3. True or False: In a naive Bayes algorithm, when an attribute value in the testing record has no
example in the training set, then the entire posterior probability will be zero.
a. True
b. False
c. Can’t determined
4. If P(A) = 0.25, P(B) = 0.6 and P(A∩B) = 0.5. Find P(A/B).
5. If P(A) = 0.3, P(B/A) = 0.4 and P(A∪B) = 0.5 then find P(B).
6. A dice is rolled. If X = {3, 5, 6}, Y = {3, 4} and Z = {1, 3, 6} then, find P(X/Y), P(Y/Z), P(X/Z).
7. A coin is tossed 4 times. Find P(C/D) in C = Head on second Toss and D = Tail on third toss
8. Given that the two numbers appearing on throwing two dice are different. Find the probability of
the event the sum of numbers appearing on dice is 8 and the number 4 appears once.
9. Evaluate P(X∪Y), if 2P(X) = P(Y) = 4/11 and P(X/Y) = 2/9.
10. If P(A) = 5/8, P(B) = 2/3 and P (A B) = 3 / 8. Find P (Ac/ Bc).
11. In a school there are 120 students out of which 60 are boys. It is known that out of 40, 10% of
boys study in class 11. What is the probability that a student chosen randomly studies in class 11 ,
given that the chosen student is a boy.
12. A coin is tossed 5 times. Find (X/Y) if X = at least two heads and Y = at most one tail.
13. A coin is tossed 4 times. Find (X/Y) if X = at most one head and Y = at most 3 tails.
14. The following table shows hypothetical data concerning student characteristics and whether or
not each student should be hired.
2. Compute the conditional probabilities for GPA and Effort given Hirable = Yes/No.
○ GPA = poor
○ Effort = lots
determine whether they are more likely to be Hirable = Yes or Hirable = No.
4. Show your step-by-step calculations.
15. A feature F1 can take a certain value: A, B, C, D, E, or F, which represents the grades of students
from a college.
Ordinal variables are the variables that have some order in their categories. For example, grade A
should be considered a high grade than grade B.
16. Match List I with List II and choose the correct answer from the options given below:
17. For a negatively skewed distribution, the median would be equal to which of the following
measures?
A. Mean
B. Mode
C. Second quartile
D. Fifth quartile
E. 50th percentile
Choose the most appropriate answer from the options given below:
18. Identify the type of data (nominal, ordinal, interval, or ratio) represented by each of the following.
Confirm your answers by giving your own examples.
a. What type of data is Blood group?
b. What type of data is Temperature (Celsius)?
c. What type of data is Ethnic group?
d. What type of data is Job satisfaction index (1–5)?
e. What type of data is Number of heart attacks?
f. What type of data is Calendar year?
g. What type of data is Serum uric acid (mg/100 ml)?
h. What type of data is Number of accidents in a 3-year period?
i. What type of data is Number of cases of each reportable disease reported by a health
worker?
19. A man travels from Jaipur to Agra by a car and takes 4 hours to cover the whole distance. In the
first hour he travels at a speed of 50 km/hr, in the second hour his speed is 64 km/hr, in third hour
his speed is 80 km/hr and in the fourth hour he travels at the speed of 55 km/hr. Find the average
speed of the motorist.
20. Three rotten apples are mixed accidently with seven good apples and four apples are drawn one
by one without replacement. Let the random variable X denote the number of rotten apples. If μ
and σ² represent the mean and variance of X, respectively, then 10(μ^2+σ^2) is equal to:
a. 20
b. 250
c. 25
d. 30
21.
22. Ervin bowled 7 games last weekend. His scores are: 155, 165, 138, 172, 127, 193, 142. What is
the sample standard deviation of Ervin's scores?
a. 511.33
b. 22.61
c. 438.48
d. 20.94
23. Ervin bowled 7 games last weekend. His scores are: 155, 165, 138, 172, 127, 193, 142. What is
the population variance of Ervin's scores?
a. 511.33
b. 22.61
c. 438.29
d. 20.94
24. What is the mathematical relationship between the variance and the standard deviation?
a. The variance is the difference between the standard deviation and the average.
b. The standard deviation is the square of the difference between the variance and the
average.
c. The variance is the square root of the standard deviation.
d. The standard deviation is the square root of the variance.
25. If you want to invest in a new stock but get very stressed out when you see large fluctuations in
the price, even if the price is generally increasing, which of the following stocks (all with an
average of around $30) is best for you?
a. DGH, with a standard deviation of 1.7
b. JKL, with a standard deviation of 3.6
c. OPQ, with a standard deviation of -1.3
d. WXY, with a standard deviation of 1.1
26. What is the general category of metrics that describe numeric data?
a. Standard deviation
b. Dependent variables
c. Descriptive statistics
d. Variance
27. What is the ordinary average of a group of numbers called?
a. Median
b. Mode
c. Standard Deviation
d. Mean
28. In which type of distribution is the median greater than the mean?
a. Normal
b. Skewed to the right
c. Skewed to the left
d. Symmetrical
29. Which statistic is usually used to describe the representative value for a nominal variable such as
religious affiliation?
a. Mode
b. Median
c. Outlier
d. Mean
30. Construct a box plot for the following data set.
3,5,8,8,9,11,12,12,13,13,16
31. The reaction times (in milliseconds) of a group of 20-year-olds and a group of 30-year-olds were
tested. The reaction times for the 20-year-olds has been plotted below:
220,252,256,312,332,332,400
Construct a box plot for this set of the data and note two differences between the two groups.
Y N Mild Y Y
Y Y No N Y
Y N Strong Y Y
Y Y Mild N N
N N No N N
N Y Strong Y Y
N Y Strong N Y
N Y Mild Y Y
Do I believe that a patient with the following symptoms has the flu?
39. Lucy has a box of chocolates containing milk, white and dark chocolates. The probability of
picking a milk chocolate from the box is ½ and the probability of picking a milk chocolate or a
white chocolate is 4/5. What is the probability of picking a white chocolate from the box?
40. Which sequences correctly represent the relationships between the mean, median, and mode in
right-skewed and left-skewed distributions? [0.5]
a. Right Skewed: Mean < Median < Mode; Left Skewed: Mean < Mode < Median
b. Right Skewed: Mode < Median < Mean; Left Skewed: Mean < Median < Mode
c. Right Skewed: Mean < Median < Mode; Left Skewed: Mode < Median < Mean
d. Right Skewed: Mode < Mean < Median; Left Skewed: Mode < Median < Mean
41. The probability that a smoker gets cancer is 0.8, and a non-smoker gets cancer is 0.1. What are
the chances that a person actually smokes if he has cancer? Numerous research confirms that 30%
of people smoke.
42. For the given data 85, 72, 90, 68, 88, 75, 92, 78, 80, 85, 70, 95, 82, 76, 88, 91, 74, 83, 87, 79
a. Given a dataset of numbers, calculate the range, mean(expected value), median, sample
skewness, population skewness, kurtowsis and mode.
b. Calculate the standard deviation, variance and coefficient of variation of the given
dataset.
c. Find the quartiles (Q1, Q3) and IQR of a given dataset.
d. Determine if any outliers exist in a given dataset using the IQR method.
e. Calculate the skewness of a given dataset.
f. Given a dataset of grouped data (in a frequency table), calculate the mean.
g. Calculate the weighted mean of a set of values with their corresponding weights.
43. A professor recorded marks of 100 students. The mean score is 60, and the median score is 58.
Using the empirical relation between mean, median, and mode, estimate the mode of the
distribution.
a. 56
b. 54
c. 62
d. 64
44. The weights of 10-year-old girls are known to be normally distributed with a mean of 70 pounds
and a standard deviation of 13 pounds. Find the percentage of 10-year-old girls with weights
between 60 and 90 pounds.
45. A multiple-choice test has 10 questions, each with 4 options. A student guesses all answers.
1. What is the probability that the student gets exactly 3 correct answers?
2. What is the expected number of correct answers?
46. A factory produces steel rods with lengths normally distributed with a mean of 100 cm and a
standard deviation of 2 cm. The factory rejects rods shorter than 96 cm or longer than 104 cm.
1. What percentage of rods are rejected?
2. If the factory wants to reduce the rejection rate to 5%, what should the new acceptable range of
lengths be?
47. Consider following joint distribution mass function
Y=4 Y=10
Outcome(X) 1 2 3 4 5 6
PMF(X); P(x) 0.2 0.1 0.2 0.2 0.2 0.1
CDF(X);P(X<=x) 0.2 0.3 0.5 0.7 0.9 1
49.What is the probability density function values at X = 0.8, if all possible outcomes
(0.5<=X<=0.9) of a stochastic event are equally likely to occur.
50. Mimic the numbers coming on a dice which exhibit following probability mass function
Outcome(X) 1 2 3 4 5 6
PMF(X); P(x) 0.2 0.1 0.2 0.2 0.2 0.1
CDF(X);P(X<=x) 0.2 0.3 0.5 0.7 0.9 1
a. Generate 100 numbers from such a dice. Check how close your distribution is to the above
probability distribution
b. Calculate sample and population variance
c. For a fixed distribution, repeat the above experiments 100 times, check how many times which
formula comes better for calculating variance (with denominator n or n-1)
51. If a fair coin is tossed twice, what is the probability of getting two heads?
52. A bag contains 5 red balls and 3 green balls. What is the probability of drawing a red ball?
53. Given P(A) = 0.4, P(B) = 0.3, and P(A ∩ B) = 0.12, are events A and B independent?
54. Calculate the mean and variance of a binomial distribution with n=10 and p=0.5.
55. If the probability of rain on any given day is 0.2, what is the probability that it will rain on exactly
2 out of 5 days?
56. Given P(A) = 0.6, P(B|A) = 0.8, find P(A ∩ B).
57. A box contains 5 red balls and 3 blue balls. Two balls are drawn without replacement. What is the
probability that both balls are red? And what is the probability when balls are drawn without
replacement?
58. Calculate the expected value of a random variable X with the following probability distribution:
a. | X | 1 | 2 | 3 |
b. |------|-----|-----|-----|
c. | P(X) | 0.2 | 0.5 | 0.3 |
59. If a continuous random variable X follows a uniform distribution between 0 and 1, find the
probability that 0.2 ≤ X ≤ 0.8.
60. What is the sum of probabilities of all possible outcomes in a sample space?
a) 0
b) 1
c) Infinity
b) The occurrence of one event does not affect the probability of the other
65. Which one of the following is not the correct property of Normal Distribution?
1. Continuous distribution
List I (Applications)
A. Height of individuals in a population
B. Daily sales of a retail store
C. Lifetimes of electronic devices before they fail
D. Number of defects in a production line
E. Number of selections from a group without replacement
List II (Distributions)
I. Normal distribution
II. Hypergeometric distribution
III. Exponential distribution
IV. Poisson distribution
a)
b)
A–I, B–III, C–III, D–IV, E–II
A–III, B–I, C–IV, D–II, E–I
✅
c) A–I, B–II, C–III, D–IV, E–III
d) A–IV, B–III, C–I, D–II, E–I
67. A basketball game is played for 30 minutes. A coach claims that his team's players commit, on
average, no more than 10 fouls per game. Let µ represent the team's average number of fouls per
game. Another coach thinks that these players create more fouls. And in the next game the team
fouled 100 times."
What type of distribution do the fouls follow? What is the probability associated with 100 or
more fouls per game given the team’s coach’s statement is true?
68. A company has 1000 employees, consisting of: 700 Developers, 100 Sales & Marketing
employees, 200 QA Engineers. A random sample of 30 employees is selected. Let X be the
number of QA Engineers in this sample. Solve the following questions.
1. What is the underlying distribution? & What is the probability of selecting exactly 10 QA
Engineers? [0.5]
2. What is the probability of selecting at least 5 QA Engineers? & What is the probability of
selecting at most 8 QA Engineers? [0.5]
Given:
Answer: A) 0.4690
Explanation: Population standard deviation = √(population variance) = √0.22 ≈ 0.4690.
Answer: B) 0.5244
Explanation: Sample standard deviation = √(sample variance) = √0.275 ≈ 0.5244.
71. 3. Why might the sample variance (0.275) be larger than the population variance (0.22)?
A) Due to sampling error
B) Because the sample size is small
C) Both A and B
D) It should always be smaller
72. 4. If the sample size is n=20, what is the unbiased estimate of the population variance?
(Note: The given sample variance is likely already unbiased, but this tests understanding.)
A) 0.22
B) 0.275
C) 0.259
D) 0.290
Answer: B) 0.275
Explanation: The problem states "sample variance is 0.275", which is typically the unbiased
estimator (s²) for the population variance.
Answer: A) 5.33%
Explanation: CV = (σ / μ) × 100 = (0.4690 / 8.8) × 100 ≈ 5.33%.
75. 7. If the sample size is large, the sample variance should be:
A) Equal to the population variance
B) Larger than the population variance
C) Smaller than the population variance
D) Unrelated
77. The mileage which car owners get with a certain kind of radial tyre is a random variable having
an exponential distribution with mean 40,000 km. Find the probabilities that one of these tires
will last (i) at least 20,000 km and (ii) at most 30,000 km.
78. A call center receives customer calls at a random rate throughout the day. The number of calls
received per hour follows which probability distribution?
a) Normal
b) Poisson
c) Binomial
d) Exponential
79. The following dataset contains information about customer usage of phone services, including the
total minutes used, the number of calls made, and the total charges incurred during the day.
However, some values are missing (NaN). The value of k for KNN Imputation is fixed at k=2.
Write only important values that will be used to arrive the solution. [1]
No TotalDayMinutes TotalDayCalls TotalDayCharge
80. The cumulative frequency graph below shows the weight of 100 people who attend Weight
Watchers.
The weight of the lightest member was 61 kilograms and the weight of the heaviest member was 135. Draw
a box plot to show the distribution of the Weight Watchers members.
81. Which graph can utilise both quantitative and categorical variables at the same time? Justify your
answer.
c. Boxplot
a. Histogram
d. Contingency table
b. Pie chart
82. A company has three offices across India: Delhi, Mumbai, and Kolkata. Each office has sent a
compiled list sharing sales in quarter 1, quarter 2, quarter 3, and quarter 4. Provide a visualisation
that presents the variation of sales within each city's quarters and also between the cities. Justify
your answer.
b. Pie chart
c. Boxplot
d. Heatmap
a. Stacked bar chart
83. Which of the following visualizations is most effective at illustrating the distribution of a single
quantitative variable?
a. Scatter plot
c. Histogram
b. Pie chart
d. Line chart
84. A soccer player successfully scores a penalty 75% of the time. If they take 10 penalties in a
match, what is the probability that they score at least 8 goals?
a) 0.2543
b) 0.3894
c) 0.6127
d) 0.7589
-----------------------------
More questions related to the subject will be added soon.
Feature Selection
{Feature Selection, Extraction, Curse of dimensionality, Filter method based on
correlation methods such as correlation coefficient, Spearman and Kendall Tau
coefficients, Null Space, Information Gain, Decision Tree, Wrapper Methods, Recursive
Feature Elimination method, Feature importance, Embedded methods, Regularization,
Overfitting, Underfitting}
Correct answer: Feature selection chooses a subset of the original features, maintaining
their interpretability, while feature extraction creates new, lower-dimensional features
(e.g., principal components) that are combinations or transformations of the original
features, often sacrificing interpretability.
2) The primary mechanism by which both feature selection and feature extraction
mitigate the curse of dimensionality is by reducing the effective dimensionality of the
data space.
a) True
b) False
Correct answer: Pearson measures the linear relationship between the raw values of two
variables, assuming a Gaussian distribution. Spearman measures the monotonic
relationship between the ranks of the variables, making it more robust to non-linear
relationships and less sensitive to outliers, without assuming a specific distribution.
6) A data scientist is analyzing a dataset for a binary classification task. She finds that
Feature X₁ has a high Pearson correlation (0.85) with the target, while Feature X₂ has a
high Information Gain. Briefly explain why she might prefer to select Feature X₂ over X₁
based on these metrics.
Correct answer: Pearson correlation only measures linear relationships, and its
interpretation is complicated for non-continuous target variables (like binary
classification). Information Gain, derived from entropy reduction, is a non-linear,
non-parametric measure that directly assesses how well a feature splits the data based
on class labels, making it generally more appropriate and powerful for feature selection
in classification problems, especially when relationships are non-linear.
a) True
b) False
8) When implementing RFE with a Support Vector Machine (SVM) as the base model,
what criterion is typically used at each step to determine which feature to eliminate?
Correct answer: b) The feature with the smallest absolute magnitude of its corresponding
weight vector component.
9) The Null Space of a design matrix X consists of all vectors 𝐯 such that the
matrix-vector product X𝐯=𝟎. If a non-zero vector exists in the Null Space, what does this
imply about the features (columns) of X?
Correct answer: It implies that the features are linearly dependent (or redundant).
Specifically, the non-zero vector 𝐯 represents the coefficients of a linear combination of
the features that sums to zero, meaning at least one feature can be perfectly
represented as a linear combination of the others.
10) Which of the following regularization techniques inherently drives the coefficients of
irrelevant features to exactly zero, thus performing intrinsic feature selection?
a) L₂ Regularization (Ridge)
b) L₁ Regularization (Lasso)
c) Elastic Net Regularization
d) Dropout Regularization
11) Explain the primary difference in the penalty applied to model coefficients by L₁
(Lasso) versus L₂ (Ridge) regularization and how this leads to different outcomes in
feature selection.
Correct answer: L₁ adds a penalty proportional to the sum of the absolute values of the
coefficients, which results in sparsity, driving the coefficients of less important features to
exactly zero (feature selection). L₂ adds a penalty proportional to the sum of the squares
of the coefficients, which shrinks the magnitude of all coefficients toward zero but rarely
makes them exactly zero, thus performing regularization but not explicit feature
selection.
12) A model with very high variance and low bias, which performs exceptionally well on
the training data but poorly on unseen test data, is suffering from ______.
13) If a predictive model exhibits high bias and low variance, failing to capture the
underlying relationship in the data for both training and test sets, applying L₂
regularization with a very large penalty term would likely:
14) Briefly describe the mechanism by which feature importance values derived from a
trained Decision Tree (or ensemble methods like Random Forest) are calculated, and
how a practitioner might use these values for feature selection.
Correct answer: Feature importance in a Decision Tree is typically calculated based on
the total reduction in the loss function (e.g., Gini impurity or entropy for classification, or
mean squared error for regression) attributed to that feature across all splits in the tree.
A practitioner uses these values by setting a threshold and selecting only the features
whose importance score exceeds that threshold, as they contribute the most to the
model's predictive power.
15) Consider two features, F_(A) and F_(B), in a predictive model. If F_(A) and F_(B) are
highly correlated with each other, but only F_(A) is selected by an L₁ regularized model
while $F_B$'s coefficient is driven to zero, this illustrates the L₁ regularization's tendency
to:
Correct answer: b) Select an arbitrary feature from a highly correlated group and discard
the others.
Linear Regression
{Linear model, prediction, model, extending to multiple attributes, bias, weights,
optimizing model parameters, projection method, model hyper-parameters, model
parameters}
2) True or False: The primary purpose of the bias parameter (w₀) in a linear regression
model is to control the slope (steepness) of the regression line.
a) True
b) False
3) Which of the following mathematical expressions represents the Mean Squared Error
(MSE) objective function for a dataset with N samples, where y_(i) is the actual value
and y_(i) is the predicted value?
a) 1/N ∑(i=1)^(N)|y(i)-y_(i)|
b) ∑(i=1)^(N)(y(i)-y_(i))
c) 1/N ∑(i=1)^(N)(y(i)-y_(i))²
d) 1/N sqrt(∑(i=1)^(N)(y(i)-y_(i))²)
4) Consider a simple linear regression model where the optimal weight w₁ is 3.5 and the
bias w₀ is -2. If a new data point has a feature value x=10, what is the model's prediction
for the output y?
Correct answer: 33
5) True or False: When extending univariate linear regression to multiple attributes, the
feature vector 𝐱 is typically augmented with an initial component of '1' to incorporate the
bias term in the matrix-vector multiplication.
a) True
b) False
6) For a multiple linear regression model with D features, the prediction y is represented
in vector-matrix notation as y=𝐰^(T)𝐱. The vector 𝐰 (weights and bias) and the
augmented feature vector 𝐱 must both have a dimensionality of __________.
7) Which of the following is the primary reason for using the squared difference
(y_(i)-y_(i))² rather than the absolute difference |y_(i)-y_(i)| in the Mean Squared Error
objective function for linear regression optimization?
8) True or False: The closed-form solution for the optimal weights in linear regression is
often referred to as the Normal Equation and involves the pseudoinverse of the feature
matrix.
a) True
b) False
9) In a multivariate linear regression problem, you have a design matrix 𝐗 (including the
bias column) and a target vector 𝐲. If 𝐗^(T)𝐗 is invertible, the Normal Equation solution
for the optimal weight vector 𝐰 (the projection method result) is given by:
a) 𝐰=(𝐗𝐗^(T))^(-1)𝐗𝐲
b) 𝐰=𝐗^(T)𝐲(𝐗𝐗^(T))^(-1)
c) 𝐰=(𝐗^(T)𝐗)^(-1)𝐗^(T)𝐲
d) 𝐰=𝐗(𝐗^(T)𝐗)^(-1)𝐲
10) Given the design matrix 𝐗=((1,2),(1,4)) and the target vector 𝐲=((6),(10)). Calculate
𝐗^(T)𝐲, which is a component of the Normal Equation calculation.
11) The learning rate used in Gradient Descent to train a linear regression model is an
example of a model _________, while the optimal weight vector 𝐰 found by the Normal
Equation is an example of a model _________. (Separate your two answers with a
comma).
12) True or False: In linear regression, model parameters are learned directly from the
training data during the optimization process, whereas model hyper-parameters are
typically set prior to or outside of this optimization.
a) True
b) False
13) Which of the following is the best description of a model parameter in the context of
linear regression?
a) A setting that controls the complexity of the model, chosen before training begins.
b) The cost function used to measure the model's performance on the training data.
c) A value internal to the model (like a weight or bias) whose value is estimated from the
data.
d) The type of regularization (e.g., L1 or L2) applied to the objective function.
Correct answer: c) A value internal to the model (like a weight or bias) whose value is
estimated from the data.
{convergence, learning rate, stopping criteria, batch size, vanishing gradient issue}
1) Explain the primary mathematical difference between the L₁ (Lasso) and L₂ (Ridge)
loss functions when used as regularization terms, specifically focusing on the effect each
has on model weights.
Correct answer: The L₁ loss (absolute value of weights) promotes sparsity by driving
some weights exactly to zero (feature selection), while the L₂ loss (squared magnitude of
weights) shrinks all weights towards zero but rarely makes them exactly zero.
2) True or False: The L₁ loss function is generally more robust to outliers in the training
data than the L₂ loss function.
a) True
b) False
3) A regression model uses the L₂ loss function for regularization with a regularization
parameter λ=0.5. If a specific model weight is w_(j)=2.0, calculate the L₂ regularization
penalty term contributed by this single weight.
4) Which of the following is the primary limitation that makes the Brute Force
optimization method generally impractical for high-dimensional, continuous-variable
problems?
9) True or False: The primary goal of Soft Computing is to find the exact, verifiable global
optimum for a problem, unlike traditional optimization methods.
a) True
b) False
10) The fundamental update rule for Gradient Descent on a parameter θ with respect to
a cost function J(θ) is θ_(new)=θ_(old)-α⋅ (𝜕J(θ))/(𝜕θ). By setting the gradient (𝜕J(θ))/(𝜕θ)
to zero, you are attempting to find the ______ of the cost function.
11) A machine learning model is being trained using Gradient Descent. The cost function
is J(w)=w²-4w+5. Find the value of the weight w when the gradient is exactly zero.
Correct answer: 2
12) Which of the following best describes the role of the learning rate (α) in the Gradient
Descent algorithm?
Correct answer: c) It controls the magnitude of the step taken in the direction opposite to
the gradient.
13) True or False: Using a large batch size in Stochastic Gradient Descent (SGD)
generally leads to faster convergence per epoch but also requires more computation
time per update step.
a) True
b) False
14) The vanishing gradient issue in Gradient Descent is primarily caused by which of the
following?
15) A common stopping criterion for Gradient Descent is to halt the process when the
change in the cost function between consecutive iterations falls below a small
predetermined threshold ϵ. If the cost function changes from J_(k)=1.0003 to
J_(k+1)=1.0001, and ϵ=10^(-4), should the algorithm stop based on this criterion? Justify
your answer.
Linear Algebra
Vector and Matrix Operations
Vectors and Basic Operations{ scaling, adding, linear combination, unit vector, vector
magnitude}
Matrices and their basic Operations {Matrix multiplication as linear combination of columns or
rows}
1) Given a vector 𝐯=((2),(-1)), the resulting vector after scaling by a factor of 3 is 𝐮=((6),(-3)).
Geometrically, what transformation does this scaling operation perform on 𝐯?
a) Rotation
b) Translation
c) Change in length only
d) Change in length and possibly direction (if the scalar is negative)
5) Express the vector 𝐰=((1),(8)) as a linear combination of 𝐮=((1),(2)) and 𝐯=((-1),(4)). The
scalar coefficients (c₁,c₂) are:
a) (c₁,c₂)=(3,2)
b) (c₁,c₂)=(2,3)
c) (c₁,c₂)=(1,7)
d) (c₁,c₂)=(5,-4)
6) Geometrically, the vector addition 𝐮+𝐯 can be visualized using the **parallelogram rule** or
the **triangle rule**.
a) True
b) False
9) The geometric interpretation of the linear combination c₁𝐯₁+c₂𝐯₂ involves reaching a point by
scaling the initial vectors and then performing vector addition via the ______ rule.
10) Given 𝐀=((1,2),(0,3)) and 𝐁=((4,1),(-1,5)), compute the matrix product 𝐀𝐁.
11) A 3×2 matrix 𝐀 is multiplied by a 2×1 column vector 𝐱. The resulting 3×1 vector 𝐲=𝐀𝐱 is a
linear combination of which components of 𝐀?
a) The rows of 𝐀
b) The columns of 𝐀
c) The entries on the main diagonal of 𝐀
d) The transpose of $\mathbf{A}$'s rows
12) Explain why the magnitude of a vector 𝐯 is sometimes referred to as its "$L_2$ norm."
13) Consider the matrix multiplication 𝐂=𝐀𝐁, where 𝐀 is 2×3 and 𝐁 is 3×4. If you want to
compute the i-th column of 𝐂 without calculating the entire product, you would express it as a
linear combination of the columns of ______ weighted by the entries of the i-th column of
______.
14) Let 𝐌=((2,1),(3,0)) and 𝐱=((-1),(4)). The product 𝐌𝐱 is equivalent to the linear combination:
a) 4((2),(3))+(-1)((1),(0))
b) (-1)((2),(3))+4((1),(0))
c) 2((-1),(4))+1((3),(0))
d) 3((2),(1))+0((-1),(4))
15) A vector 𝐯 has a unit vector 𝐯=((1/ sqrt(2)),(-1/ sqrt(2))). If the magnitude of 𝐯 is 6, what is 𝐯?
---------------
Simultaneous system of linear equations
A simultaneous system of linear equations form a matrix equation {Row and Column
view of System of equations, Gauss Elimination, Gauss Jordon, pivot element, rank, REF,
RREF, Particular solution, homogeneous solution, total solution, Properties of Rank,
Elimination matrix, Elementary matrix that changes only one row, LU decomposition}
2x-3y=5
$4x + y = 1$
Write the corresponding matrix equation in the form A𝐱=𝐛, where A is the coefficient matrix, 𝐱 is
the vector of variables, and 𝐛 is the constant vector.
2) In the column view of the system A𝐱=𝐛, the vector 𝐛 must be a linear combination of the
______ of the matrix A.
3) The process of Gauss Elimination always results in a unique Row Echelon Form (REF) for a
given matrix.
a) True
b) False
A=((1,2,3),(0,4,5),(0,0,6))
Identify the pivot elements after applying Gauss Elimination to the matrix A.
A=((1,3),(2,6))
6) The elementary matrix that transforms ((1,0),(3,1)) into the identity matrix I by subtracting 3
times the first row from the second row is an elimination matrix.
a) True
b) False
7) Determine the Row Echelon Form (REF) of the augmented matrix for the system:
x+y=2
$2x + 3y = 5$
a) ((1,1,|,2),(0,1,|,1))
b) ((1,1,|,2),(0,0,|,1))
c) ((1,0,|,1),(0,1,|,1))
d) ((1,2,|,2),(0,1,|,1))
8) What is the fundamental property that distinguishes a Reduced Row Echelon Form (RREF)
from a general Row Echelon Form (REF)?
9) Given a system A𝐱=𝐛, if the rank of the coefficient matrix A is less than the rank of the
augmented matrix [A|𝐛], what is the structure of the solution set?
10) Find the Reduced Row Echelon Form (RREF) of the matrix:
B=((1,2),(3,4))
11) For a system of m equations and n variables, A𝐱=𝐛, if Rank(A)=Rank([A|𝐛])=k and k<n, the
homogeneous solution 𝐱_(h) has n-k free variables.
a) True
b) False
12) The total solution to a non-homogeneous system A𝐱=𝐛 is written as the sum of the particular
solution 𝐱_(p) and the homogeneous solution 𝐱_(h), i.e., 𝐱_(total)=𝐱_(p)+𝐱_(h). The particular
solution 𝐱_(p) is found by setting all free variables to zero. Which of the following defines the
homogeneous solution 𝐱_(h)?
13) The matrix E=((1,0,0),(-2,1,0),(0,0,1)) is an elimination matrix that, when multiplied on the
left, performs which elementary row operation on a 3×n matrix A?
14) Find the L and U factors in the LU decomposition (A=LU) of the matrix:
A=((1,2),(3,8))
a) L=((1,0),(3,1)), U=((1,2),(0,2))
b) L=((1,2),(0,2)), U=((1,0),(3,1))
c) L=((1,0),(-3,1)), U=((1,2),(0,2))
d) L=((1,0),(3,1)), U=((1,2),(0,6))
a) n
b) 0
c) n-1
d) Any integer k<n
-----------------------------------------
Vector spaces
{space, subspace, span, linearly dependent vectors, linearly independent vectors,
determinants, , basis, dimension of a vector space, vector space of matrices}, 4 vector spaces
related to a matrix A of size m x n {Row space of A, R(A), a subspace of R^n, Column space of
A, C(A), subspace of R^m, Null Space of A, N(A), a subspace of R^n, Null Space of A^T,
N(A^T), a subspace of R^m), Fundamental Theorem of Linear Algebra (dim(R(A))+dim(N(A)) =
n and dim(R(A^T))+dim(N(A^T)) = m}
1) Define a vector space V over a field F and list the two main properties that must hold for a
subset W of V to be considered a subspace.
2) The set of all polynomials of degree exactly 2, P₂={ax²+bx+c ∣ a≠0,b,c∈ℝ}, forms a vector
space under the usual polynomial addition and scalar multiplication.
a) True
b) False
3) Given the set of vectors S={((1),(0)),((0),(1))} in ℝ², describe the span span(S).
5) For a set of n vectors in ℝ^(n), what must the determinant of the matrix formed by these
vectors as columns be equal to for the vectors to be linearly independent?
a) Exactly 0
b) Any non-zero real number
c) Any non-negative real number
d) 1 or -1
8) What is the dimension of the vector space of all 2×3 matrices, denoted as M_(2×3)(ℝ)?
9) The Row Space R(A) of a matrix A is the subspace spanned by the ______ of A, and is a
subspace of ℝ^(n), where A is m×n.
10) For a 3×4 matrix A, the Null Space N(A) is a subspace of which Euclidean space?
a) ℝ³
b) ℝ⁴
c) ℝ^(3×4)
d) ℝ¹
11) Find the Null Space N(A) for the matrix A=((1,2),(2,4)).
12) The Column Space C(A) of a matrix A is defined as the range of the linear transformation
T(𝐱)=A𝐱.
a) True
b) False
13) If a 4×5 matrix A has a rank of 3, what is the dimension of the Null Space of $A$ dim (N(A)),
according to the Fundamental Theorem of Linear Algebra (Rank-Nullity Theorem)?
a) 7
b) 5
c) 3
d) 1
15) State the two main dimensional relationships given by the Fundamental Theorem of Linear
Algebra concerning a matrix A of size m×n.
16) Which of the following statements is a consequence of the Fundamental Theorem of Linear
Algebra's Orthogonality relationships?
a) The Row Space R(A) and the Column Space C(A) are orthogonal complements.
b) The Null Space N(A) is orthogonal to the Column Space C(A).
c) The Row Space R(A) is orthogonal to the Null Space N(A).
d) The Row Space R(A) and the Null Space N(A^(T)) are the only orthogonal subspaces of the
four fundamental subspaces.
17) Consider the matrix A=((1,0,-1),(0,1,1)). Find a basis for the Null Space of the Transpose
N(A^(T)).
18) Let V be the vector space of all continuous functions on the interval [0, 1]. Is the set of
vectors W={f(x)∈V∣f(0)=4} a subspace of V? Justify your answer briefly.
---------------------
{Orthogonal vectors, Unit vectors, Angle and length of a vector does not change on the
application of Orthonormal Linear Operators. These properties are also followed by rotation
operators.}
1) Define a linear map T:V→W between two vector spaces V and W. Specify the two axiomatic
properties that T must satisfy.
a) True
b) False
3) Which of the following matrices represents a shear transformation in ℝ² that adds twice the
second component to the first component?
a) ((1,0),(2,1))
b) ((1,2),(0,1))
c) ((2,0),(0,1))
d) ((1,1),(1,1))
4) Consider the vector 𝐯=((3),(-4)). Apply the scaling transformation matrix A=((5,0),(0,5)) to 𝐯.
The resulting vector is ______.
5) The operator T(𝐯)=𝐯+𝐚, where 𝐚 is a non-zero fixed vector (a translation), is a linear operator
because it preserves the operation of vector addition.
a) True
b) False
6) Let P:ℝ³→ℝ³ be the linear operator that projects a vector onto the xy-plane (i.e., z=0). What is
the 3×3 matrix representation of P?
8) Given the set of orthogonal vectors 𝐮₁=((1),(1)) and 𝐮₂=((-1),(1)), transform this set into an
orthonormal set {𝐞₁,𝐞₂}.
9) The Gram-Schmidt process is used to transform a basis for a vector space into an ______
basis.
10) Find the 2×2 matrix R that performs a counter-clockwise rotation of a vector in ℝ² by an
angle of θ=π/3 radians.
11) Let A be an n×n orthogonal matrix. For any vector 𝐯∈ℝ^(n), the length of the transformed
vector A𝐯 is equal to the length of 𝐯 (i.e., ‖A𝐯‖=‖𝐯‖).
a) True
b) False
12) Consider the orthogonal matrix Q=((0,1),(-1,0)), which represents a rotation by 270^(∘)
clockwise. Calculate the cosine of the angle between 𝐮=((1),(0)) and 𝐯=((0),(1)). Then calculate
the cosine of the angle between Q𝐮 and Q𝐯. The value of the cosine of the angle does not
change.
a) True
b) False
14) Let T:ℝ²→ℝ² be the linear map defined by the matrix M=((4,0),(0,1/2)). This transformation is
best categorized as a ______ operator.
----------------------
Eigenvalues & Eigenvectors
{eigenvectors if multiplied by any scalar remains the eigenvector for the operator. For a
symmetric matrix Eigenvectors are orthogonal if the eigenvalues are distinct and if two
eigenvectors share the same eigenvalue then each vector in the vector space spanned by these
vectors will be eigenvector sharing the same eigenvalue.}
Correct answer: A non-zero vector 𝐯∈V is an eigenvector of a linear operator T if T(𝐯)=λ𝐯 for
some scalar λ.
a) True
b) False
a) 0 and 1
b) 2 and 3
c) 1 and 2
d) 2 and 0
Correct answer: The eigenvalues λ are found by solving the characteristic equation, which is
given by det(A-λI)=0, where I is the identity matrix.
6) If 𝐯 is an eigenvector of matrix A with eigenvalue λ=4, what is the result of the matrix
multiplication A(5𝐯)?
a) 4𝐯
b) 5𝐯
c) 20𝐯
d) 9𝐯
7) Determine the eigenvector corresponding to the eigenvalue λ=3 for the matrix A=((2,1),(1,2)).
8) For a symmetric matrix, if two eigenvectors 𝐯₁ and 𝐯₂ correspond to the same eigenvalue λ,
they must be orthogonal.
a) True
b) False
9) Which of the following conditions guarantees that two eigenvectors 𝐯₁ and 𝐯₂ of a symmetric
matrix A are orthogonal?
10) Prove that if 𝐯 is an eigenvector of A with eigenvalue λ, then for any scalar c≠0, c𝐯 is also an
eigenvector of A with eigenvalue λ.
Correct answer: 0
a) True
b) False
14) Consider a 3×3 symmetric matrix A with a degenerate eigenvalue λ. If 𝐯₁ and 𝐯₂ are two
linearly independent eigenvectors for λ, what can be said about any vector 𝐮 in the span of
{𝐯₁,𝐯₂}?
15) If a 2×2 symmetric matrix has a repeated eigenvalue λ=4, what is the minimum dimension of
the eigenspace E₄?
Correct answer: 2
-----------------
1) If A is an n×n matrix, its singular values are the square roots of the eigenvalues of the matrix
A^(T)A. This is a necessary step when computing the ______ decomposition.
a) True
b) False
4) Explain the fundamental distinction in applicability between the Spectral Theorem for matrix
diagonalization and the Singular Value Decomposition (SVD).
Correct answer: Spectral Theorem applies only to symmetric matrices (or more generally,
normal matrices) and diagonalizes A. SVD applies to any matrix, factoring A into UΣV^(T).
5) Given a data matrix X, the eigenvectors of the covariance matrix C= 1/(m-1) X^(T)X
correspond to the principal components.
a) True
b) False
6) Which of the following conditions is necessary and sufficient for an n×n matrix A to be
diagonalizable via A=PDP^(-1)?
9) Describe the mathematical role of the principal components in the context of dimensionality
reduction via PCA.
Correct answer: Principal components are the eigenvectors of the covariance matrix that define
a new, orthogonal basis for the data, ordered by the amount of variance in the data they
capture.
10) For a non-square matrix A, which of the following decompositions is always possible?
a) Diagonalization A=PDP^(-1)
b) A=QR
c) Singular Value Decomposition A=UΣV^(T)
d) Eigendecomposition A=VΛV^(-1)
11) A dynamical system is described by the first-order linear system of ODEs d𝐱/(dt) =A𝐱, where
A is a diagonalizable n×n matrix. Outline how matrix diagonalization is used to find the general
solution 𝐱(t) in terms of eigenvalues and eigenvectors.
Correct answer: Diagonalize A=PDP^(-1). Define 𝐲=P^(-1)𝐱. The ODE transforms to d𝐲/(dt) =D𝐲,
which decouples into n independent scalar equations dy_(i)/(dt) =λ_(i)y_(i). The solution is
𝐲(t)=[c₁e^(λ₁t),…,c_(n)e^(λ_(n)t)]^(T), and the final solution is 𝐱(t)=P𝐲(t).
12) In the context of low-rank approximation using SVD, if a matrix A has singular values
σ₁≥σ₂≥…≥σ_(r)>0, the best rank-$k$ approximation (k<r) is obtained by setting all singular
values σ_(k+1) through σ_(r) to zero and reconstructing the matrix.
a) True
b) False
Correct answer: a) True
13) What is the fundamental connection between the Principal Component Analysis (PCA)
algorithm and the eigendecomposition of the data's covariance matrix?
Correct answer: The principal components (directions of maximal variance) are the eigenvectors
of the covariance matrix, and the variance along those components is given by the
corresponding eigenvalues.
14) A key limitation of applying matrix diagonalization to high-dimensional data is that the matrix
must be square and must have a full set of linearly independent eigenvectors. For Singular
Value Decomposition (SVD), a key practical limitation for large datasets is the high
computational cost, specifically the O(n³) complexity for a dense n×n matrix.
a) True
b) False
15) A researcher applies PCA to a dataset and finds that the first principal component accounts
for 85% of the total variance. If they use only the first principal component for dimensionality
reduction, what is the most significant practical limitation they must be aware of regarding their
ability to reconstruct the original data?
Correct answer: By retaining only 85% of the variance, the remaining 15% (which may contain
important, albeit smaller, features or noise) is lost, leading to an unavoidable information loss
and distortion in the reconstructed data.
A positive skew in a dataset, such as house prices, indicates that the mean is greater than the median, which is typically greater than the mode. The tail on the right side pulls the mean higher than central measures, suggesting consideration of the median for reporting central tendencies as it is less affected by outliers .
The Interquartile Range (IQR) is more robust than the range because it is not affected by the extreme values, like high executive salaries, as it focuses on the middle 50% of data. This makes it particularly useful for understanding the typical variability in a dataset where outliers could skew the range significantly, providing a clearer picture of the central distribution of salaries .
A heatmap is ideal for visualizing the relationship between temperature measurements and types of experiments because it effectively conveys the frequency and intensity of different temperature values across experiment types. The color intensity in the heatmap can represent the range of temperatures associated with each experiment type, allowing researchers to easily identify patterns or anomalies in the data distribution .
Using only the first principal component for dimensionality reduction, which captures 85% of the variance, implies that 15% of the variance is unaccounted for. This leads to an information loss, potentially overlooking smaller yet significant features or noise in the data, thus distorting the original data's full complexity .
Standard deviation is generally preferred over variance for presentation because it is expressed in the same units as the original data, making it more intuitive for understanding and comparing the variability directly. This aids in communication, particularly to non-statistical audiences, making the information more accessible and meaningful .
The Bayes classifier is referred to as a maximum a posteriori classifier because it relies on Bayes' theorem to estimate the posterior probabilities of classes. The decision rule involves choosing the class with the highest posterior probability, effectively maximizing a posteriori probability and hence the name .
In Singular Value Decomposition, singular values represent the 'strengths' or 'magnitudes' of the principal component directions of a matrix, where larger singular values indicate directions of higher variance. These singular values relate to principal components as they define the scaling along each principal axis, thus capturing the essence of data variability .
A geographical heatmap is optimal when visualizing spatial data, such as COVID-19 case rates per capita across counties. It displays variations in data intensity based on geographical locations. The insights come from recognizing patterns of concentration or spread over the area, enabling researchers to interpret high-intensity zones as areas with more cases and thus prioritize interventions .
Principal Component Analysis (PCA) employs the eigendecomposition of a covariance matrix to identify eigenvectors, which form the principal components. This helps in transforming the dataset to a new orthogonal basis where components capture maximum variance, enabling dimensionality reduction by prioritizing components with the largest eigenvalues, effectively summarizing the data's variance with fewer dimensions .
The L₁ regularization (Lasso) applies absolute value to weights, encouraging sparsity by potentially driving some weights to zero, thus assisting in feature selection. Conversely, L₂ regularization (Ridge) uses squared magnitudes of weights, which shrinks all weights uniformly towards zero but does not typically zero them, helping to reduce overfitting while retaining all features .