Scribd
Upload
6 views2 pages

Resampling Techniques in Statistics

Resampling methods like bootstrapping and jackknifing are used to estimate the precision of sample statistics and validate models. Prediction error represents the noise or inaccuracy in predictions, and is measured as the difference between predicted and actual values. There are two types of prediction error: training error made on the training data used to build the model, and test error made on new unseen data, which indicates how well the model will generalize. Statistical inference uses random samples to make inferences about unknown population parameters, through constructing confidence intervals to estimate values and hypothesis testing to assess claims about populations.

Uploaded by

Navneet Singh
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
6 views2 pages

Resampling Techniques in Statistics

Resampling methods like bootstrapping and jackknifing are used to estimate the precision of sample statistics and validate models. Prediction error represents the noise or inaccuracy in predictions, and is measured as the difference between predicted and actual values. There are two types of prediction error: training error made on the training data used to build the model, and test error made on new unseen data, which indicates how well the model will generalize. Statistical inference uses random samples to make inferences about unknown population parameters, through constructing confidence intervals to estimate values and hypothesis testing to assess claims about populations.

Uploaded by

Navneet Singh
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Question 1: Explain Sampling and resampling with proper example.

Answer:

RESAMPLING In statistics, resampling is any of a variety of methods for doing one of the following:

1. Estimating the precision of sample statistics (medians, variances, percentiles) by using subsets of
available data (jackknifing) or drawing randomly with replacement from a set of data points
(bootstrapping)

2. Exchanging labels on data points when performing significance tests (permutation tests, also called
exact tests, randomization tests, or re-randomization tests)

3. Validating models by using random subsets (bootstrapping, cross validation) Common resampling
techniques include bootstrapping, jackknifing and permutation tests.

Ques 2: Explain Prediction error with proper example

Answer:

PREDICTION ERROR:

Prediction attempts to form patterns that permit it to predict the next event(s) given the available input
data.

 Deterministic predictions: If Bob leaves the bedroom before 7:00 am on a workday, then he will
make coffee in the kitchen.
 Probabilistic sequence models: If Bob turns on the TV in the evening then he will 80% of the
time go to the kitchen to make popcorn.

The Prediction Error tries to represent the noise through the concept of training error versus test error.
We fit our model to the training set. We take our model, and then we apply it to new data that the
model hasn't seen. In general, because the more data, the bigger the sample size, the more information
you have, the lower the error is.

Types of prediction error

1. Training: Training error is the error we get applying the model to the same data from which we
trained.
2. Test: Test error is the error that we incur on new data. The test error is actually how well we'll
do on future data the model hasn't seen.
Question 3: Explain briefly statistical inference.

Answer:

STATISTICAL INFERENCE Use a random sample to learn something about a larger population.

Two main ways to learn about a population-

a. Confidence intervals

b. Hypothesis testing

Confidence intervals

• Allow us to use sample data to estimate a population value, like the true mean or the true
proportion, i.e. estimate parameters.

• Example: What is the current mean GPA of U.S. college & university students?

Hypothesis testing

• Allows us to use sample data to test a claim about a population, such as testing whether a
population proportion or population mean equals some number.

• Example: The mean GPA of U.S. college & university students today is larger than 2.70 which
was the mean GPA in 1990?

You might also like