Statistical Inference Exam Questions
Statistical Inference Exam Questions
Asymptotic behavior in statistical inference refers to the properties of estimators and statistical tests as the sample size becomes large. In the context of the document, it applies to parameter estimation by suggesting that as the sample size increases, the distribution of estimators approaches a normal distribution, allowing usage of asymptotic confidence intervals .
Fisher Information provides a measure of the amount of information that an observable random variable carries about an unknown parameter. It is used in constructing an asymptotic confidence interval by quantifying the precision of parameter estimates. More Fisher Information implies tighter confidence intervals, indicating more precise parameter estimation .
The MLE for the parameter θ in a Pareto distribution is derived by maximizing the likelihood function specific to the Pareto distribution. For the given losses data (0.40, 0.25, 0.70, 0.20, 0.70), the MLE is calculated as the solution that maximizes the logarithm of the distribution's likelihood function, resulting in an approximate numerical value of θ .
The MLE of θ for normally distributed scores is the sample variance, calculated as 88 from the provided data. Thus, the MLE for θ is 88 .
The length L of a confidence interval is calculated using the formula that incorporates the standard error derived from the Fisher Information of the parameter. For the given sample of Pareto-distributed losses and a 98% confidence level, the length L is determined through standard deviation calculations using the Fisher Information, resulting in a specific numerical value .
A score function is the derivative of the log-likelihood function with respect to the parameter of interest. In the context of estimating the unknown variance θ of student scores following a normal distribution N(μ, θ), the score function S(θ) is calculated by differentiating the log-likelihood function L with respect to θ, given that the mean μ is known .
Fisher Information for parameter λ in an exponential distribution is calculated by taking the second derivative of the log-likelihood function with respect to λ and evaluating the expected value. It is crucial for parameter estimation as it informs the variance of the MLE for λ, affecting the precision of estimations .
The sample variance is calculated using the formula S^2 = (1/n) * Σ(Xi - X̄)^2, where Xi are the individual scores and X̄ is the sample mean. The sample mean is (60 + 45 + 80 + 72 + 90 + 25) / 6 = 62. The variance is S^2 = (1/6) * [(60-62)^2 + (45-62)^2 + (80-62)^2 + (72-62)^2 + (90-62)^2 + (25-62)^2] = 528/6 = 88. The standard deviation is the square root of the variance, S = √88 = 9.38 .
The MLE for the variance θ of normally distributed student scores can be derived by solving the equation obtained from setting the score function S(θ) = 0. This involves differentiating the likelihood function with respect to θ and equating to zero. The MLE ensures maximum by checking the second derivative of the log-likelihood function at this point and confirming it's negative .
Order statistics involve arranging the data points from a sample in ascending order. For the exam scores provided, they are arranged as 25, 45, 60, 72, 80, 90. These are the ordered statistics denoted as X(1), X(2), ..., X(6).