A right-tailed z-test is used when the alternative hypothesis is that the population mean is greater than the hypothesized mean (HA: µ > µ0). The decision criterion for rejection of the null hypothesis is if the test statistic exceeds a critical value. In contrast, a left-tailed z-test is used when the alternative hypothesis proposes that the population mean is less than the hypothesized mean (HA: µ < µ0), with rejection occurring if the test statistic is below a critical value. A two-tailed z-test is employed when the alternative hypothesis suggests that the population mean is different from the hypothesized mean (HA: µ ≠ µ0). The null hypothesis is rejected if the absolute value of the test statistic exceeds a critical value on either tail of the distribution, implying a possible effect in either direction .

Type I error occurs when the null hypothesis is rejected despite being true. It is denoted by the significance level, α, and represents a 'false positive' outcome. Type II error happens when the null hypothesis is accepted while the alternative hypothesis is true, indicating a 'false negative.' It is denoted by β. These errors impact hypothesis testing outcomes as Type I errors lead to incorrect conclusions about the presence of an effect when there is none, while Type II errors fail to detect actual effects. The balance between minimizing these errors is crucial for the reliability and validity of statistical tests .

The test statistic is a numerical quantity calculated from sample data used as an indicator of the sample's characteristics. It plays a central role in hypothesis testing by summarizing the data into a single metric that can be used to make decisions about the null hypothesis. The calculated value of the test statistic is compared against critical values determined by the significance level or P-value to decide whether to reject or fail to reject the null hypothesis. Depending on whether the test is one-tailed or two-tailed, the directionality of the test statistic helps determine the rejection regions, guiding the conclusion about the hypothesis .

A simple hypothesis completely specifies the distribution of the sample, including all parameters. It implies that for any given set of values, the model does not extend beyond these parameters. In contrast, a composite hypothesis does not fully specify the distribution; it leaves one or more parameters unspecified or allows them to vary within certain ranges. This differentiation is important because it affects how statistical tests are designed and interpreted, influencing the error rates and conclusions drawn from data .

The acceptance and rejection regions in a hypothesis test are defined areas of the probability distribution of the test statistic that guide decision-making on the null hypothesis. The rejection region is the range of values for which the null hypothesis is rejected in favor of the alternative hypothesis. Conversely, the acceptance region includes values where the null hypothesis is not rejected. These regions are determined by the chosen significance level, α, and the distribution of the test statistic under the null hypothesis. For example, in a z-test, critical values are calculated based on α, beyond which the test statistic must fall to reject H0. These regions thus help operationalize hypothesis testing decisions .

Sample size directly influences the power of a hypothesis test, which is the probability of correctly rejecting a false null hypothesis. Larger sample sizes increase the power of a test, reducing Type II errors (β), as they provide more accurate estimates of the population parameters and reduce variability. By increasing the sample size, the probability of detecting a true effect improves, leading to higher test sensitivity. While Type I errors (α) are specified by the significance level and impacted less by sample size, maintaining a constant α while increasing sample size enhances the reliability of the test without affecting the chance of rejecting a true null hypothesis. Thus, optimizing sample size balances the risks of both error types and enhances test outcomes' validity .

The null hypothesis, denoted by H0, is a statement that asserts that there is no effect or no difference, and it serves as a default or initial claim in hypothesis testing. It is the hypothesis that is assumed to be possibly true until evidence suggests otherwise. The alternative hypothesis, denoted by HA or H1, is a statement that contradicts the null hypothesis, proposing that there is an effect, a difference, or a relationship. It is the hypothesis that researchers aim to support. The roles of these hypotheses are crucial as they provide a structured framework for testing and validating experimental data through statistical methods .

Consider a study testing whether a new drug reduces blood pressure. A simple hypothesis might specify a normal distribution of blood pressure levels with a mean reduction of exactly 10 mmHg. This completely defines the expected outcome if the drug has the proposed effect. Conversely, a composite hypothesis would suggest that the drug reduces blood pressure by at least 10 mmHg but does not specify the exact amount, encompassing a range of mean reductions beyond merely 10 mmHg. In testing, a simple hypothesis allows precise calculations based on fixed parameters, while a composite hypothesis requires broader evaluations as it involves multiple possible scenarios or parameter values .

The significance level, α, is the probability of making a Type I error and reflects the threshold at which we decide to reject the null hypothesis. It represents the level of risk the researcher is willing to accept for a Type I error. The power of a test, defined as 1 − β, is the probability that the test correctly rejects a false null hypothesis, hence successfully identifying a true effect. The significance level and power are related as both affect the sample size and are influenced by the same data distribution; typically, increasing the power of the test while controlling α requires increasing the sample size or effect size .

A P-value is the smallest level of significance at which the null hypothesis can be rejected, calculated from the test statistic in a given analysis. It represents the probability of observing the sampled data, or something more extreme, assuming the null hypothesis is true. The significance level, α, on the other hand, is a predetermined threshold set by the researcher that determines when the null hypothesis should be rejected. The P-value offers a degree of evidence against the null hypothesis; if it is less than α, the null hypothesis is rejected. Thus, while the significance level is set before testing, the P-value is computed from the data and can vary .