Parametric statistics
What Is Parametric Statistics?
Parametric statistics is a branch of statistics that draws inferences from data by assuming those data were generated by a probability distribution with a fixed, finite set of parameters. The key word is "parametric": the analyst specifies a distributional family, such as the normal, binomial, Poisson, or exponential, and then uses the data to estimate the parameters of that family, such as the mean and variance. All subsequent inferences, confidence intervals, hypothesis tests, and regression fits, flow from that distributional assumption. This distinguishes parametric statistics from nonparametric methods, which make fewer assumptions about the underlying distribution.
The field draws on probability theory, calculus, and linear algebra, and its modern form was largely established in the early twentieth century through the work of Karl Pearson, Ronald Fisher, and Jerzy Neyman. Parametric methods are the default in engineering research because they tend to produce narrower confidence intervals and more powerful hypothesis tests than distribution-free alternatives, provided the assumed distributional family is a reasonable description of the data.
Distributional Assumptions and Model Specification
The practical starting point in parametric analysis is verifying that the chosen distribution fits the data. For continuous outcomes, the Gaussian (normal) distribution is the most common assumption, justified theoretically by the central limit theorem: the sum of many independent random variables converges in distribution to a Gaussian regardless of their individual distributions. Formal normality tests, including the Shapiro-Wilk test for samples under 50 observations and the Kolmogorov-Smirnov test for larger samples, assess whether the data are consistent with normality. For count data, the Poisson or negative binomial distribution is typically assumed. The overview of parametric and nonparametric tests from the Mayo Clinic Research department provides a practical guide to selecting and verifying distributional assumptions before applying parametric procedures.
Common Parametric Tests
The most widely used parametric hypothesis tests are variants of the t-test and the F-test. The one-sample t-test assesses whether a sample mean differs from a specified value; the two-sample t-test compares means between two groups; and the paired t-test handles matched observations. Analysis of variance (ANOVA) generalizes the two-sample comparison to three or more groups by partitioning total variation into between-group and within-group components, testing whether group means are equal under the assumption of normally distributed residuals with equal variance. Linear regression is the parametric model for predicting a continuous outcome from one or more predictors, with parameter estimates obtained by ordinary least squares. The Boston University School of Public Health materials on nonparametric tests clarify which parametric assumptions each test requires and when a nonparametric alternative is appropriate.
Estimation and Power
Within the parametric framework, maximum likelihood estimation (MLE) is the standard method for estimating distributional parameters. MLE finds the parameter values that maximize the probability of the observed data, and under regularity conditions it is consistent, asymptotically unbiased, and achieves the Cramer-Rao lower bound on variance. Statistical power, the probability of correctly rejecting a false null hypothesis, is generally higher for parametric tests than for their nonparametric counterparts when distributional assumptions hold, which motivates the preference for parametric methods in engineering applications where sample sizes are controlled. The parametric test overview from ScienceDirect Topics covers the relationship between sample size, effect size, and power for the main parametric tests.
Applications
Parametric statistics has applications in a wide range of engineering and scientific contexts, including:
- Quality control in manufacturing, using t-tests and ANOVA to compare process means across production lines
- Signal-to-noise ratio estimation in communications and radar systems
- Reliability analysis and failure rate modeling using Weibull or exponential distributions
- Experimental design and analysis of variance in materials science and chemical engineering
- Regression modeling for sensor calibration and measurement system characterization