Linear approximation
What Is Linear Approximation?
Linear approximation is a mathematical technique for replacing a nonlinear function or system with a linear model that closely matches its behavior within a restricted operating range. The approximation is constructed by evaluating the function and its first derivatives at a chosen reference point, producing a tangent line or hyperplane that represents the function to first order. Within a sufficiently small neighborhood of the reference point, the linear model tracks the nonlinear function with useful accuracy, enabling the application of linear analysis and design tools to problems that would otherwise require more complex nonlinear methods.
Linear approximation is foundational in engineering, physics, and applied mathematics because most analytical and numerical tools for systems analysis, stability assessment, and control design assume linear behavior. Nonlinear differential equations do not in general have closed-form solutions, but their linearized counterparts can be analyzed with standard methods for ordinary differential equations, Laplace transforms, and linear algebra. The technique connects directly to Taylor series expansion, differential calculus, and perturbation theory.
Taylor Series Linearization
The mathematical basis of linear approximation is the Taylor series expansion of a smooth function about an operating point. For a scalar function f(x) expanded around a point x_0, the first-order approximation is f(x) approximately equals f(x_0) plus f'(x_0) times (x minus x_0), retaining only the constant and linear terms of the series. The quadratic and higher-order terms are discarded; this is justified when the deviation from x_0 is small enough that the neglected terms are negligible compared to the linear term.
For functions of multiple variables, the first-order Taylor expansion uses partial derivatives: the approximation near a point (x_0, y_0) adds partial derivative terms in each variable, evaluated at the reference point. This multivariable form of linearization is the basis for small-signal models in analog circuit analysis, where transistor characteristics are replaced by linear conductance and transconductance parameters evaluated at a DC bias point. The validity of the small-signal model depends on the signal amplitude remaining small compared to the scale over which the nonlinearity changes appreciably.
Jacobian Linearization of Nonlinear Systems
For nonlinear dynamic systems described by differential equations, linear approximation is carried out around an equilibrium point where all time derivatives are zero. The state equations dx/dt = f(x, u) are expanded to first order using the Jacobian matrices: the matrix of partial derivatives of f with respect to the state vector x, and the matrix of partial derivatives with respect to the input u, both evaluated at the equilibrium. The resulting linear state-space model captures the dynamics of small perturbations around the operating point and is the standard model used in control system design.
The stability of the nonlinear system near an equilibrium can be assessed from the eigenvalues of the Jacobian: if all eigenvalues have negative real parts, the equilibrium is locally asymptotically stable, and the linear model accurately represents the local dynamics. Linearization of nonlinear differential equations using Taylor's series provides a systematic treatment of this procedure for systems with both scalar and vector state variables. The Taylor and Francis reference on linearization discusses both the theoretical basis and engineering contexts where the technique is applied, including gain-scheduling for systems whose operating point shifts over a wide range. The limitation is that the linear model fails for large perturbations: trajectories that take the system far from the equilibrium may not be well described by the local linear approximation, and phenomena such as limit cycles or chaos, which are absent from linear models, may dominate the true behavior.
Applications
Linear approximation has applications in a range of fields, including:
- Control system design, where PID and state-feedback controllers are designed from linearized plant models
- Analog circuit simulation, where small-signal equivalent circuits replace nonlinear device models for AC analysis
- Numerical methods, where Newton-Raphson iteration uses linear approximation to find roots of nonlinear equations
- Structural engineering, where linear elastic models approximate the behavior of materials under small strains
- Computational fluid dynamics, where linearized flow equations are used in stability analysis of laminar flow profiles