What Are Vectors?

Vectors are mathematical objects defined by both a magnitude and a direction, distinguishing them from scalar quantities that carry magnitude alone. In the formal sense of linear algebra, a vector is an element of a vector space: any object that obeys the axioms of vector addition and scalar multiplication. This abstraction encompasses geometric directed line segments in two or three dimensions, sequences of real or complex numbers, functions in a Hilbert space, and many other structures, making vectors one of the most broadly applicable constructs in engineering and applied mathematics.

The concept of vectors in geometry and mechanics was developed during the 19th century by William Rowan Hamilton, Hermann Grassmann, and Josiah Willard Gibbs. The modern notation of bold letters and component representations became standard in the 20th century. In electrical engineering and physics, vectors appear in two closely related but distinct ways: as geometric objects describing physical quantities such as force, velocity, and electric field, and as abstract n-tuples of numbers used in linear algebra to analyze systems of equations, signal transformations, and data representations.

Vector Spaces and Linear Operations

A vector space over a field (typically the real or complex numbers) is a set V together with two operations: vector addition, which combines two vectors to produce another, and scalar multiplication, which scales a vector by a number. These operations satisfy eight axioms including commutativity, associativity, and the existence of an additive identity (the zero vector) and additive inverses. A basis for a vector space is a minimal set of linearly independent vectors that span the space; the number of basis vectors is the dimension. Inner products, which generalize the dot product, assign a scalar to each pair of vectors and enable the definition of orthogonality, projection, and geometric length (the norm). The NIST Digital Library of Mathematical Functions documents the standard definitions and properties of vector spaces, inner products, and related constructs used across applied mathematics and engineering.

Eigenvalues and Eigenvectors

An eigenvector of a square linear transformation (or matrix) A is a nonzero vector v such that Av equals a scalar multiple of v, written Av = λv, where λ is the corresponding eigenvalue. Eigenanalysis reveals the intrinsic structure of a linear transformation: eigenvectors point in the directions that the transformation stretches or compresses without rotating, and eigenvalues give the scale factors. For symmetric matrices, all eigenvalues are real and eigenvectors corresponding to distinct eigenvalues are orthogonal, a result central to the spectral theorem. Eigendecomposition underpins principal component analysis, the discrete Fourier transform (where the complex exponentials are eigenfunctions of the convolution operator), and the stability analysis of differential equations and feedback control systems. The MIT OpenCourseWare course on linear algebra (18.06) provides a rigorous, freely accessible treatment of eigenvectors and their applications in engineering contexts.

Vector Calculus and Field Representations

In three-dimensional space, vector calculus extends differentiation and integration to vector-valued functions. The gradient of a scalar field assigns a vector at each point indicating the direction and magnitude of the greatest rate of increase. The divergence of a vector field measures the net outward flux per unit volume at each point, and the curl measures rotational tendency. Gauss's divergence theorem and Stokes' theorem relate volume and surface integrals of divergence and curl to boundary integrals, forming the analytical backbone of electromagnetic field theory as described in Maxwell's equations. In signal processing, the concept of a signal vector in an n-dimensional space is the foundation of filter bank design, compressed sensing, and the analysis of wireless communication channels. The arXiv preprint series in mathematical physics regularly publishes work applying vector field theory to electrodynamics, fluid mechanics, and continuum mechanics.

Applications

Vectors have applications in a wide range of scientific and engineering disciplines, including:

• Signal processing, where signal vectors are projected onto basis sets for filtering, coding, and spectral analysis
• Computer graphics and animation, where position, velocity, and normal vectors define geometry and illumination
• Machine learning, where data instances and model parameters are represented as vectors in high-dimensional spaces
• Electromagnetic analysis, where electric and magnetic fields are modeled as vector fields satisfying Maxwell's equations
• Structural and mechanical engineering, where force, displacement, and stress vectors describe loading and deformation