Lower bound
What Is a Lower Bound?
A lower bound is a value that no element of a given set falls below. In the order-theoretic definition, an element b of a partially ordered set is a lower bound of a subset S if b is less than or equal to every member of S. The greatest such value, when it exists, is the infimum or greatest lower bound, and the completeness axiom of the real numbers guarantees that every nonempty set of reals bounded below has one. The dual notion is the upper bound, and a set possessing both is called bounded.
Beyond this definition, the term carries a second and equally important sense across engineering and computer science: a proven limit on the best performance any method can achieve on a problem. In that sense a lower bound is a statement of impossibility. It says that no algorithm can run faster, no estimator can be more precise, and no code can be shorter than a stated quantity, regardless of how clever the design. Because such statements quantify over all possible approaches rather than a particular one, they are generally far harder to establish than upper bounds, which need only one working construction.
Order Theory and Analysis
In real analysis the greatest lower bound underpins the definitions of limit inferior, convergence, and the Riemann and Lebesgue integrals, since lower Darboux sums are built from infima over subintervals. Lattice theory generalizes the idea: in a meet-semilattice every pair of elements has a greatest lower bound, written as their meet, and complete lattices extend this to arbitrary subsets. These structures appear in program analysis, where the meet of abstract states computes the strongest property that holds on all execution paths, and in formal concept analysis and type systems, where a greatest lower bound corresponds to the most general common subtype.
Lower Bounds in Computational Complexity
Proving that a problem requires at least a certain quantity of time, space, circuit size, or communication is one of the central goals of theoretical computer science, and one of its most stubborn. Comparison-based sorting is bounded below by n log n through a decision tree argument, and information-theoretic and adversary arguments give tight bounds for a number of other problems. General circuit complexity has resisted comparable progress: the best proven size bound for an explicit Boolean function remains a small constant multiple of the input length, as surveyed in the Simons Institute's research vignette on lower bounds in computational complexity. Barriers including relativization, the natural proofs barrier of Razborov and Rudich, and algebrization explain why standard techniques stall. Restricted models fare better, and results such as lower bounds for the size of nondeterministic circuits illustrate the incremental progress typical of the area.
Bounds in Estimation and Optimization
Statistical signal processing uses lower bounds to establish the best precision attainable from a measurement. The Cramér-Rao lower bound states that the covariance of any unbiased estimator is at least the inverse of the Fisher information matrix, which makes it the standard benchmark for radar, sonar, localization, and channel estimation algorithms; extensions such as the Cramér-Rao bound for estimation after model selection adapt it to settings where the model itself is chosen from data. Related bounds include the Ziv-Zakai and Barankin bounds at low signal-to-noise ratio, and Shannon's channel capacity, which lower bounds the energy per bit any reliable code requires. In discrete optimization, relaxations of an integer program yield lower bounds that prune the search tree in branch and bound.
Applications
Lower bounds are used across fields including:
- Algorithm design and analysis of computational hardness
- Cryptography, where security rests on proven or conjectured hardness
- Radar, sonar, and wireless localization system design
- Communication system design against the Shannon limit
- Operations research and integer programming solvers
- Static program analysis and compiler optimization