What Is Problem-solving?

Problem-solving is the cognitive and computational process by which an agent, human or automated, identifies a goal state, searches a space of possible actions, and selects a sequence of steps that transforms an initial state into the desired outcome. As a field of study, problem-solving draws from cognitive psychology, artificial intelligence, operations research, and human factors engineering. It is concerned with both how humans naturally reason through novel challenges and how computational systems can be designed to do the same. The discipline is foundational to computer science, where algorithms, heuristics, and search methods formalize the idea of systematic solution-finding.

Research in problem-solving has historically been organized around two modes: algorithmic approaches, which guarantee a correct solution if sufficient computational resources are available, and heuristic approaches, which sacrifice optimality guarantees in favor of reaching a good solution within practical time and resource constraints. Judea Pearl's foundational work Heuristics: Intelligent Search Strategies for Computer Problem Solving established the formal basis for heuristic search as a field and introduced graph-search algorithms such as A* that underpin modern pathfinding, planning, and scheduling systems.

Cognitive Models of Problem-solving

Cognitive psychology frames problem-solving as search through a problem space, a construct introduced by Allen Newell and Herbert Simon in their work on general problem solvers in the 1970s. The problem space consists of an initial state, a goal state, a set of operators that move from one state to another, and constraints that restrict which operators can be applied. Human problem-solvers rarely conduct exhaustive search; instead, they apply means-ends analysis, subgoal decomposition, and pattern recognition to prune the search tree. The field of human factors engineering applies these cognitive models to system design, examining how task structure, interface layout, and workload affect an operator's ability to identify and resolve problems in real time. Research on cognitive properties of human factors in engineering published through IEEE addresses the ways in which cognitive load and situational awareness interact with problem-solving performance in complex sociotechnical systems.

Heuristics and Search Strategies

Heuristics are decision rules or evaluation functions that guide search toward promising regions of the problem space without guaranteeing an optimal outcome. Common families include hill-climbing, best-first search, and branch-and-bound, each suited to different trade-offs between solution quality and computational effort. Simulated annealing and genetic algorithms apply heuristics inspired by physical and biological processes to combinatorial optimization problems where exact methods are computationally intractable. In artificial intelligence, constraint satisfaction formulations reduce a problem to a set of variables, domains, and constraints and then apply propagation and backtracking to find assignments that satisfy all constraints. The Springer Nature chapter on problem-solving and search methods provides a structured taxonomy of these approaches and their relative strengths across different problem classes.

Problem-solving in Engineering Systems

Engineering problem-solving integrates formal methods with domain knowledge and collaborative judgment. Design problems are typically ill-defined: requirements are incomplete, constraints are imprecise, and multiple solutions may be acceptable. Systems engineering practice structures complex problems through functional decomposition, trade-space analysis, and failure mode identification. Formal verification methods apply mathematical proof techniques to hardware and software designs, establishing that a system's behavior meets its specification under all possible inputs. Human operators remain essential in engineering contexts, diagnosing anomalies in power grids, process plants, and aircraft that exceed the modeled scenarios built into automated monitors.

Applications

Problem-solving has applications in a wide range of technical and professional fields, including:

• Artificial intelligence planning and autonomous agent control
• Engineering design, optimization, and decision support
• Human factors and user interface design to reduce cognitive errors
• Fault diagnosis and troubleshooting in manufacturing and infrastructure
• Educational technology and adaptive learning systems