What Is Extended Reality?

Extended reality (XR) is an umbrella term covering the spectrum of technologies that combine digital content with the physical environment or replace it entirely, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). The unifying concept across all three is the manipulation of a user's perceptual relationship to their surroundings through computational rendering, tracking, and display systems. XR is formally addressed in IEEE P7030, the Recommended Practice for Ethical Assessment of Extended Reality Technologies, which establishes definitions and sociotechnical assessment frameworks covering augmented reality, virtual reality, immersive web, and spatial web systems.

The field draws on computer graphics, sensor fusion, human-computer interaction, optics, and display engineering. Its technical lineage includes Ivan Sutherland's 1968 head-mounted display prototype and the military flight simulators of the 1970s. XR platforms became commercially viable in the 2010s when inertial measurement unit (IMU) technology, GPU performance, and display miniaturization converged to the point where interactive head-mounted systems could be manufactured at consumer price points.

Virtual Reality

Virtual reality replaces the user's visual and auditory perception entirely with computer-generated content delivered through a head-mounted display. Contemporary VR headsets track head orientation and position using a combination of IMUs, optical sensors, and depth cameras to maintain the alignment between user head movement and rendered viewpoint, a property called six-degrees-of-freedom (6DoF) tracking. Latency between head motion and image update, called motion-to-photon latency, must remain below approximately 20 milliseconds to avoid perceptual discomfort. Resolution, field of view, and refresh rate are the primary display parameters that determine perceived realism.

Standalone headsets, which integrate processing onboard, are distinguished from tethered systems that offload rendering to a desktop GPU. The tradeoff is between portability and graphical fidelity. The U.S. Government Accountability Office's Science and Technology Spotlight on Extended Reality Technologies describes current VR, AR, and MR device categories, noting that advances in foveated rendering, which concentrates resolution only in the direction the eye is focused, are critical to achieving high-fidelity VR within the power budgets of standalone devices.

Augmented and Mixed Reality

Augmented reality overlays computer-generated graphics, text, or other data onto the user's view of the physical world without replacing it. Implementations range from smartphone camera pass-through displays to optical see-through headsets that superimpose images directly onto the user's visual field using partially reflective combiners. AR applications require real-time estimation of the pose of the physical environment relative to the display, a problem solved by simultaneous localization and mapping (SLAM) algorithms running on the device.

Mixed reality extends augmented reality by enabling digital objects to interact spatially with physical ones: a virtual sphere rolling behind a real table, or a digital overlay that occludes when a real hand passes in front of it. Achieving physically consistent interaction requires depth sensing, often provided by structured light or time-of-flight sensors, and rendering pipelines that integrate real-world geometry into scene composition in real time.

Research published through IEEE Xplore on XR in workplace settings identifies spatial anchoring, persistence of virtual content across sessions in fixed physical locations, as a core unsolved problem for enterprise AR deployments, where digital annotations on physical machinery must remain accurately registered over shifts and maintenance cycles.

Applications

Extended reality has applications in a wide range of fields, including:

• Industrial training and remote expert assistance on complex equipment
• Surgical planning visualization and medical education
• Architecture and construction design review with spatial walkthroughs
• Military simulation and mission rehearsal
• Retail and e-commerce product visualization for consumers