What Is Virtual Reality?

Virtual reality (VR) is a technology that immerses a user in a computer-generated three-dimensional environment that can be perceived and interacted with through specialized hardware and software. The user experiences the environment from a first-person perspective, with the display updating in real time to reflect head movement and physical actions, creating a sense of presence that distinguishes VR from conventional screen-based media. The field draws on computer graphics, display optics, sensor fusion, spatial audio, and human factors research, and its conceptual foundations were developed in the 1960s and 1970s by researchers including Ivan Sutherland, whose 1968 head-mounted display is considered an early precursor to modern VR systems.

Contemporary VR systems deliver stereoscopic imagery to each eye through a head-mounted display (HMD), use inertial measurement units (IMUs) and optical tracking to determine head pose, and supplement visual immersion with spatial audio that shifts the apparent direction and distance of sounds as the user moves. Motion controllers, full-body tracking suits, and haptic feedback devices extend interaction to the user's hands and body.

Immersive Display and Tracking Systems

The display subsystem of a VR headset must deliver high resolution, a wide field of view, and a motion-to-photon latency below approximately 20 milliseconds to avoid perceptual artifacts that cause discomfort. The IEEE standard 3079-2020 for HMD-based VR sickness reduction defines requirements and test methods for motion-to-photon latency, recognizing it as the primary hardware parameter governing user comfort. Tracking systems fall into inside-out configurations, where cameras mounted on the headset map the surrounding environment and compute pose from observed features, and outside-in configurations, where fixed external sensors track markers on the headset. Room-scale VR, which allows users to walk freely within a physically bounded area, depends on accurate six-degrees-of-freedom (6DoF) tracking. Solid modeling and polygon rendering pipelines optimized for stereoscopic real-time output drive the GPU workload, requiring careful level-of-detail management to maintain frame rates above 90 Hz.

Interaction and Affordances

Affordances in VR are the perceivable action possibilities offered by virtual objects and environments: whether a door handle appears graspable, whether a surface looks walkable, whether a button looks pressable. Designing effective affordances in virtual environments requires translating the physical cues that guide real-world interaction into graphical and audio signals. Hand controller tracking maps physical hand position into the virtual scene, and interaction systems use collision detection and physics simulation to govern how users pick up, manipulate, and release virtual objects. Spatial audio plays a significant role in reinforcing affordances: localized sound cues confirm interactions, signal events in the peripheral field of view, and contribute to the sense that the virtual environment occupies real space around the user. Research published in the IEEE VR 2022 conference proceedings covers a range of interaction techniques, from bare-hand gesture recognition to controller-based ray-casting, evaluating them for task performance and user comfort across application domains.

Mixed Reality and the XR Continuum

VR sits at the fully immersive end of the extended reality (XR) continuum, which also includes augmented reality (AR), where digital content overlays the real world, and mixed reality (MR), where virtual and physical objects coexist and interact. The boundaries between these categories have blurred as headsets have added outward-facing cameras that can display a passthrough view of the physical environment alongside virtual overlays, enabling a single device to operate across the continuum. Digital twin applications, where a VR environment is synchronized with real-time sensor data from a physical system, occupy a hybrid position: the virtual environment is immersive and computer-generated, but its state mirrors that of an existing physical asset. The Microsoft Learn overview of mixed reality describes the spectrum from fully physical to fully virtual environments and how modern headsets traverse it.

Applications

Virtual reality has applications in a wide range of fields, including:

• Military, industrial, and medical training and simulation
• Architectural and product design review and stakeholder communication
• Physical therapy, pain management, and exposure therapy in clinical settings
• Interactive entertainment, narrative experiences, and social platforms
• Remote collaboration and virtual workspaces for distributed teams