What Is Immersive Video?

Immersive video is a class of video content and delivery technology that captures or synthesizes a full spherical or wide-field scene and presents it in a way that allows the viewer to direct their gaze freely within the recorded environment, producing a sense of spatial presence stronger than that of conventional flat-frame video. The term covers 360-degree monoscopic video, stereoscopic 360-degree formats that add depth perception, and six-degrees-of-freedom (6DoF) video that permits small lateral translations in addition to rotational head movement. Immersive video draws on computer vision, video compression, network engineering, and display technology, and it has become a distinct area of study within the IEEE Multimedia and IEEE VR research communities.

The production pipeline for immersive video begins with multi-camera rigs, typically an array of wide-angle lenses arranged in a spherical configuration, whose individual streams are stitched computationally into a single equirectangular projection. Resolution requirements are substantially higher than for conventional video because the full spherical image must contain enough detail to appear sharp when only a fraction of it, the portion within the viewer's field of view, is displayed at any moment.

Capture and Projection Formats

Spherical video is most commonly stored and transmitted in equirectangular projection, which maps the sphere onto a flat rectangle by treating longitude and latitude as Cartesian coordinates, analogous to the Mercator map projection. This format is widely supported by encoding pipelines and platforms but oversamples the polar regions, which are rarely the focus of viewer attention. Cube-map projections tile the sphere onto the six faces of a cube and can improve coding efficiency in polar regions. Tiled encoding approaches subdivide the sphere into independently encoded regions, which simplifies partial decoding; a player need only decode the tile or tiles that correspond to the viewer's current viewport rather than the entire frame. IEEE conference research on viewport-adaptive encoding and streaming of 360-degree video established a foundational framework for these adaptive tile-based delivery systems.

Viewport-Adaptive Streaming

Because the viewer of an immersive video can only perceive a portion of the full spherical frame at any moment, bandwidth can be saved by predicting where the viewer will look and delivering high-quality tiles for that region while transmitting other regions at lower bitrate. Head-movement prediction models, often based on recurrent neural networks trained on gaze datasets, feed these streaming decisions in real time. The approach is integrated into MPEG-DASH-based adaptive bitrate systems, where the client communicates viewport orientation to the server to steer which quality level is sent for each tile. Research on adaptive 360-degree VR video streaming published through IEEE and arXiv described a divide-and-conquer tiling strategy that reduced bandwidth requirements by more than half in simulations using real head-movement traces, without perceptible quality reduction within the field of view.

Display and Playback Systems

Immersive video is consumed through three main display configurations. Head-mounted displays provide the strongest sense of presence because the HMD tracks head rotation and updates the rendered viewport in real time; consumer devices including the Meta Quest and PlayStation VR2 are designed to support 360-degree video playback natively. Flat-panel and curved displays presenting a wide field of view without head tracking offer a less immersive but more accessible alternative for broadcast applications. Dome theaters and cylindrical projection installations serve planetariums, science centers, and immersive event venues, where audiences experience the spherical content without wearing personal devices. IEEE Spectrum coverage of virtual reality telepresence and 360-degree video examined edge-compute-assisted compression for live 360-degree streaming, demonstrating the feasibility of real-time immersive broadcast at broadcast-quality bitrates.

Applications

Immersive video has applications in a range of fields, including:

• Journalism and documentary production using 360-degree field reporting
• Live sports and entertainment broadcasting delivered to consumer VR headsets
• Real estate and tourism virtual walkthroughs for remote audiences
• Medical education using recorded surgical procedures in spherical video
• Cultural heritage preservation through virtual tours of historical sites