What Is Telexistence?

Telexistence is a technology concept that enables a human being to have a real-time sensation of existing at a place other than their actual location, to interact with the remote environment through an avatar body, and to perform physical tasks there as if they were physically present. The concept was formulated by Prof. Susumu Tachi at the University of Tokyo in 1980 and has since grown into a research area combining robotics, virtual reality, haptics, and high-speed communications. Unlike conventional telepresence systems that provide primarily visual and auditory channels, telexistence systems aim to deliver the full sensory experience of physical presence, including touch, force, and temperature.

The field distinguishes itself from virtual reality by grounding the experience in a real, remote environment rather than a computer-generated one. A telexistence system consists of an avatar robot at the remote site, a master station worn or operated by the human user, and a bidirectional communication link that carries sensory data from the robot to the user and commands from the user to the robot in close to real time.

Sensory Display Systems

The sensory display subsystem in a telexistence setup presents the remote environment to the human operator across multiple modalities. Visual feedback is typically delivered through a stereoscopic head-mounted display driven by cameras on the avatar robot's head, with the display tracking the operator's head movements so the camera system reorients to match the operator's gaze. Auditory feedback uses binaural microphones to provide spatial sound cues. Haptic feedback, considered the defining capability of mature telexistence systems, uses force, vibration, and temperature sensors distributed across the robot's hands and fingers to generate corresponding sensations through actuators in the master gloves or exoskeleton. The TELESAR V and TELESAR VI systems developed at Tachi Lab demonstrate full upper-body telexistence with 67 degrees of freedom and haptic sensation governed by the principle of haptic primary colors, described in detail on the Tachi Lab telexistence research pages.

Control and Presence

The sense of presence, meaning the subjective feeling of actually being in the remote location rather than operating a remote machine, is the central performance metric for telexistence systems and distinguishes them from conventional teleoperation. Presence arises from the combination of sensory richness, sensory congruence (the correspondence between the operator's movements and the avatar's responses), and low perceptual delay. The master station captures the operator's full body pose and transmits it to the slave robot, which replicates those movements in the remote environment while the sensory data flows in the opposite direction. As surveyed in IEEE Transactions on Robotics research on humanoid robot teleoperation, the depth and fidelity of this bidirectional coupling determine whether the operator experiences immersive presence or the disconnected sensation characteristic of simpler remote control.

Latency and Synchronization

The perceptual quality of a telexistence experience degrades sharply when communication latency causes a mismatch between the operator's movements and the avatar's corresponding actions or sensory feedback. Studies on visual feedback latency find that delays above 50 to 100 milliseconds are noticeable and begin to disrupt the sense of presence; delays above 250 milliseconds impair motor control. As reviewed in PubMed research on telexistence and human ubiquity, managing this latency requires co-optimizing the communication infrastructure, the robot's servo bandwidth, and the rendering pipeline of the head-mounted display. Predictive algorithms that estimate the robot's future position and pre-render the corresponding visual can partially compensate for network-induced latency, a technique borrowed from flight simulation and extended to the richer sensory channels of telexistence.

Applications

Telexistence has applications in a wide range of domains, including:

• Remote surgery and medical intervention in resource-limited settings
• Hazardous environment inspection and intervention (nuclear, disaster response)
• Space exploration using avatar robots operated from Earth or orbit
• Remote manufacturing and assembly in inaccessible facilities
• Tourism and cultural heritage access for mobility-impaired individuals
• Education and training in simulated real-world environments