Multimedia communication
What Is Multimedia Communication?
Multimedia communication is the transmission of integrated audio, video, text, and data between endpoints over wired or wireless networks. It combines signal processing, network engineering, and source coding to deliver synchronized media streams with quality sufficient for voice, video conferencing, streaming entertainment, and interactive services. The field emerged as a discipline in the late 1980s when advances in digital compression and packet-switched networking made it practical to carry more than one media type on a single connection.
Multimedia communication draws on both circuit-switched telephony traditions and packet-switched data networking. Early broadband deployments used ISDN and later B-ISDN as the transmission substrate, providing guaranteed bandwidth pipes. The shift toward IP-based transport introduced flexibility but also variability in delay, loss, and jitter, making quality-of-service (QoS) management central to the discipline.
Broadband Transport and QoS Architectures
Reliable multimedia delivery over shared IP networks depends on mechanisms that give time-sensitive media streams preferential treatment. The IntServ architecture, defined in IETF RFC 2205, uses the Resource Reservation Protocol (RSVP) to reserve bandwidth and buffer capacity along a per-flow path before transmission begins. DiffServ, defined in IETF RFC 2474, takes a coarser approach: traffic is marked at the network edge with a Differentiated Services Code Point (DSCP), and interior routers forward packets according to per-hop behaviors without maintaining per-flow state. DiffServ scales more readily to large networks, while IntServ provides stronger per-flow guarantees for applications such as video conferencing that require bounded latency and jitter. Both architectures address what the IETF recognized in the mid-1990s as the fundamental tension between the efficiency of best-effort forwarding and the timing demands of real-time media.
Real-Time Transport Protocols
The Real-time Transport Protocol (RTP) and its companion Real-time Transport Control Protocol (RTCP) provide the application-layer foundation for multimedia communication over IP. RTP carries sequenced, timestamped media payloads and identifies the codec in use; RTCP carries periodic control packets that report reception statistics, allowing senders to adapt bitrate in response to measured packet loss or delay. The Session Initiation Protocol (SIP) and H.323 are the dominant signaling protocols, each responsible for negotiating codec parameters, establishing sessions, and routing calls. Most consumer video conferencing systems, including those complying with the WebRTC browser standard, build on RTP/RTCP beneath a higher-level application layer.
Transcoding and Adaptive Delivery
Endpoints in multimedia communication systems differ widely in processing capacity, screen resolution, and available bandwidth, so transcoding, the process of converting a media stream from one encoding format, bitrate, or resolution to another, is a standard infrastructure function. A transcoding server may convert a high-definition H.265 stream to a lower-resolution H.264 stream for a mobile client, or re-encode audio from the Opus codec to G.711 at a gateway bridging IP and public switched telephone network (PSTN) segments. Adaptive bitrate streaming (ABR) protocols such as MPEG-DASH extend this principle by encoding a single media asset at multiple quality levels, then directing the client to switch between levels based on measured throughput. The MPEG-7 Multimedia Content Description Interface, standardized as ISO/IEC 15938, provides a metadata layer that can accompany streams to describe content type, language, and access restrictions, supporting automated routing and transcoding decisions in large distribution systems.
Applications
Multimedia communication has applications in a wide range of fields, including:
- Video conferencing and unified communications in enterprise and government
- Telemedicine and remote patient monitoring over broadband connections
- Distance learning and interactive educational broadcasting
- Video surveillance and real-time monitoring over IP networks
- Consumer streaming services and over-the-top video delivery
- Emergency response coordination using integrated voice and video channels