What Are Video Codecs?

Video codecs are software or hardware components that encode video data into a compressed format for storage or transmission, and decode that compressed data back into displayable frames. The word "codec" is a contraction of coder-decoder, reflecting the two complementary operations. Without codecs, uncompressed video would be impractical for most uses: a single minute of uncompressed 1080p video at 30 fps and 8-bit depth requires approximately 12 gigabytes of storage.

Codecs operate by exploiting two fundamental types of redundancy in video. Spatial redundancy refers to the similarity of adjacent pixels within a single frame, while temporal redundancy refers to the similarity between successive frames in a sequence. Most practical codecs address both, applying transform coding (commonly the discrete cosine transform) within frames and motion-compensated prediction between frames.

Standards and Codec Families

The dominant codec standards have been developed jointly by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). H.264, also known as Advanced Video Coding (AVC), was finalized in 2003 and became the most widely deployed standard in history, supported across virtually every consumer device and platform. Its successor, H.265 (High Efficiency Video Coding, or HEVC), was finalized in 2013 and offers approximately 50 percent better compression than H.264 at equivalent visual quality. A coding efficiency study comparing AV1, H.265, and H.264 confirmed these efficiency differences in controlled encoder comparisons.

The MPEG-4 standard, an earlier milestone, introduced object-based video coding and was the basis for the AAC audio codec as well as video coding profiles used in early streaming and mobile applications. While newer codecs have superseded MPEG-4 video coding in most contexts, the container formats and audio coding tools from MPEG-4 remain in widespread use.

Open and Royalty-Free Codecs

A parallel track of codec development has produced open, royalty-free alternatives. Google's VP8 and VP9 codecs, used primarily in WebM containers for browser-based video, established an open codec tradition. AV1, released in 2018 by the Alliance for Open Media (a consortium including Google, Netflix, Amazon, Apple, Microsoft, and Intel), achieves roughly 30 percent better compression than H.265 and carries no per-stream royalty obligations. AV1 adoption has grown rapidly in streaming contexts where licensing costs and patent encumbrances associated with HEVC create deployment friction.

The ITU-T and MPEG groups continue developing the H.266 (Versatile Video Coding, or VVC) standard, which targets another doubling of compression efficiency over HEVC for 4K and 8K content. Meanwhile, neural network-based video coding has emerged as a research direction, with learned transform and prediction models beginning to rival hand-engineered codecs on standard benchmarks. The IEEE Signal Processing Society identifies video coding as a central application area for signal processing research.

Codec Selection Criteria

Codec choice in a deployment involves trade-offs among compression efficiency, computational complexity for encoding and decoding, licensing costs, and hardware support. A codec comparison paper published by the Alliance for Open Media illustrates these trade-offs quantitatively using peak signal-to-noise ratio and structured similarity index measures. Consumer devices have dedicated hardware decoders for widely adopted codecs, making software-only codecs unsuitable for battery-constrained applications even if their compression is superior.

Applications

Video codecs have applications in a wide range of disciplines, including:

• Streaming media platforms and adaptive bitrate delivery
• Video conferencing and real-time communication
• Broadcast television and over-the-top content
• Digital cinema and post-production archiving
• Surveillance and security systems
• Mobile video and short-form content platforms