What Is Ray Tracing?

Ray tracing is a rendering and simulation technique that models the propagation of light by following the paths of individual rays as they travel through a scene, interact with surfaces, and are absorbed, reflected, refracted, or scattered. In computer graphics, it produces photorealistic images by simulating the geometric optics of light-surface interaction with a fidelity that rasterization-based pipelines cannot achieve at equivalent quality. In optical engineering and electromagnetic simulation, the same ray-based formalism is used to analyze lens systems, predict antenna propagation, and characterize stray light in optical instruments. The underlying physics, tracing straight-line ray paths through a medium and computing interactions at boundaries, is the same whether the application is a rendered film frame or the optical analysis of a telescope.

The idea of tracing rays backward from an image plane was first described as a rendering technique by Arthur Appel in 1968, and formalized into the recursive shading model still widely used today by Turner Whitted in his 1980 paper "An Improved Illumination Model for Shaded Display." Whitted's algorithm computed reflections, refractions, and shadows by recursively spawning secondary rays, producing the first computationally generated images with physically accurate glass and mirror effects.

Core Algorithm and Light Transport

The standard ray tracing algorithm begins by casting a primary ray from the camera position through each pixel in the image plane into the scene. When that ray intersects a surface, the renderer computes local illumination at the intersection point and spawns secondary rays: shadow rays toward each light source to determine occlusion, reflection rays along the specular reflection direction, and transmission rays through transparent materials following Snell's law. The process recurses until rays reach a light source, exit the scene, or a maximum recursion depth is reached. An IEEE Xplore paper on rendering realistic scenes using ray tracing describes the mathematical formulation of this visibility and shading pipeline and its application to photorealistic scene rendering.

Path tracing, an extension developed by James Kajiya in 1986 from the rendering equation, replaces deterministic secondary rays with Monte Carlo sampling of the hemisphere of possible light directions at each intersection. This approach converges to the physically correct solution of the rendering equation, including indirect illumination and soft shadows, at the cost of noisy images that require many samples per pixel to resolve. Modern production renderers, including those used for visual effects in film, are path tracers.

Hardware Acceleration and Real-Time Ray Tracing

For decades, ray tracing was considered too computationally expensive for real-time applications. A single high-quality image might require millions of primary and secondary ray intersections, each demanding a traversal of an acceleration data structure such as a bounding volume hierarchy (BVH) to identify the nearest surface intersection among potentially millions of scene triangles. GPU-based acceleration began to change this calculus, and NVIDIA's introduction of dedicated RT Core hardware in its Turing architecture in 2018 marked the first consumer graphics hardware with fixed-function ray-triangle intersection units. The ACM implementation study on ray tracing algorithms and graphics rendering documents the performance characteristics of hardware-accelerated BVH traversal and the hybrid rendering pipelines that combine rasterization for primary visibility with ray tracing for reflections and shadows.

Real-time ray tracing at interactive frame rates is now standard in AAA game titles running on modern GPUs, enabled by denoising algorithms that reconstruct a clean image from a small number of samples per pixel using deep learning.

Optical and Electromagnetic Applications

Beyond computer graphics, ray tracing is applied to the analysis of optical systems, where it predicts aberrations, determines stray light paths, and validates lens designs. In antenna propagation modeling, ray-based methods simulate multipath fading in urban environments by tracing reflections from buildings. IEEE's research on using game engines for ray tracing physics demonstrates how graphics ray tracing infrastructure can be adapted for radiofrequency propagation simulation, unifying the software tools used for graphics and physical modeling.

Applications

Ray tracing has applications across a range of fields, including:

• Photorealistic rendering for film visual effects, animation, and architectural visualization
• Real-time rendering in video games using hybrid rasterization and ray tracing pipelines
• Optical system design, including stray light analysis in telescopes, cameras, and scientific instruments
• Radiofrequency propagation simulation for wireless network planning in complex environments
• Non-destructive testing using acoustic ray tracing to model ultrasound wavefield propagation