Holograms — spatial video, volcap, light fields — have long been a research curiosity, used in production mostly for immersive experiences or background content. But recently the landscape has changed; in this talk we'll cover how AI-driven holographic technology is opening up new possibilities in film, broadcast, and immersive applications. As recently as five years ago, 3D holographic images looked like a bad video game. This all changed with NeRF and Gaussian Splats, which suddenly were capable of photorealistic holograms. These technologies are just now coming to market, with initial applications in visual effects, immersive entertainment, and augmented reality broadcast.
In visual effects, these technologies allow unprecedented control of a virtual camera, producing A-camera-quality outputs while giving creatives absolute control over camera movement. This is more than bullet time, it's complete control over time and space in a virtual set, entirely captured by cameras. It's faster to produce and can be higher quality than digi-doubles or deep fakes, plus it's significantly more fun to work with. In the broadcast sphere, the technology is currently limited to pre-recorded 3D images — enabling "augmented reality" broadcasts that mix live studio environments with pre-recorded holograms. Today, a studio can drop a full 3D capture of an athlete or celebrity directly into the live broadcast, seamlessly. Within five years, though, this technology will be real time, allowing live holographic experiences — first for 2D displays, then eventually for fully holographic devices. The talk will feature recent examples from Aina's 75-camera system. If you're interested in next-generation visual experiences, or curious about how holographic tech will influence filmmaking and broadcast in the very near future, put this talk on your schedule. Visual effects supervisors, directors, and producers with skeptical questions are particularly welcome.