We’ve been hearing for years that augmented reality (AR) and virtual reality (VR) are the future of content, but until now, the reality has often fallen short of the hype. That changed the moment we put on Apple Vision Pro at their Sydney headquarters. What we experienced wasn’t just an incremental update—it was a paradigm shift. Both immersive video and spatial video are about to redefine not just how we watch, but how we feel video content.
Apple’s demos of these technologies were astonishing. One minute, we were sitting court side at an NBA and NFL game, and it wasn’t just a typical wide shot. It felt like we were there. The crowd’s energy, the players’ movements, the sense of being present—this wasn’t just viewing; it was transporting. Moments later, we were sitting across the table from a child blowing out birthday candles, watching the smoke drift past us as though we could reach out and touch it.
These experiences weren’t imagination; they were real, thanks to stereoscopic video and cutting-edge hardware. And while it’s thrilling, it also makes one thing clear: immersive and spatial video aren’t just for gamers and technophiles. This is the next frontier for everyone—from filmmakers and educators to advertisers and families.
Immersive Video: The Next Leap in Professional Production
First, let’s talk about immersive video, the one that had us court side at the game. Traditional video, no matter how slick or high-definition, still feels flat. Immersive video uses stereoscopic cameras that record two slightly different angles for each eye, mimicking natural vision. When these two videos play through a device like the Apple Vision Pro, they create real-world depth and space. The footage is filmed in ultra-high-definition (up to 8K resolution), capturing every detail—from subtle facial expressions to the texture of the court—with hyper-realism
So, what makes this different from what we’ve seen before? Simple: the sense of presence. It’s not just about high-quality visuals; it’s about feeling like you’re there. Traditional 2D video creates a wall between you and the scene. Immersive video tears that wall down.
Yet, as exciting as this is, there’s a catch—no production cameras currently exist for immersive video. While Canon has developed a stereoscopic lens and Black Magic is developing a camera to capture this type of content, we’re still in a transitional phase. For now, professionals are experimenting with devices like the iPhone 16 Pro and Apple Vision Pro, testing the waters of what’s possible in immersive video production.
Spatial Video: Bringing Immersive Experiences to Everyday Life
On the more personal side of things, we have spatial video, which could be described as immersive video’s everyday cousin. Unlike the massive professional rigs needed to produce immersive content, spatial video can be shot on devices we already have—namely, the iPhone 16 Pro.
This was demonstrated to us through a clip of a child’s birthday party, filmed on the iPhone. The result? A video that didn’t just capture the moment but made us feel as though we were right there, seated at the table. As the child blew out the candles, the smoke seemed to drift by us, almost tangible. The depth and realism were staggering.
Spatial video bridges a gap we didn’t even know existed. It adds dimension to personal memories, creating emotional experiences that standard videos simply can’t. This could be a game-changer for how we record family events, travel experiences, or even everyday moments. When paired with devices like the Apple Vision Pro, spatial video becomes more than just a novelty—it turns into a portal back to the memory itself.
How Does It Work?
The secret behind both immersive and spatial video is stereoscopic technology. This technique, which mimics how our eyes perceive the world, records two slightly different images—one for each eye. When these images are played back through a device like the Apple Vision Pro, the viewer experiences a sense of depth, making the video feel three-dimensional.
- Stereoscopic Cameras: Capture dual perspectives for each eye.
- 8K Resolution: Ultra-high-definition ensures that every detail is crisp and lifelike.
- Separate Playback for Each Eye: Devices like the Apple Vision Pro feed these videos directly to each eye, creating the illusion of depth and presence.
The result? You’re not just watching a video; you’re experiencing it.
The Game-Changing Applications
While Apple’s demos were certainly impressive, they were also just the tip of the iceberg. Immersive and spatial video are about to change the game across multiple industries:
- Marketing and Advertising: Brands will be able to create truly interactive experiences, allowing consumers to engage with products in immersive ways. Whether it’s virtually test-driving a car or exploring a new pair of sneakers up close.
- Entertainment and Sports: Watching a concert or a live sports game from the comfort of your living room is one thing, but immersive video will make you feel like you’re sitting front-row. From concerts to the sidelines, it’s set to redefine live experiences.
- Tourism and Travel: Imagine visiting the Great Wall of China or exploring the Great Barrier Reef without ever leaving your home. Immersive tourism is poised to take off, allowing people to explore the world virtually with breathtaking realism.
- Education: Virtual field trips, immersive history lessons, or even interactive science experiments are just a few ways this technology could revolutionise learning.
What’s Next for Immersive and Spatial Video?
Right now, the hardware costs are prohibitive for many. Devices like the Apple Vision Pro are retailing at $6,000 AUD, making them inaccessible for widespread use. But this won’t last forever. Competitors like Meta are already developing more affordable alternatives, like the Meta Orion, and as production costs come down, it’s only a matter of time before immersive and spatial video become mainstream.
We predict that immersive video will become the standard for content consumption within the next 3 to 6 years. In the meantime, creatives are exploring what’s possible, testing spatial video with the iPhone 16 Pro and experimenting with the Apple Vision Pro for playback. For now, it’s a playground for innovation, but soon, it will be the norm.
This technology is already reshaping how we think about video. It’s no longer just a passive viewing experience—it’s a fully interactive journey. And while we’re in the early days of its evolution, there’s no denying that immersive and spatial video are poised to revolutionise content creation.
The future of video is here, and it’s going to change everything.
