After you slip on the knitted head strap and turn a small dial to get a light-tight fit, the view of the real world through Apple’s Vision Pro headset is nearly seamless. Nearly. You’re not seeing the world through a transparent lens, but instead, a real-time video recreation of it beamed from external cameras onto a pair of better-than-4K screens.
The colors were crisp, the lag nonexistent, and the resolution high enough to be free of the screen door effect that plagues other virtual or mixed-reality headsets. But there’s just enough of a gap between the experience and real life to land in an uncanny valley. That’s why taking a hands-on test drive of Vision Pro during Apple’s WWDC event last week made me think of the 1995 cult cyberpunk noir film Strange Days. In the film, 3D recordings of real events can be replayed and re-lived through a piece of wearable tech, and Vision Pro’s slight flattening of reality reminded me of those virtual memories.
Stranger still was the experience of watching new 3D video clips recorded through the Vision Pro and played back for me like a high-tech pop-up greeting card. I predict that will be a standout feature of the device, which will cost $3,500 and be available sometime in early 2024.
More meta than Meta
Most everything else about the Vision Pro was an improvement on or evolution of features already found on devices like the Meta Quest, HoloLens, or PSVR. For example, the Meta (formerly Oculus) Quest started pushing virtual office environments with floating video chats and wall-sized spreadsheets when parent company Meta rebranded itself as a metaverse pioneer. And AR devices like HoloLens and Magic Leap already offer a view rooted in the real world, carefully layering augmented content on top.
Vision Pro plays with both of those concepts, letting you pin apps, videos and web browser windows all around you. It improves on what has come before by selectively letting elements of the reality intrude — like a real-world visitor visibly bleeding through your virtual background just by proximity.
Virtual visitors can also intrude in your mixed reality experience. What you or I might call virtual avatars for FaceTime calls were, in AppleSpeak, dubbed “Personas.” They were the most impressive, and unsettling, part of the experience.
If I didn’t know the Persona I was talking to a real-time 3D recreation of a real person’s face, I might have been fooled into thinking I was seeing a live video feed. The 3D face scans, which Apple says you’ll be able to create from scratch using the headset’s external depth-sensing cameras, are extremely naturalistic, especially at first glance. Could you impersonate a loved one? No, at least not yet. But if this is the Day One demo version, we’re only a few iterations away from that. I’m sure Apple will lean on the device’s eye-scanning identification for security to lock down fake face phishing, but it’ll be an ongoing cat-and-mouse game to prevent it.
Hands down
Eschewing handheld controllers, the Vision Pro relies almost entirely on simple gesture controls. Many of the pinch and swipe movements feel similar to the ones used by the Quest, but there’s one major difference. On the Quest, trying to use gesture controls accurately feels like playing a carnival game — a steady eye and serious concentration are required. Even then, it can be hit-or-miss. The Quest is not seamless enough to use full-time, so you need to keep its handheld controllers nearby.
Vision Pro’s simple hand gestures, mostly pinching to tap and swiping from side to side, worked every time. The hand and finger movements required are subtle, can be activated from your lap, and are augmented by eye tracking to select options from a menu. It’s miles beyond what the gesture controls for the Quest are capable of, as it should be for a device that costs seven times as much.
The name game
During its WWDC keynote and the subsequent hands-on demo sessions, Apple avoided even mentioning buzzwords like VR or AI. Instead, the Vision Pro is described as a “spatial computing device” that uses machine learning.
Now, this isn’t my first VR headset rodeo. I first experienced modern VR back in 2012 when I tried out a very early Oculus Rift prototype. I know a VR headset when I see one, and the Vision Pro is a very fancy, very nice, very expensive VR headset.
In a way, VR headset design has almost come full circle since that 2012 demo. The new Vision Pro has been accurately described as looking like a pair of high-tech ski goggles. The original Rift prototype I saw was literally built into a pair of real ski goggles with a screen shoved inside and the exterior covered with black tape.
That original Rift was bulky and uncomfortable, and its lack of mitigating technologies for motion sickness meant my stomach was in knots for the rest of the day after using it. Vision Pro feels a million times more evolved, showing how VR hardware and software have made huge leaps in a relatively short 10 years. Despite its light weight and comfort features, I didn’t forget I was wearing the Vision Pro during my hands-on demo time, but my brain quickly adapted to being a few degrees from reality.
The idea of working in a virtual office surrounded by giant floating app windows doesn’t necessarily excite me, and the isolation issues inherent in any head-mounted wearable are magnified by the high price — it’s hard to imagine any household buying multiple headsets, or even one, in spite of all the home entertainment features. But the slightly voyeuristic thrill of creating and playing back 3D video clips — that Strange Days effect — sets the Vision Pro experience apart from other headsets I’ve tried and makes it standard future virtual, augmented or spatial experiences will be judged against.
Read more: Here’s What Early Testers Are Saying About Apple’s Vision Pro Headset