Connect with us

Tech

Apple reveals Vision Pro, a AR/VR headset unlike any other

Published

on

CUPERTINO, Calif.—After years of speculation, leaks, rumors, setbacks, and rumblings of amazing behind-the-scenes demos, Apple has made its plans for a mixed reality platform and headset public. Vision Pro is “the first Apple Product you look through, not at,” Apple’s Tim Cook said, a “new AR platform with a new product” that “augments reality by seamlessly blending the real world with the digital world.”

“I believe augmented reality is a profound technology. Blending digital content with the real world can unlock new experiences,” Cook said.

The headset, which looks like a pair of shiny ski goggles, has a lightweight aluminum frame with a single piece of glass on the front that acts as a lens for a wide array of cameras. A single button lets you capture videos while a “digital crown” lets you tune how much of outside reality is filtered out at any time.

The Vision Pro’s MicroOLED backplane packs 23 million pixels across two panels “the size of a postage stamp.” A three-element lens delivers that image at the proper depth “everywhere you look,” Apple said, and allows for true 4K HDR video that can show fine text that looks sharp “from any angle.”

The headset is powered by an M2 chip combined with support from a new chip called R1. These chips process inputs from 12 different cameras, 5 sensors (included a LiDAR scanner) and six different microphones. Apple said that while the M2 “ensures performance,” the R1 “virtually eliminates lag,” and delivers images to the displays within 12ms, ensuring experiences “feel like they’re taking place in front of your eyes.”

For weight purposes, an external battery will sit in your pocket and connect to the Vision Pro through a cable. A number of “soft textile parts” are part of a modular system that flexes to the form of your face, with a flexible band that incorporates ear pods for sound. Custom inserts from Zeiss will allow for vision correction for those that wear glasses.

The headset’s visionOS operating system can be controlled in a “fully 3D interface” without a handheld controller. It solely uses your eyes, hands, and voice as an interface, and the unit lets you “control the system simply by looking.” Icons and other UI elements react to your gaze, and you use natural gestures like tapping your fingers or a gentle flick to select them—no need to hold your hands awkwardly in front of you constantly.

Advertisement

Existing iOS developer frameworks have been extended into the visionOS environment to offer support for what Apple is calling “spatial computing.” That means “Hundreds of Thousands” of existing iPad and iOS apps will work on Vision Pro at launch. Apple promises that developers will be able to create 3D objects that “look and feel real” in their visionOS apps. A new app store will include custom Vision Pro apps as well as compatible iOS apps.

In video demonstrations, Apple showed users walking around and grabbing things from a fridge without taking the headset off. And to further keep you from feeling isolated while wearing the headset, a system called EyeSight will display your eyes when someone is nearby, conveying “a critical indicator of connection and emotion.”

Floating 2D apps can be placed to float around your “real world” space, which remains visible through the semi-transparent display. Elements in this interface will cast shadows in the real room around them and respond to light, Apple said. These apps can also “expand fully into your space,” like a pulsating 3D animation in a mindfulness app.

A floating 4K Mac display will appear when users glance at their MacBook display while in the Vision Pro. From there, users can interact with use a virtual keyboard or their voice to type, or make use of a physical Magic Trackpad and/or Magic Keyboard.

While watching movies (including 3D movies) on a virtual floating screen, the device will automatically dim your surroundings to be less distracting. The headset can take spatial photos or videos with the click of a button, which you can re-experience as panoramas that you feel like you’re actually inhabiting, Apple said.

Apple CEO Bob Iger came out to demonstrate a number of customized Vision Pro experiences, from Disney+ support to ESPN sports broadcasts with a wide array of stats filling your room to a virtual Mickey Mouse that walks around your space.

Disney+ support will be available on day one, alongside over 100 Apple Arcade titles that will be available to play via a floating screen and a handheld controller on the device.

This is a developing story and will be updated.

Source: Ars Technica

Advertisement

Follow us on Google News to get the latest Updates

Trending