Qualcomm’s phone-connected VR Smart Viewer: expect more headsets to run through the phone.

VR and AR headsets are going to be powered by phones, via USB-C, in the near future. At least, that’s Qualcomm’s plan. And those headsets could be a lot more capable than you might expect. Eye tracking, full 6DoF positional tracking like Oculus Quest and even controller-free hand gestures are part of the picture.

Qualcomm already announced USB-C compatible VR and AR headsets were coming earlier this year, but a new working prototype reference design announced today shows more of how these headsets will actually work.

The Qualcomm Snapdragon Smart Viewer Reference Design — will connect to an approved range of 5G-enabled Snapdragon 855 phones using USB-C, but also has its own Snapdragon XR1 processor (same as the new Google Glass) to split processing. Imagine your phone does the VR heavy lifting, while the headset chip does some of the work, including controller tracking, eye tracking and headset positioning.

a woman sitting on a sidewalk: qualcomm-snapdragon-smart-viewer-reference-design-awe-may-29-2019© Provided by CBS Interactive Inc.
qualcomm-snapdragon-smart-viewer-reference-design-awe-may-29-2019

Qualcomm’s head of XR, Hugo Swart, sees that marriage of phone and headset, and the split processing possibilities, as a way forward. Standalone VR headsets right now, like the Oculus Quest, do impressive things but rely on having powerful enough dedicated chips onboard. Qualcomm’s split processing model could make smaller (or cheaper) headsets.

The headset reference design can work with full-motion 6DoF controllers like the Oculus Quest, or with controller-free hand tracking like the HoloLens, recognizing tap, zoom, pinch and scroll gestures. It has a 2K-per-eye display with 72Hz refresh rate, and two front cameras that can track full-motion controllers or hand gestures (the Oculus Quest uses four front cameras).

Eye tracking onboard

The Smart Viewer also has eye tracking built in, provided by Tobii. Qualcomm introduced eye tracking on mobile VR headset prototypes over a year ago, but it looks like this time, maybe, eye tracking could finally arrive in more products.

While the Smart Viewer connects with a phone (or a PC), it could also technically work on its own without a phone, should a manufacturer want to build storage onboard and have it work as a more basic VR-AR device. Qualcomm says the decision depends on whether someone would like standalone functions with a higher price and bigger size, or they’d prefer a slimmer, smartglass-like look.

Qualcomm’s chips are increasingly in nearly every major AR and VR mobile headset on the market: Microsoft HoloLens, Oculus Quest, Vive Focus, Google Glass, and Google’s standalone Daydream VR platform. That’s why news of this reference design matters: Previous Qualcomm VR reference designs have led to hardware like the Oculus Go, Google’s Lenovo Mirage Solo, HTC Vive Focus and Oculus Quest.

The Smart Viewer reference design, manufactured by GoerTek, will be sold to businesses interested in modifying or adapting the technology, and according to Qualcomm’s Swart, it’s intended to accelerate future VR and AR headsets to arrive faster. Swart doesn’t think many of these headsets will come by 2019, but headsets based on this reference design and tech should definitely come in 2020.

Which means, along with 5G phones, we’re going to likely see a lot of lower-cost, USB-C connected smartglasses and VR headsets coming, too.

The Oculus Quest , available May 21, is a completely self contained VR headset. It costs $399. It’s made by Facebook. I’ve been using one: here’s what makes it amazing.

If you’ve played VR on a PC, you know about “full motion” 6DoF tracking, which allows you to lean and duck and walk and wave your arms. You can do that here.

Quest has built-in tracking in its headset, called Oculus Insight. Its included Touch controllers can also be tracked.

Quest looks like most other VR headsets: big and boxy. But it’s pretty comfy, with foam padding, and fit over my glasses fine.

I will never look flattering in VR.

There’s a lot of motion with Quest: you’ll be dancing, grabbing, ducking. It can be a workout.

Oculus Quest pairs to a phone, but only to adjust settings, set up your account, and help manage app purchases and downloads. You don’t need it when using Quest. The Oculus App runs on iOS or Android.

The Touch controllers: they’re imposing, but they’re fantastic.

The Oculus Touch controllers on Rift had buttons, finger position awareness, vibration and 6DoF tracking. Same here.

The Quest headset has stiff side straps but is otherwise compact.

Velcro straps adjust to fit my head and face.

Carrying Quest in a bag isn’t easy because of those stiff straps. Pick up Oculus’ $40 carrying case, which is designed to contain this and protect its lenses.

The design means it’s not always easy to tuck away. That’s still a problem with VR.

A look at the Fresnel lenses. The Quest’s LCD display has a resolution of 1,440×1,600, which looks fantastic and crisp.

The elastic side bands stretch to allow my head to drop in.

Inside, small speakers in the straps pipe in spatial 3D audio, no headphones needed (but there are two headphone jacks).

The lenses can be adjusted to fit for IPD (interpupillary distance), like the PC-based Rift.

The Quest controllers have wrist straps. Wear them! (Don’t toss the controllers across the room.)

Each controller has two buttons, an analog stick, and two analog triggers. Plus, it’ll register whether your fingers are on or off the buttons, allowing pointing and “grabbing.”

It means that you can kind of feel like you’re reaching out and picking up things, which is really cool.

They’re comfortable, too.

The controllers use AA batteries. So far they’ve lasted a week and a half without needing replacing.

This is me using the Quest outside. You can do this, sort of, but Oculus seriously recommends using it indoors (bright light can disrupt tracking).

Also, Quest can draw a boundary for your playspace, erecting a glowing blue “fence” to show your safety zone — but it won’t sense when new obstacles have arrived. You’ve been warned. But: if you peek outside your play area limits, passthrough cameras show your world in black and white. It’s cool! (And useful.)

Using the iOS app to peek at new game releases.

You can use Quest while standing or sitting. In stationary modes, the glowing fence gets a little intrusive.

Finding a place to store your VR headset might be a challenge.

Dancing games like Dance Central and Beat Saber (kind of dancing), or sports games like Sports Scramble, make amazing use of the full-motion controllers.

Is the Quest for you? Consider its price: $400 is like a fancy game console. That’s expensive for some, affordable for others (AR headsets cost over $1,000).

Oculus Quest runs its own apps and games, and won’t necessarily port all Rift and Go titles. Many games and apps will support cross-buy and cross-play — but which ones?

A look at the Oculus Go from 2018 (left), Oculus Quest (center) and 2016 Oculus Rift (right). Quest feels like the fusion of the other two.

The Quest’s comfy feel and well-made design, and its self-contained audio and sharp display, are like Oculus Go.

The Quest’s adjustable lenses and support for 6DoF tracking is like the Rift.

Go and Quest are both Android based and use Qualcomm Snapdragon processors. The Go has a Snapdragon 820, while Quest has a Snapdragon 835.

Oculus Go is a stay-seated and turn-your-head experience, like other phone-based VR, and has just a simple Nintendo Wii-like controller. Oculus Quest’s Touch controllers are far fuller featured.

But, Quest is still locked off from other ecosystems. It won’t integrate with Android, or Windows. It runs whatever apps it chooses to run, and while there’s 64 or 128GB of storage, there’s no SD card slot.

The Oculus Quest (left) vs. the Rift (right) look similar from a distance, minus the cable. But the Rift connects to a PC.

The future of Oculus VR might be a fusion of both Rift and Quest. Oculus’ newest Rift, the Rift S, also has built-in positional tracking.

There’s no eye tracking on Quest. Maybe in the future?

But for what it does, Oculus Quest feels like an incredible achievement in mobile VR.

It’s most likely the beginning of a wave of smaller, mobile, affordable devices. Some with AR, too.

But for now, Quest is the best; just beware of a limited app library for now. Read my review .

43/43 SLIDES

Source

RELATED ARTICLESMORE FROM AUTHOR