Snapdragon XR2 Chip To Enable Standalone Headsets With 3K x 3K Resolution, 7 Cameras (roadtovr.com) 34
An anonymous reader quotes a report from Road to VR: Qualcomm today announced Snapdragon XR2 5G, its latest chipset platform dedicated to the needs of standalone VR and AR headsets. The new platform is aimed at high-end devices with support for 3K x 3K displays at 90Hz, along with integrated 5G, accelerated AI processing, and up to seven simultaneous camera feeds for user and environment tracking. While XR1 was made for low-end devices, XR2 5G targets high-end standalone headsets, making it a candidate for Oculus Quest 2, Magic Leap 2, and similar next-gen devices.
XR2 offers up notable improvements over Snapdragon 835 (one of the most common chipsets found in current standalone headsets, including Quest); Qualcomm claims 2x performance in CPU & GPU, 4x increase in pixel throughput for video playback, and up to 6x resolution per-eye compared to Snapdragon 835 -- supporting up to 3K x 3K displays at 90Hz. [...] Notably, XR2 supports up to seven simultaneous camera feeds (up from four in prior platforms). This is key for advanced tracking, both of the environment and the user. [...] Qualcomm also says that XR2 offers low-latency pass-through video which could improve the pass-through video experience on headsets like Quest, and potentially enable a wider range of pass-through AR use-cases. Additionally XR2 boasts significantly accelerated AI processing; 11x compared to Snapdragon 835, which could greatly benefit the sort of operations used for turning incoming video feeds into useful tracking information.
XR2 offers up notable improvements over Snapdragon 835 (one of the most common chipsets found in current standalone headsets, including Quest); Qualcomm claims 2x performance in CPU & GPU, 4x increase in pixel throughput for video playback, and up to 6x resolution per-eye compared to Snapdragon 835 -- supporting up to 3K x 3K displays at 90Hz. [...] Notably, XR2 supports up to seven simultaneous camera feeds (up from four in prior platforms). This is key for advanced tracking, both of the environment and the user. [...] Qualcomm also says that XR2 offers low-latency pass-through video which could improve the pass-through video experience on headsets like Quest, and potentially enable a wider range of pass-through AR use-cases. Additionally XR2 boasts significantly accelerated AI processing; 11x compared to Snapdragon 835, which could greatly benefit the sort of operations used for turning incoming video feeds into useful tracking information.
Fuck everything (Score:2)
A long way to go (Score:2)
Nah, we're a long way from that kind of over-the-top.
3Kx3K is still way below what you'd really like for VR/AR. A 4KUHD screen mostly filling your field of view will have clearly visible pixels, but would at least be pushing them down to the size that you'd mostly notice them as "jaggies" on sharp edges. Provide one of those for each eye, and you're up to 16Mpixels/frame, well over the 9Mpixel/frame of the 3Kx3K. And you could probably double that to an 8K screen per eye and still have room for visual im
Great news (Score:1)
Re: Great news (Score:2)
Needs wireless built in (Score:2)
Re: (Score:2)
Re: (Score:2)
Right, 5G is a dumb play - it won't work in most places before these headsets are discontinued.
I want a wireless high-res display tethered to my phone so I can get some reasonable work done on a four-hour bus ride without lugging along a laptop. Wireless keyboard/trackball can fold up nicely.
Re: (Score:1)
So, 3k starfox graphics? (Score:2)
Because even high end videocards have issues with this kind of resolutions.
Re: (Score:2)
Really? I mean this is less than double the resolution that an Index already has, and that headset has no issue running on mid-range graphics cards.
Purpose of AR/VR? (Score:2)
Re: (Score:2)
Because. Its. Fun!
Books and movies have industrial. military and medical uses too, but mostly are for fun :)
Re: (Score:2)
why does the average consumer need any sort of AR/VR? I don't get it.
Because it's incredibly frigging fun. Even now with the technology still far from perfect I don't regret getting a VR headset for even a moment and I highly recommend to anyone to actually try it at a local VR lab. I got hooked by playing with an old Rift CV1 headset, and the current generation is even better.
Re: Purpose of AR/VR? (Score:2)
Re: (Score:1)
3k is a good resolution... (Score:2)
I own a wireless Vive Pro which is around 3k resolution. Its "enough" to give a crisp view. A simple stand-alone headset at that resolution would be a game-changer.
Re: (Score:2)
Forget passthrough AR @ 90hz (Score:3)
Passthrough AR (using cameras to capture the room around you for realtime display on the screen) needs a minimum of ~200-250hz, and *really* 400-1000hz if it extends into your peripheral vision. Otherwise, the 'slosh' will have you puking in no time.
Motion sickness is a problem, but SLOSH-induced VR sickness is ENORMOUSLY worse, and not something you EVER really adapt to (besides learning to turn your head slowly & close your eyes before turning your head quickly to hide it from yourself).
Jitter (synthetic images not anchored properly) in foveal vision is annoying, but is stressful & sickness-inducing in peripheral vision. Blame evolutionary survival mechanisms that depend upon noticing 'danger' out of the corner of your eye.
One stopgap idea I had: do 'bluescreen' passthrough AR. Render synthetic video to an alpha-blended framebuffer at ~100hz. Capture stereo camera images at 400hz, and combine both for output to a 400hz display (repeating each frame of synthetic overlay video 4 times per camera-frame).
The net effect would be similar to optical AR (eg, Magic Leap & Hololens) today... the synthetic image would still lag a bit, but at least the reality-anchoring passthrough video wouldn't slosh.
Slosh is just one problem of many... but it's a BAD problem that totally kills the usability of passthrough AR @ 90hz.
I'd also propose a short-term display compromise: 8k displays, with the understanding that only a small part can sustain synthetic video at full framerate. Use case: developers who run their IDE directly on virtual monitors in the headset. At 8k, you can render the equivalent of 3 2560x1600 monitors (one fully in view, plus ~1/2 of the adjacent ones) at normal viewing distance, so you can develop VR apps without having to constantly put on & take off the headset. Yes, everyone knows 90hz + 8k games aren't viable with present-day GPUs... and that's ok. Make 'developer' headsets with double-rez displays so they can render the IDE at 8k, but program games for 4k & just scale them 2x2 when running on a 'developer' headset.
Same deal with 4k monitors. Yes, we all know interface speeds & GPUs are too slow today for 4k @ 240hz. So make the display 3848x2560 & capable of 60-120fps at that resolution... but capable of 240-480fps at 1920x1080 with 2x2 nearest-neighbor scaling, and maybe even 960-1000fps at 960x540. I'm so sick of having to choose between a display that can do 1080p120 or 2160p30, instead of both 1080p120 and 2160p30 (or 1080p240 + 2160p60). Computationally, any monitor with g-sync or FreeSync should be able to do this. Worst-case, it might need another $5 worth of RAM to allow static double-buffering. For an expensive premium monitor, that's *nothing*.
Re: Forget passthrough AR @ 90hz (Score:3)
^-- elaboration about the 'bluescreen passthrough' idea:
Have the app render a synthetic scene that's ~25% taller & wider than the visible display at 1/4 the passthrough camera rate. Then, instead of simply repeating each rendered frame 4 times or attempting to use the GPU to render it at camera speed, have a DSP-like intermediate GPU that integrates the motion sensors & camera views to transform the synthetic reference frame slightly during the intermediate frames to improve its anchoring to your su
Re: (Score:2)
Passthrough AR (using cameras to capture the room around you for realtime display on the screen) needs a minimum of ~200-250hz, and *really* 400-1000hz if it extends into your peripheral vision. Otherwise, the 'slosh' will have you puking in no time.
Completely incorrect. Passthrough AR needs improved *latency* not improved framerates. 80/90Hz is more than enough to prevent VR sickness providing the latency is low.
Re: (Score:2)
At 90fps, your camera-display latency will NEVER be less than the duration of a single video frame... 11.11ms.
11.11ms is ABSOLUTELY perceptible as "slop" or "slosh". Attempting to engage in tasks requiring hand-eye coordination with 11.11ms latency would have you fumbling like you're drunk, and feeling like your bones have turned to floppy rubber. And 11.11ms is the BEST case for 90fps video.
To reduce the latency further, you MUST increase the video framerate (at least, for the camera and display, regardles
Re: (Score:2)
No you only need to increase the frame rate for the camera not the display. Being able to display a prepared input on a 90Hz display already solves VR sickness. If it didn't then VR wouldn't be working right now. The only issue for AR is that the image is ready to be displayed when the display is ready to switch to the next frame, and that isn't a limitation of display technology but rather everything else around it.
Re: Forget passthrough AR @ 90hz (Score:2)
That's the thing, though... VR *isn't* very usable today. At least, not for more than a few minutes at a time. And slosh is a big reason *why* forcing an employee to spend hours at a time working in 90hz VR would almost certainly constitute an OSHA violation.
The injury is cumulative over the span of a few hours. If you're playing a high-adrenaline game, you might not notice the stress. If you're an architect doing CAD in a passthrough-AR environment, you absolutely WILL notice the stress that comes from end
Re: (Score:1)
Re: Forget passthrough AR @ 90hz (Score:2)
Slosh != "motion sickness".
Motion sickness is what you get when your eyes tell you that you're moving, but your vestibular system says you aren't.
"Slosh" is what you perceive when you start turning your head, but the world around you lags by 5-100+ milliseconds. It's not as bad as motion sickness... it's much, MUCH worse. It's the main reason why passthrough AR has been non-viable so far.
If you're in a 100% synthetic immersive cartoon/Seuss-like world, your brain somewhat can rationalize slosh. If you're in
uh,,, (Score:2)
IT development (Score:1)
It's sentient? (Score:2)
What else could that mean? It's not like the term would be misused as part of a marketing scheme or anything...
Re: It's sentient? (Score:2)