Today, during the XR edition of The Android Show, Google showed off a bunch of updates and new features headed to its mixed reality OS. And while most of the news was aimed at developers, I got a chance to demo some of the platform’s expanded capabilities on a range of hardware including Samsung’s Galaxy XR headset, two different reference designs and an early version of Xreal’s Project Aura smart glasses and I came away rather impressed. So here’s a rundown of what I saw and how it will impact the rapidly growing ecosystem of head-mounted displays.
First up was one of Google’s reference design smart glasses with a single waveguide RGB display built into its right lens. I’ve included a picture of it here, but try not to read too deeply into its design or aesthetics, as this device is meant to be a testbed for Android XR features and not an early look at upcoming models.
Try not to read too much into the appearance of Google’s reference design smart glasses, as they are explicitly labeled as prototypes meant to test upcoming features in Android XR. (Sam Rutherford for Engadget)
After putting them on, I was able to ask Gemini to play some tunes on YouTube Music before answering a call simply by tapping on the touchpad built into the right side of the frames. And because the reference model also had onboard world-facing cameras, I could easily share my view with the person on the other end of the line.
Naturally, I was curious about how glasses had the bandwidth to do all this, because in normal use, they rely on a Bluetooth or Bluetooth LE connection. When asked, Max Spear, Group Product Manager for XR, shared that depending on the situation, the device can seamlessly switch between both Bluetooth and Wi-Fi, which was rather impressive because I couldn’t even detect when that transition happened. Spear also noted that one of Google’s focuses for Android XR is making it easier for developers to port over the apps people already know and love.
This means for devices like the reference design I wore that feature a built-in display (or displays), the OS actually uses the same code meant for standard Android notifications (like quick replies) to create a minimalist UI instead of forcing app makers to update each piece of software to be compliant with an ever-increasing number of devices. Alternatively, for models that are super lightweight and rely strictly on speakers (like Bose Frames), Google has also designed Android XR so that you only need mics and voice controls to access a wide variety of apps without the need for visual menus.
This is the picture Google’s reference design smart glasses created (via Gemini ) when I asked it to transform a photo I took of some pantry shelves into a sci-fi kitchen. (Sam Rutherford for Engadget)
Meanwhile, if you’re hoping to take photos with your smart glasses, there’s a surprising amount of capability there, too. Not only was I able to ask Gemini to take a photo, the glasses were also able to send a higher-res version to a connected smartwatch, which is super handy in case you want to review the image before moving on to the next shot. And when you want to inject some creativity, you can ask Gemini to transform pictures into practically anything you can imagine via Nano Banana. In my case, I asked the AI to change a shot of a pantry into a sci-fi kitchen and Gemini delivered with aplomb, including converting the room into a metal-clad setting complete with lots of light strips and a few bursts of steam.
However, one of the most impressive demos was when I asked Google’s reference glasses to look at some of that same pantry environment and then use the ingredients to create a recipe based on my specifications (no tomatoes please, my wife isn’t a fan). Gemini went down an Italian route by picking pasta, jarred banana peppers, bell peppers (which I thought was a somewhat unusual combination) and more, before launching into the first steps of the recipe. Sadly, I didn’t have time to actually cook it, but as part of the demo, I learned that Gemini has been trained to understand human-centric gestures like pointing and picking things up. This allows it to better understand context without the need to be super specific, which is one of those little but very impactful tricks that allows AI to feel way less robotic.
This is how Google Maps will look on Android XR. Note that this is the flat 2D version instead of the more detailed stereoscopic view available on smart glasses with dual displays. (Sam Rutherford for Engadget)
Then I had a chance to see how Uber and Google Maps ran on the reference glasses, this time using models with both single and dual RGB displays. Surprisingly, even on the monocular version, Maps was able to generate a detailed map with the ability to zoom in and out. But when I switched over to the binocular model, I noticed a significant jump in sharpness and clarity along with a higher-fidelity map with stereoscopic 3D images of buildings. Now, it may be a bit early to call this, and the perception of sharpness varies greatly between people based on their head shape and other factors, but after seeing that, I’m even more convinced that the smart glasses with dual RGB displays are what the industry will settle on in the long term.
The second type of device I used was the Samsung Galaxy XR, which I originally tried out when it was announced back in October. However, in the short time since, Google has cooked up a few new features that really help expand the headset’s capabilities. By using the goggle’s exterior-facing cameras, I was able to play a game of I Spy with Gemini. Admittedly, this might sound like a small addition, but I think it’s going to play a big part in how we use devices running Android XR, because it allows the headset (or glasses) to understand better what you’re looking at in order to provide more helpful contextual responses.
Even though it was announced not long ago in late October, Samsung’s Galaxy XR headset is already getting some new features thanks to some updates coming to Android XR. (Sam Rutherford for Engadget)
However, the biggest surprise was when I joined a virtual call with someone using one of Google’s new avatars, called Likeness. Instead of the low-polygon cartoony characters we’ve seen before in places like Meta Horizon, Google’s virtual representations of people’s faces are almost scary good. So good I had to double-check that they weren’t real and from what I’ve seen they’re even a step up from Apple’s Personas. Google says that headsets like the Galaxy XR rely on interior sensors to track and respond to facial movements, while users will be able to create and edit their avatars using a standalone app due out sometime next year.
The person in the bottom right is using a Likeness, which during my demo looked surprisingly responsive and realistic. (Google)
Next, I got a chance to test out the Android XR’s PC connectivity by playing Stray on the Galaxy XR while it was tethered wirelessly to a nearby laptop. Not only did it run almost flawlessly with low latency, I was also able to use a paired controller instead of relying on hand-tracking or the laptop’s mouse and keyboard. This is something I’ve been eagerly waiting to try because it feels like Google has put a lot of work into making Android XR devices play nicely with other devices and OSes. Initially, you’ll only be able to connect Windows PCs to the Galaxy XR, but Google says it’s looking to support macOS systems as well.
Finally, I got to try out Xreal’s Project Aura glasses to see how Android XR works on a device primarily designed to give you big virtual displays in a portable form factor. Unfortunately, because this was a pre-production unit, I wasn’t able to take photos. That said, as far as the glasses go, I was really impressed with their resolution and sharpness and the inclusion of electrochromic glass is a really nice touch, as it allows users to change how heavily the lenses are tinted with a single touch. Alternatively, the glasses can also adjust the tint automatically based on whatever app you are using to give you a more or less isolated atmosphere, depending on the situation. I also appreciate the Aura’s increased 70-degree FOV, but if I’m nitpicking, I wish it were a bit higher, as I occasionally found myself wanting a bit more vertical display area.
Unfortunately, I wasn’t allowed to take photos of Xreal’s Project Aura smart glasses, as the model I used was still an early pre-production unit. So here’s a shot provided by Google instead. (Google / Xreal)
As a device that’s sort of between lightweight smart glasses and a full VR headset, the Aura relies on a wired battery pack that also doubles as a touchpad and a hub for plugging in external devices like your phone, laptop or even game consoles.
While using the Aura, I was able to connect to a different PC and multitask in style, as the glasses were able to support multiple virtual displays while running several different apps at the same time. This allowed me to be on a virtual call with someone using a Likeness while I had two other virtual windows open on either side. I also played an AR game (Demeo) while I moved around in virtual space and used my hands to reposition the battlefield or pick up objects with my hands.
Now I will fully admit this is a lot and it took me a bit to process everything. But upon reflection, I have a few takeaways from my time with the various Android XR devices and prototypes. More than any other headset or smart glasses platform out now, it feels like Google is doing a ton to embrace a growing ecosystem of devices. That’s really important because we’re still so early in the lifecycle for wearable gadgets with displays that no one has really figured out a truly polished design like we have for smartphones and laptops. And until we get there, this means that a highly adaptable OS will go a long way towards supporting OEMs like Samsung, Xreal and others.
But that’s not all. It’s clear Google is focused on making Android XR devices easy to build for. That’s because the company knows that without useful software that can highlight the components and features coming on next-gen spectacles, there’s a chance that interest will remain rather niche — similar to what we’ve seen when looking at the adoption of VR headsets. So in a way, Google is waging a battle on two fronts, which makes navigating uncharted waters that much more difficult.
A major focus for Android XR while people are still figuring out how to make smart glasses is to support a wide variety of designs including those with single displays, dual displays or models without any displays that rely on cameras and speakers. (Sam Rutherford for Engadget)
Google is putting a major emphasis on Android XR’s ability to serve as a framework for future gadgets and support and address developer needs. This mirrors the approach the company takes with regular Android and the opposite of Apple’s typical MO, because unlike the Vision Pro and visionOS, it appears Google is going to rely heavily on its partners like Xreal, Warby Parker, Gentle Monster and others to create engaging hardware. Furthermore, Google says it plans to support smart glasses that can be tethered to Android and iOS phones, as well as smartwatches from both ecosystems, though there will be some limitations for people using Apple devices due to inherent OS restrictions.
That’s not to say that there won’t be Pixel glasses sometime down the road, but at least for now, I think that’s a smart approach and possibly a lesson Google learned after releasing Google Glass over a decade ago. Meanwhile, hi-res and incredibly realistic avatars like Likenesses could be a turning point for virtual collaboration, because, in a first for me, talking to a digital representation of someone else felt kind of natural. After my demos, I had a chance to talk to Senior Director of Product Management for XR Juston Payne, who highlighted the difference between smart glasses and typical gadgets by saying “Smart glasses have to be great glasses first. They need to have a good form factor, good lenses with prescription support, they need to look good and they have to be easy to buy.”
That’s no simple task and there’s no guarantee that next-gen smart glasses and headsets will be a grand slam. But from what I’ve seen, Google is building a very compelling foundation with Android XR.
