Google Partners With Magic Leap to Secure Key Tech for AR Headsets

Google and Magic Leap today announced a “strategic technology partnership.” The move shows Google seeking to gain ground to keep up with the likes of Meta, Apple, and others in a race to control the AR headset market.

While consume VR headsets have been around for years now, none of the world’s major technology companies have launched consumer-focused AR glasses.

But behind the scenes, companies like Meta, Apple, and Google are racing each other toward that future—one they hope will see all-day AR glasses become as big as the smartphone.

Google has had several starts and stops in the XR space. Google Cardboard was first out the door way back in 2014, and introduced millions to a very basic VR experience made by slapping a smartphone into a cardboard viewer with simple lenses.

The company got more serious with Google Daydream, making a more streamlined experience with phones that were specially certified to work with more advanced smartphone viewers.

And while Daydream ultimately failed, it wasn’t just Google’s fault. The whole concept of VR smartphones viewers just never found a foothold. Meta and Samsung’s similar Gear VR project faced a similar fate. And even Oculus Go—a low cost headset that further streamlined the ‘smartphone VR’ experience by building the smartphone components directly into the headset—couldn’t make the formula work.

Higher fidelity VR, with full tracking and motion controllers, seemed to be the way forward as both PC VR headsets and Meta’s Quest line had shown.

But even those headsets are ultimately stepping stones in the eyes of Google, Meta, and Apple. All are gunning for a future where the reality-altering experience of VR can be merged with the real-world through lightweight AR glasses that people can wear all day.

While Google continues to build out its ARCore software platform (which lets Android developers build phone-based AR apps) Google still eventually needs to get a head-worn AR platform off the ground if it hopes to compete with peers like Meta and Apple, which are already getting a foothold on head-worn AR experiences with devices like Quest 3 and Vision Pro.

Google has made clear that it’s intent on building—or at least supporting—such a device. The company publicly announced last year that it was working with both Samsung and Qualcomm on just that.

If Google wants to leapfrog over the preliminary step of building an MR headset like Meta and Apple, one of the biggest barriers is the challenge of optics. Producing a high-resolution, wide-field of view image through something the size of a pair of glasses is an incredible physics challenge that hasn’t been cracked by anyone just yet.

Optics may be one reason why Google has had starts and stops with its own efforts to build a pair of AR glasses. A major internal project to build such a device, called Project Iris, was reportedly shut down sometime last year.

Such starts and stops have seemingly left Google trailing the others in this race. But the company hasn’t given up yet.

Now its tapping AR headset maker Magic Leap in an effort to secure key technology needed to make a compact AR device. The “multi-faceted, strategic technology partnership” with Google was announced today by Magic Leap, and very specifically calls out optics as being a key driver behind the arrangement.

Shahram Izadi, Vice President and General Manager of AR/XR at Google, said, “We look forward to bringing together Magic Leap’s leadership in optics and manufacturing with our technologies to bring a wider range of immersive experiences to market. By combining efforts, we can foster the future of the XR ecosystem with unique and innovative product offerings.”

Magic Leap Chief Technology Officer, Julie Larson-Green said, “This partnership accelerates the transformative power of AR by combining our extensive optics capabilities with Google’s technologies to continue to advance immersive experiences to the developer ecosystem and for customers. We are looking forward to expanding the potential of XR – blending the physical world with valuable, contextually relevant solutions.”

Magic Leap has had starts and stops of its own. But through the course of the company’s wild fundraising ride, near failure, and eventual stabilization, Magic Leap has amassed a large number of patents relating to XR technology. Their latest headset, Magic Leap 2, also has among the widest field-of-view in a device its size with transparent optics.

And that’s probably where Google’s interests lie.

Whether adopting a more advanced version of the optics in Magic Leap 2, or leaning into a novel solution that’s been developed and patented by Magic Leap, it seems Google is hoping to buy itself a shortcut to market, at least as far as the optics are concerned.

It’s still unclear at this point exactly how this partnership will manifest, but the limited information we have points in a particular direction: Google may be developing its own headset, using Magic Leap’s optics technology, but ultimately the whole headset may be manufactured by Magic Leap.

This would leave Magic Leap to continue its enterprise-focused business while still earning money from the consumer AR space that Google and others are trying to bring to fruition.

And still other strategic plays are possible… Samsung went completely unmentioned in the Google and Magic Leap announcement—where does it fit into this picture? For now only time will tell.