Introducing Meta AI on Meta Quest—Your Smart MR Assistant

Last year at Meta Connect, we introduced Meta AI—our supercharged intelligent assistant with Meta Llama technology under the hood. Ray-Ban Meta smart glasses were the first smart glasses to ship with Meta AI built in.* They’ve gotten smarter over time with the introduction of Meta AI with Vision—a multimodal update that lets your smart glasses see what you see so you can translate text, get fashion tips, and more, all completely hands-free. And now, Meta Quest is gearing up to join the party this summer.**

As part of the Meta Horizon OS, Meta AI will let you go beyond the hands-free experience you’re used to. Soon you’ll be able to get answers to a wide range of questions with real-time information thanks to Bing. Meta AI with Vision will be part of the update (available in Passthrough to start), so you’ll be able to ask questions about your physical surroundings while in-headset.*** These changes will begin rolling out in the US and Canada in experimental mode next month—and we’ll continue to improve the experience over time.

Let’s say you’re watching YouTube videos of some breathtaking hikes in mixed reality while packing for your upcoming trip to Joshua Tree. You can ask Meta AI for advice on how to best dress for the summer weather. Or you could hold up a pair of shorts and say, “Look and tell me what kind of top would complete this outfit.” You can get the forecast so you can prep for the weather ahead and even ask for local restaurant recommendations to indulge your inner foodie.

Or say you’re in-headset and listening to music while working on a paper for school on a massive virtual monitor. You could ask Meta AI to identify some of the most memorable quotes from Shakespeare’s Hamlet and explain the significance of the “to be or not to be” soliloquy or the play within a play.

You might be playing Assassin’s Creed® Nexus VR, parkouring across rooftops when your curiosity is piqued. Why not ask Meta AI whether or not there were actual assassins in colonial Boston? The answer may surprise you... 🫢

More than a decade ago, we recognized AI and the metaverse as two foundational technologies for the next computing platform, and we’ve been investing in fundamental research into both ever since. In fact, breakthroughs in areas like computer vision are what allowed standalone VR to take off in the first place and made the new generation of all-in-one mixed reality devices possible.

AI has been a driving force of our consumer hardware since the beginning, and recent innovation in generative AI has helped to accelerate key pieces of our vision for the next great wave of human-oriented computing. Large language models are enabling powerful virtual assistants that become even more useful when embedded within wearable devices like Ray-Ban Meta smart glasses and, soon, Quest. And as the technology continues to advance, we’ll be able to make the experience better over time thanks to regular software updates.

Millions of people have already tried Meta AI via Facebook, Instagram, WhatsApp, Messenger, the web, and Ray-Ban Meta smart glasses, and we’re thrilled for even more to tap into the power, intelligence, and utility of Meta AI on Quest. It’s still early days, and there’s more functionality to come. We can’t wait to see how you use Meta AI in-headset, and we’ll have more updates to share soon.****