Discover the world with multimodal AI glasses

You look at the painting and say, "Hey Meta, which artist painted this?" Meta AI responds in your open-ear speakers, "This piece is Garden at Sainte-Adresse, painted by Claude Monet."

This is an example of how multimodal AI glasses work. They combine multiple types of input (what you say and what you see) to give you the right answer. Here's more on how multimodal AI glasses reshape the way you engage with your environment.

How does multimodal AI integrate with AI glasses?

Multimodal AI systems process information across various types of input signals, such as visual and audio data. When integrated into AI glasses, this technology changes how you experience and interact with the world around you.

In Ray-Ban Meta and Oakley Meta glasses, Meta AI integrates multimodal signals to understand your environment and generate the right answers to your questions. Behind the scenes, several features in the glasses work together to make this happen:

• Multi-mic arrays: Premium mics reliably capture audio input, like your voice prompts, even in crowded spaces.
• High-resolution camera: The 12 MP ultra-wide camera captures your point of view, supporting contextual understanding.
• Open-ear speakers: Discreet speakers with adaptive volume relay answers from Meta AI to you with clarity, while keeping you aware of your surroundings.

If you see a flower on your morning walk and want to know its name, just look at the flower while wearing your AI glasses (visual signal) and ask Meta AI to identify it (audio signal). Meta AI will interpret your voice command, analyze what you're looking at and give an accurate response, like "This is a peony. More specifically, it looks like a herbaceous peony."

Everyday benefits of multimodal AI glasses

Ray-Ban Meta and Oakley Meta glasses with multimodal AI respond naturally to queries about what you see and hear.

Here are four everyday applications of AI glasses and how they can improve your day-to-day life.

1. Translate languages

Live translation in AI glasses from Meta transforms how you connect and communicate at home or abroad — in both speech and text formats.

Speech translation

AI glasses from Meta support real-time, two-way translation across English, French, German, Italian, Portuguese and Spanish.

Simply select your desired languages and say, "Hey Meta, start live translation." You'll hear translated speech through open-ear speakers in Ray-Ban Meta and Oakley Meta glasses. With Meta Ray-Ban Display, you can see in-lens captions when you enable the captions feature.

When you reply, the Meta AI app will translate and transcribe your response. The person you're speaking with can either read the translated text in the Meta AI app or listen to its audio.

If you no longer need translation, say, "Hey Meta, stop live translation." With Meta Ray-Ban Display, you can also use your Meta Neural Band to end translation. This sleek wristband translates subtle hand gestures into commands that control your Meta Ray-Ban Display glasses — no buttons or voice commands needed. Simply tap your middle finger on your thumb and live translation will end.

Text translation

Meta AI in your AI glasses translates foreign scripts in real time. Say, "Hey Meta, what does this text say?" to translate everything from street signs to restaurant menus in the language you prefer.

When touring a Renaissance palace, you may notice inscriptions etched in Italian on marble columns. Say, "Hey Meta, translate this inscription" and Meta AI will tell you precisely what the text says. If you need more details, just ask Meta AI.

2. Get help in the moment

With a camera and open-ear speakers built into the frame, multimodal AI glasses from Meta deliver on-demand assistance wherever life takes you. To do this, Meta AI correlates multiple real-time inputs: what you're looking at, where you are, how you're moving and what you say.

Discover the stories behind every heritage site you visit when exploring a new city. Just look at it while wearing your AI glasses and ask, "Hey Meta, what is this?" Meta AI will use multimodal cues, from visual recognition to location data, to identify the structure and deliver insights.

Meta AI doesn't just speak and forget. If you ask a follow-up question — like "Hey Meta, can you tell me more about why this site is important?" — the AI assistant will retain context and expand on earlier insights. This continuity lets you explore your environment naturally, without breaking your flow.

Here are more everyday scenarios where your AI glasses provide contextual assistance:

• Cooking at home: Look at the ingredients on your counter and ask, "Hey Meta, what can I make with this?" and Meta AI will suggest recipes that match your ingredients. And if the recipe is new to you, just say, "Hey Meta, walk me through the steps" and AI will dictate step-by-step instructions.
• Exercising: As you're on track to beat your five-mile record, say, "Hey Meta, how fast am I running?" Oakley Meta Vanguard pairs with compatible Garmin devices (sold separately) to deliver real-time performance insights.
• Working on home repairs: You're fixing a leaky faucet and get stuck. Say, "Hey Meta, how do I fix this?" Meta AI identifies the issue and guides you through the repair process.
• Exploring nature on foot: Say, "Hey Meta, what's the fastest route out of this trail?" Receive directions through your open-ear speakers or view them on your in-lens display with Meta Ray-Ban Display.*

*This feature is in Beta mode and available to users in select cities as we continue to make it more widely available.

3. Play audio on the go

Ray-Ban Meta and Oakley Meta glasses deliver sound in a way that allows you to multitask safely. When riding the train to work, say, "Hey Meta, play [your favorite podcast]." Your AI glasses will deliver a rich audio experience without shutting out important subway announcements.

Open-ear speakers direct audio toward your ears so your listening experience remains private. While others hear only a faint hum, your audio stays crystal clear — even amid the train's background noise and nearby conversations.

AI glasses from Meta offer on-demand access to your favorite audio entertainment. From music to audiobooks, tune in to content using just voice commands or discreet hand movements:

• Use a voice command: Say, "Hey Meta, play 'California Dreamin'." To stop playback, simply tell Meta AI or use the touchpad on your right temple.
• Control via subtle gestures (with Meta Ray-Ban Display): Use subtle hand gestures to navigate media on your in-lens display menu, pause playback, adjust audio levels and more.

Multimodal AI ensures your audio experience is always responsive to your environment. When you answer an incoming call, playback pauses automatically, so you never miss a moment. If you give a voice command while music is playing, your AI glasses seamlessly recognize and respond, keeping you in control.

4. Navigate hands-free and know what's around you

AI glasses from Meta process multimodal information to support safer, more natural movement. While you're walking, you can call on multimodal AI-driven insights at any point.

Let's say you stroll past one of your city's key landmarks and would like to know more about it. Say, "Hey Meta, what am I looking at?" and Meta AI instantly draws on visual and location data to deliver an accurate response through discreet open-ear speakers. This way, spontaneous learning fits naturally into your walk. You stay focused on traffic and obstacles as you learn without looking at your phone.

AI glasses from Meta also offer pedestrian navigation.* If you're heading to meet a friend for coffee in an unfamiliar part of town, just say, "Hey Meta, direct me to [the cafe name]." The 12 MP ultra-wide camera picks up on your environment, seeing what you see in real time and then guides you reliably to your destination. You receive step-by-step audio directions through open-ear speakers in Ray-Ban Meta and Oakley Meta, or through the in-lens display with Meta Ray-Ban Display.

*This feature is in Beta mode and available to users in select cities as we continue to make it more widely available.

Choose the style that suits you. Whether you pick the iconic Ray-Ban Meta Wayfarer or the performance-ready Oakley Meta Vanguard, each pair blends seamlessly into your life to make every day better.

Experience multimodal intelligence with AI glasses from Meta

Sleek eyewear meets advanced intelligence in AI glasses from Meta. These multimodal AI glasses both look stylish and act as an AI assistant, changing how you engage with your surroundings. Find your perfect pair and access Meta AI support anywhere.

Choose the style that suits you. Whether you pick the iconic Ray-Ban Meta Wayfarer or the performance-ready Oakley Meta Vanguard, each pair blends seamlessly into your life to make every day better.