In the spring of 2024, Meta announced plans to embed its most capable AI model yet — Llama 3 — into Ray-Ban smart glasses, a quiet but consequential step in the long human project of extending the mind outward into the world. The upgrade transforms a novelty wearable into a context-aware companion capable of seeing, hearing, and reasoning about the physical environment around its wearer. Beyond the glasses, Meta is threading this same intelligence through its virtual reality headsets and social platforms, betting that AI assistants will soon become the primary layer through which people encoun
Meta's Ray-Ban Smart Glasses Get Llama 3 AI Upgrade
Every interaction with the digital world will be through AI assistants.
Mark
So Meta is putting a new AI model into smart glasses. Why does that matter? Isn't the current version already doing what people need?
Mimi
The current version runs on Llama 2, which is capable but limited. Llama 3 is more powerful and can understand multiple types of input at once—video, speech, spatial information. That means the glasses can actually see what you're looking at and understand the context in a much deeper way.
Luke
How much more powerful? The source says it's expected to be "as or more powerful" as GPT-4, but that's an expectation, not a test result. We don't actually know yet how it will perform.
Mark
And this is just for the glasses?
Mimi
No, that's the bigger story. MetaAI is expanding to the Quest 3 headset, Instagram, WhatsApp, Facebook. The glasses are one product, but Meta is trying to make this assistant the central way people interact with their digital life.
Luke
The source mentions these expansions are coming "soon" or "in the future," but there are no specific dates. We know Quest 3 is coming soon, but for Instagram and WhatsApp, we're looking at vague timelines.
Mark
What's the business angle here? Why does Meta care so much about being the AI assistant layer?
Mimi
Control. If Meta's AI mediates how people interact with information, social networks, and services, Meta becomes the gatekeeper. That's enormous power and influence.
Luke
That's interpretation, though. What we know for certain is that Meta executives said they want MetaAI to be "the most useful assistant in the world." The rest is reasonable inference, but it's not in the reporting.
Mark
Fair. So when does this actually happen?
Mimi
Llama 3 is coming later in 2024. The glasses upgrade will follow when the model is ready. Quest 3 access is coming soon. The social platform rollout is less clear.
Luke
Which is worth noting. The glasses and Quest timelines are concrete. The social platform expansion is announced but not dated, which means it could slip or change.
O Pulso
- Meta is racing to close the gap between ambient computing and genuine usefulness, upgrading Ray-Ban glasses with Llama 3 — a model powerful enough to rival GPT-4 in some configurations.
- The stakes are high: if AI assistants become the default interface for digital life, whoever owns that layer owns the relationship between billions of people and the internet.
- Llama 3's multimodal design — processing speech, video, and spatial context simultaneously — pushes the glasses from novelty gadget toward something closer to a cognitive prosthetic.
- MetaAI is expanding rapidly across Quest 3, Instagram, WhatsApp, and Facebook, turning a wearable experiment into a platform-wide infrastructure play.
- Meta's Chief AI Scientist wore the glasses as his everyday eyewear and predicted that all future digital interaction will flow through AI assistants — a vision the company is now actively engineering into reality.
In the spring of 2024, Meta announced plans to embed its most capable AI model yet — Llama 3 — into Ray-Ban smart glasses, a quiet but consequential step in the long human project of extending the mind outward into the world. The upgrade transforms a novelty wearable into a context-aware companion capable of seeing, hearing, and reasoning about the physical environment around its wearer. Beyond the glasses, Meta is threading this same intelligence through its virtual reality headsets and social platforms, betting that AI assistants will soon become the primary layer through which people encounter digital life — as inevitable and invisible as the air we breathe.
Meta is preparing to install its next-generation Llama 3 AI model into Ray-Ban smart glasses, a move that will substantially deepen what the device can do. Where the current assistant handles basic queries, Llama 3 brings multimodal capability — processing speech, video, and spatial awareness — allowing the glasses to understand the physical world around the wearer and respond with far greater nuance.
Llama 3 is Meta's most capable large language model to date, available in sizes ranging from compact versions that run locally on devices to more powerful variants competitive with OpenAI's GPT-4. It will be released as open-source software, giving developers broad access to the underlying technology.
The Ray-Ban glasses already use their camera feed to offer real-time visual advice — helping users choose outfits or troubleshoot problems by seeing what the wearer sees. Llama 3 will make that capability considerably richer. At a panel held at Meta's London headquarters in April 2024, VP of AI Research Joelle Pineau framed the ambition clearly: the goal is not merely a glasses assistant, but an AI that genuinely understands physical space and human interaction — the most useful assistant in the world.
The glasses are one piece of a much larger expansion. MetaAI will soon arrive on the Quest 3 VR headset and be woven into Instagram, WhatsApp, and Facebook, each integration tailored to its platform's context. Chief AI Scientist Yann Le Cun, himself wearing Ray-Ban glasses at the event, went further — predicting that every future digital interaction will be mediated by AI assistants, with the entire digital experience flowing through these systems.
Meta's broader bet is that AI assistants will become as foundational as search engines, and that embedding them into hardware and platforms people already use is the surest path to shaping how billions of people relate to artificial intelligence.
Meta is preparing to install its next-generation Llama 3 artificial intelligence model into Ray-Ban smart glasses later this year, a move that will substantially expand what the glasses can do. The upgrade marks a significant step forward for the company's vision of AI-powered wearables, transforming the virtual assistant from a tool that answers basic questions into something capable of handling far more nuanced and complex requests.
Llama 3 is Meta's latest large language model, designed to work across a range of sizes—from compact versions small enough to run directly on phones or glasses, to more powerful variants that rival OpenAI's GPT-4. The model will be released as open-source software, giving developers and researchers access to the underlying technology. What distinguishes Llama 3 from its predecessor is its multimodal capability: it can process not just text, but also speech, video, and spatial information about the physical world around the user.
The Ray-Ban glasses already have a foothold in Meta's AI strategy. Last year, the company upgraded the MetaAI assistant built into the frames to use the camera feed, allowing it to offer advice on clothing choices or help troubleshoot technical problems by actually seeing what the user is looking at. Llama 3 will deepen this capability, giving the assistant a richer understanding of real-world context and the ability to respond with greater sophistication.
Meta executives laid out their broader ambitions during a panel discussion at the company's London headquarters in April 2024. Joelle Pineau, the company's VP of AI Research, explained that the goal was never simply to build an assistant for glasses—rather, to create interactive AI models that could genuinely understand physical space and how people interact with the world. She stated the objective plainly: to make Llama-powered MetaAI the most useful assistant in the world.
The glasses are just the beginning. MetaAI will soon arrive on Meta's Quest 3 virtual reality headset, and the company plans to integrate the assistant into Instagram, WhatsApp, and Facebook, where it could help users manage large groups and navigate social features more easily. Each platform will benefit from the same underlying technology, but tailored to the specific context in which people use it.
Yann Le Cun, Meta's Chief AI Scientist, made a bold prediction during the same event. He declared that in the near future, every interaction people have with the digital world will be mediated by AI assistants—that the entire digital experience will flow through these systems. He was wearing Ray-Ban glasses at the time and said they had become his primary eyewear, a personal endorsement of the technology his company is building.
The expansion of MetaAI across multiple products and platforms reflects Meta's conviction that AI assistants will become as fundamental to daily life as search engines are today. By embedding the technology into hardware people already use—glasses, headsets, phones—and social platforms where people already spend time, Meta is positioning itself to shape how billions of people interact with artificial intelligence. The Llama 3 upgrade to the Ray-Ban glasses is one piece of that larger strategy, but it signals the company's confidence that the hardware and software are ready for the next phase.
Citações Notáveis
We didn't set out to make an assistant for glasses. We set out to build interactive AI models that could understand physical space and interactivity in the real world.— Joelle Pineau, VP of AI Research at Meta
In the near future, every single one of our interactions with the digital world will be through AI assistants. Our entire digital diet will be mediated by AI systems.— Yann Le Cun, Meta Chief AI Scientist
Quer a matéria completa?
Leia o original em Tom's Guide ↗
Technology