MetaMeta companylatestannounced that it willRay-BanSmart glassesLaunching a compelling multi-modalAI functionalities, providing users with a smarter and more interactive experience. This feature uses the glasses' cameras and microphones to enable Meta's AI assistant to perceive the audio-visual information around the user and respond accordingly.
Mark Zuckerberg demonstrated the update in a video on Instagram. He asked the smart glasses for suggestions on what to wear with a shirt, and the smart glasses AI assistant responded by describing the shirt and suggesting several possible pants to go with it. Additionally, he demonstrated the glasses' AI assistant's ability to translate text and provide image captions.
Zuckerberg said that users can ask Meta's AI assistant questions at different times of the day, involving questions about what the user is looking at or where they are. This shows that the multimodal AI function of this smart glasses is not limited to object recognition, but also includes language translation, image description and other applications.
In addition to the above features, CTO Andrew Bosworth demonstrated other features in a video, including asking the assistant to help annotate photos taken by users, as well as common AI functions such as translation and summarization. Bosworth demonstrated a new feature of the multimodal version on Instagram, wearing glasses and gazing at a wall art showing the state of California. Interestingly, he also seemed to be holding a smartphone, which suggests that artificial intelligence may need to be paired with glasses.
Bosworth said that starting next week, they will conduct beta testing in the United States, aiming to let users participate in the testing through an early access program, although he did not mention how to participate in the testing program in his post.
Smart glasses up to datelatestThe latest version debuted at Meta's annual Connect conference, with a starting price of $299. The current model already has a built-in AI assistant, but its capabilities are relatively limited, and it can't intelligently respond to video or photography, let alone real-time images of what the wearer is seeing (even though the glasses have a built-in camera).
This move marks Meta's commitment to integrating its AI technology into more hardware products to provide users with a smarter and more personalized experience. For the smart glasses market, this step may open up more diverse application scenarios and bring users a more convenient and intelligent life experience.