Ray-Ban Smart Glasses Updated With Real-Time AI Video, Reminders, and QR Code Scanning (techcrunch.com) 16
An anonymous reader quotes a report from TechCrunch: Meta CEO Mark Zuckerberg announced updates to the company's Ray-Ban Meta smart glasses at Meta Connect 2024 on Wednesday. [...] Meta says its smart glasses will soon have real-time AI video capabilities, meaning you can ask the Ray Ban Meta glasses questions about what you're seeing in front of you, and Meta AI will verbally answer you in real time. Currently, the Ray-Ban Meta glasses can only take a picture and describe that to you or answer questions about it, but the video upgrade should make the experience more natural, in theory at least. These multimodal features are slated to come later this year. In a demo, users could ask Ray-Ban Meta questions about a meal they were cooking, or city scenes taking place in front of them. The real-time video capabilities mean that Meta's AI should be able to process live action and respond in an audible way. This is easier said than done, however, and we'll have to see how fast and seamless the feature is in practice. We've seen demonstrations of these real-time AI video capabilities from Google and OpenAI, but Meta would be the first to launch such features in a consumer product.
Zuckerberg also announced live language translation for Ray-Ban Meta. English speaking users can talk to someone speaking French, Italian, or Spanish, and their Ray-Ban Meta glasses should be able to translate what the other person is saying into their language of choice. Meta says this feature is coming later this year and will include more language later on. The Ray-Ban Meta glasses are getting reminders, which will allow people to ask Meta AI to remind them about things they look at through the smart glasses. In a demo, a user asked their Ray-Ban Meta glasses to remember a jacket they were looking at, so they could share the image with a friend later on. Meta announced that integrations with Amazon Music, Audible, and iHeart are coming to its smart glasses. This should make it easier for people to listen to music on their streaming service of choice using the glasses' built-in speakers. The Ray-Ban Meta glasses will also gain the ability to scan QR codes or phone numbers from the glasses. Users can ask the glasses to scan something, and the QR code will immediately open on the person's phone with no further action required. Zuckerberg also unveiled the company's prototype AR glasses codenamed Orion, which feature a 70-degree field of view, Micro LED projectors, and silicon carbide lenses that beam graphics directly into the wearer's eyes.
Zuckerberg also announced live language translation for Ray-Ban Meta. English speaking users can talk to someone speaking French, Italian, or Spanish, and their Ray-Ban Meta glasses should be able to translate what the other person is saying into their language of choice. Meta says this feature is coming later this year and will include more language later on. The Ray-Ban Meta glasses are getting reminders, which will allow people to ask Meta AI to remind them about things they look at through the smart glasses. In a demo, a user asked their Ray-Ban Meta glasses to remember a jacket they were looking at, so they could share the image with a friend later on. Meta announced that integrations with Amazon Music, Audible, and iHeart are coming to its smart glasses. This should make it easier for people to listen to music on their streaming service of choice using the glasses' built-in speakers. The Ray-Ban Meta glasses will also gain the ability to scan QR codes or phone numbers from the glasses. Users can ask the glasses to scan something, and the QR code will immediately open on the person's phone with no further action required. Zuckerberg also unveiled the company's prototype AR glasses codenamed Orion, which feature a 70-degree field of view, Micro LED projectors, and silicon carbide lenses that beam graphics directly into the wearer's eyes.
And now for the one burning question (Score:2)
Re: (Score:2)
When it becomes popular, I expect to hear about an app for it related to porn. Such as an "x-ray" AI app that undresses people.
Sounds like a buch of nice attack vectors! (Score:3)
Especially the QR-code thing.
Re: (Score:2)
Yeah, I can't wait till I print a whole bunch of QR codes with links to my OnlyFans page on self-sticky papers and go to town everywhere.
Tell me what's in front... (Score:3)
Possibly a life changer for some blind people.
Re: (Score:3)
The currently available Ray Ban Meta product can work with BeMyEyes. This new product will be amazing for sighted people, but the existing Ray Ban product will be about equally good for the blind.
Ray Ban Meta has cameras, microphone, speakers, and cellular Internet. It's missing a display.
https://www.bemyeyes.com/ [bemyeyes.com]
P.S. I just read a review and the Ray Ban Meta could be a lot better as a device to help the vision-impaired. For example, the review complained that the device will only summarize text, not rea
Re: (Score:2)
I just today saw this: Meta has working AI that can tell a blind person what the glasses see!
https://x.com/matthieurouif/status/1840865632209813558?t=O6xoM109P-rC_lITLZ7E8w&s=19 [x.com]
Sounds annoying - to everyone else (Score:1)
I guess people walking down the street talking to themselves, and you can't tell if they're on the phone with ear buds or just mentally ill, wasn't annoying enough.
Blues Bros. (Score:2)
They can do that (Score:2)
I had a pair for a week, I quite liked being able to play music on them while still being able to clearly hear my surroundings. Also liked using "Hey Meta, what am I looking at", it could even identify plants - one response I had was "You are looking at a pot of red chrysanthemum flowers".
Ended up returning them because the frames were too tight, which gave me headaches. They could not be adjusted like my other frames due to the electronics in the temples (aka the arms).
I plan to check them out again when
Obligatory Futurama quote (Score:2)
Pop-up ad: "Hey fatso, stuffa you face!"
Hermes: "This thing always seems to know when I got the munchies!"
So Chomsky was wrong, all those years ago (Score:2)
"Zuckerberg also announced live language translation for Ray-Ban Meta. English speaking users can talk to someone speaking French, Italian, or Spanish, and their Ray-Ban Meta glasses should be able to translate what the other person is saying into their language of choice."
It turns out that a machine without any pretensions to having a built-in innate universal grammar can, just by processing power and conventional software, be able to translate from one language to another. Guess that's philosophy for you
And more AI news (Score:1)
Zuckerberg can f@*k off... (Score:2)
Who even owns a pair ? (Score:2)