Enabling Look and ask with Meta AI on Ray-Ban Meta smart glasses

By kevinchao89, 19 December, 2023

Forum
Assistive Technology

Not sure if anyone has tried to get into the Early Access program to try Look and Ask:
https://www.meta.com/help/smart-glasses/articles/voice-controls/look-and-ask-ray-ban-meta-smart-glasses/#
because of hearing about the "Look and Ask" feature in a podcast a friend shared with me yesterday. I got a pair of Ray-Ban Meta smart Glasses earlier today in the afternoon and have been unsuccessful at performing the correct gesture to make the "Early Access" option appear. Settings > Swipe-Down > Early Access > Look and Tell.
This part is on iOS app and has to do with VoiceOver and it's about getting the feature enabled. Has anyone been successful at:
"From the Meta View app, tap in the bottom right. Swipe down and tap Early Access. Tap Look and ask with Meta AI to turn this feature on."
// Nothing seems to happen after swiping down (tried three-finger swipe,down, bypass > swipe-down, and with VoiceOver OFF), so not seeing "Early Access".

Options

Comments

By mr grieves on Tuesday, May 28, 2024 - 08:31

A few weeks ago, I installed Proton VPN and got the AI working. Then I turned off the VPN and haven't enabled it since and it's been fine. So you should be able to get rid of the VPN if you don't want it for anything else.

I never had to pay anything for Proton.

By mr grieves on Tuesday, May 28, 2024 - 08:31

Literally the next time I use the glasses after posting that I am told that it isn't available in my region, so I guess it must time out at some point.

I'm a bit suspicious that this has been actually released in the UK at all.

And now battling with Proton trying to remember how I got it to use the US.... Apparently I need to subscribe to choose a country but it did work last time I'm sure.

By mr grieves on Tuesday, May 28, 2024 - 08:31

Where did you get that date from? I hope you are right - that's not too far away. I just need to decide if I can hang on that long or if I need to take out a trial to a VPN. I don't really want one for anything else and it seems silly to pay for what is effectively 5 minutes of fooling a pair of glasses.

By mr grieves on Tuesday, May 28, 2024 - 08:31

Thanks - that sounds promising. Let's hope so!

I really couldn't get Proton to work with the US yesterday. I think maybe I've used up my allowance for manually changing country in the free plan. So will have a look at going for the free trial of the full plan if I can't wait that long. (I am missing it quite a lot already). I have to say the Proton app seems quite accessible - I thought there were some rough edges before so either I imagined it or they have fixed them.

By mr grieves on Tuesday, June 4, 2024 - 08:31

So I gave Proton another go today and just tried switching to US. Again it tried to get me to subscribe so I said not now. Then I went to quick connect and told it to change server. And I ended up in the US. Not sure if this is a coincidence or whether it allows me to do this maybe once a month.

Anyway, opened MetaView and it told me I no longer had full access to AI. Closed and reopened, and it asked me to enable it.

So, back in business!

By Adwetya02 on Sunday, July 21, 2024 - 08:31

Hey Guys,
Instagram Story Saver apps allow users to download and save stories from Instagram to their devices. These tools are handy for preserving favorite moments or content for later viewing offline, enhancing the user experience by enabling easy access to shared media.

Visit Here & Download Story:- https://storysaver.page/

By kevinchao89 on Monday, October 14, 2024 - 08:31

Had a fun blind rock climbing session, where I used Ray-Bans Meta AI to "look and read" the route tags, which was able to identify the grade of climb for the most part. I also tried the beta of AIRA to have a remote visual interpreter call holds for me, which worked surprisingly well on the call that I was able to get an agent.

By The Blind AI on Monday, October 14, 2024 - 08:31

I saw it was earlier, but not on my laptop not yet.

By mr grieves on Monday, October 14, 2024 - 08:31

I saw a tech crunch article yesterday saying that it had arrived in the UK, Brazil and a couple of other countries although it didn't link to the source article and didn't state that it applied to the Meta Ray-bans. But I think the hold-up is likely to be legislative rather than technical so I guess if it comes out in one place then it should be released in all.

They've been talking about this on Double Tap the last few days and it seems that for some people in the UK the AI is just working out of the box. But for me I had to reconnect my VPN after it booted me out on Monday, I think.

Feels like it might be imminent though - fingers crossed.

I'm sure it's getting better too. The answers it has been giving me recently have been quite impressive.

By Gokul on Monday, October 14, 2024 - 08:31

I thought it was me imagining things. Great if I'm not.

By Ollie on Monday, October 14, 2024 - 08:31

UK doesn't get the multi modal AI, whatever that means. I have a feeling that includes the look feature. In short, I think the raybans only get to speak with meta AI, but it can't look and tell etc...

By mr grieves on Monday, October 14, 2024 - 08:31

I think you are right.

The Verge mentioned this here: https://www.theverge.

According to this article, AI in the glasses is coming to Australia and the UK, though the latter is only voice support “to start.

So yeah guess you can ask it questions but not ask it to talk about photos it takes. However "to start" does imply it should be coming at some point.

By The Blind AI on Monday, October 14, 2024 - 08:31

I've got it for about 27 years - after all the offers from podcasts. the wierd thing is, I was listneing to a podcast the other day - it wasn't sponsured by NORD VPN!

By Ollie on Monday, October 14, 2024 - 08:31

It seems that once you've activated using VPN, it should, and take this with a grain of salt, stay on. There are conflicting views, however, over on the meta stories reddit that you have to sometimes re up using your VPN.

I set mine up using a VPN and, touch wood, it seems to have stuck. I've not used the VPN for a good while now.

I would urge caution on this though. I did reflect, walking to my local coffee shop, that it could become an issue if I were relying on it only to discover it not working.

As always, I believe these things are great additions to mobility, but make sure your cane skills and willingness to ask for help remain polished. Reliance on technology beyond a five foot rod of titanium and ones wits it's a precarious proposition.

By Gokul on Monday, October 14, 2024 - 08:31

I've had to reconnect using vpn, say, once in a month or so...

By mr grieves on Monday, October 14, 2024 - 08:31

Every month or so the AI in my glasses stops working. At that point, I quit MetaView, open WinScribe and turn the VPN on. Then back to MetaView, usually having to quit and reopen a second time, then I just enable it. Back in WinScribe I turn off the VPN. And it then works for another month or so. It takes about a minute to get it back up and running now. And WinScribe is free. I am loathe to subscribe to something I use for a couple of minutes a month if that.

My main issue with the glasses is that I often find I get errors saying that there is no internet. Which may be a problem with my mobile provider, three, I guess. But it's annoying if I go out for a day and find I can't use the AI at all.

An update came in yesterday. I can now set timers on the glasses which is pretty handy. You can also share the last uttered phrase to a contact, or on Facebook or whatever. I think it's a bit sensitive as to how you ask it to do this. I tried "share last response with my wife" and it said it could only share the most recent response. I said "share most recent response with my wife" and it gave me the same error. I tried a few times, then "share response to wife". It then told me there were no responses in the last 30 seconds. So I still need to fiddle with that a bit.

You can now also record voice messages and send them through WhatsApp.

By Ollie on Monday, October 14, 2024 - 08:31

Yeah, I've switched to EE which is more stable than O2, especially here in Bristol where meta was constantly failing due to poor data connection. Saying that, it did fail yesterday.

Top tip: If you are out and about and this happens, open control centre and toggle airplane mode on and off and it will reconnect you to the network, hopefully with a better priority.

By mr grieves on Monday, October 14, 2024 - 08:31

Thanks for the tips.

A couple of times I did close and reopen the MetaView app which fixed the problem but usually not. I'll try to remember your suggestion next time.

I used to be on giffgaff which uses o2. I liked it because you didn't get tied into a contract and it's quite flexible. I stupidly changed to three because it was a good deal and I was going to get the data plan on my watch, but in the end I couldn't really justify paying the extra when I could just keep my phone in my pocket. I need to find a bit of time to shop around and see what offers are available, so I'll definitely check out EE when I do that.

By Ollie on Monday, October 14, 2024 - 08:31

Cycling the meta app helps too. It sometimes seems to drop connection to the server.

Yeah, I'm on a 30 day rolling with EE. It's always such a gamble to move providers. As far as I understand it, EE has the best coverage and going between Leicester and Bristol I had very few drop outs, with O2, it was nothing but drop outs.

the other thing to keep in mind when using sub contracters like giffgaff, tesco, sky etc, is they may be cheaper but you are shunted further down the contention rating so, if it is a very busy mast, full fat O2 customers will be prioritised. I didn't know this and was surprised to hear about it.

By Ollie on Monday, October 14, 2024 - 08:31

This is just in general though, we do need good signal all the time. I think there is a greater importance for us as we are so reliant on phones, which is why I was happy to get a couple of contracts and use them at the same time to A/B test. I'm headed to Cornwall next week, so will have to see just how that holds up.

By The Blind AI on Monday, October 14, 2024 - 08:31

I have 2 numbers on my phone, different networks, so I always have the best chance at a good signal.

For what it's worth, EE AND o2.

By Brian on Monday, October 14, 2024 - 08:31

If I may ask, Ollie, how far do you travel throughout your day during your commute? I’m just curious as it seems like you do a lot of traveling, and have to deal with a lot of service crossover.

By mr grieves on Monday, October 14, 2024 - 08:31

So I played around a bit more with this. If I say "Hey Meta, send last response to mrs grieves" it asks me if I want to send it via WhatsApp, so I confirm. It then sends her the text of my original question plus the response. If I have tried a look and ask with a photo, then it works but does not also send th ephoto.

As mentioned before, the wording is important - it doesn't understand it if you preface response with anything like "last" or "most recent" or whatever.

Nice little feature though. It's also easy to forget sometimes that Meta AI can be used like a normal voice assistant and it's pretty good. Actually, the AI responses recently have been much better than before.

I'm amazed that companies like giffgaff have a worse than than the main companies like o2. That's really interesting.

I've never tried using multiple sims in one phone before. If I was to stick a pay as you go in my other socket, does it just automatically fallback to it when the main sim doesn't have a signal?

By Ollie on Monday, October 14, 2024 - 08:31

Assuming you're on a relatively up to date iPhone, you can have eight E-Sims but only two active. Having an E-Sim will depend on your carrier, but I think most do it now. It's easy to convert in settings, cell/mobile, depending on where you're from.

You have to set your primary voice line,for obvious reasons, though you can still receive calls to both lines and, if you do need to call from the other line, you can choose in the phone app.

Regarding data, which I think is what your'e really interested in, you can again, set your primary data sim but you can also tell it to use data from teh other sim when needed, IE, if one drops out the other should take over. I was briefly doing this with EE and O2, but couldn't really tell if it was working or not. EE was fairly solid throughout and getting 5 g in many more places than O2, though I think it is limited to 100 MBPS.

Regarding traveling about, it's up to Leicester to see my folks, live in Bristol, and was studying in Bath, which I visit less often now the MA is over. Even throughout Bristol there is a wide variation in signal though with some deadspots for all carriers. Luckily, I don't live in one of those...

By mr grieves on Monday, October 21, 2024 - 08:31

Thanks, that's great info - it definitely makes sense to add a second pay as you go sim I reckon.

By Gokul on Monday, October 21, 2024 - 08:31

Meta AI descriptions have improved like anything! Got some time and so played around with it for sometime today. I'd almost say it's as good as gemini as far as descriptions are concerned.