Seleste glasses.

By Brad, 18 February, 2024

Forum
Assistive Technology

First of all I'd like to thank the applevis member who introduced me to these glasses. I can't rememberyour name but i'm sure you'll know who you are when you come across this so thank you very much.

I'm very interested in the seleste glasses, I'm actually going to be talking to the founder on Tuesday/Wednesday depending on what they're doing about adding mapping functionality to their glasses.

They're planning on doing it and would like my input.

They're thinking of adding google maps to the glasses.

I found google maps to not really work for me, but that could just be me.

I do know that if you're in the US there's more accessibility options but in the UK they don't exist.

having said that; I can totally see the AI overlay making the maps app amazing!

So applevis community If you could have a mapping app on a pair of glasses what would it have to do for you to make it a winner?

For me I have the following: 1. I'll need to talk to Ela, the assisstent, and have her/it be as hands on or hands off as I need.

In other words, If I want turn by turn directions, I should be able to ask for that, if I just want street names spoken out loud as I walk past, I should be able to turn that on and off, same with busses trains and all that.

2. This is a maybe and i'm honestly unsure of it but, being able to tell someone when to cross the road, yeah I know; the mobility instructors wouldn't agree with that at all and I can see why so perhaps i'll move away from that one.

3. If I go into a shop/store, I need to say, scan for raspberries for example and it should be able to walk me to ial 1, 2, and 3, then scan for raspberries.

3.1 I should be able to ask where the counter/trolleys/carts are in the shop/store and it should be able to guide me to them.

4. Saved routes,, I should be able to ask it to save my roote and it should do so.

5. This is another unsure one, but what do you guys think about haptic feedback on the arms of the glasses? Tap left to go left, right to go right and the ability to turn that on or off if you want/need it?

That's all I've got for now so give me any of your ideas.

If I've missed a feature you must have, and no; making a sandwidge doesn't count, please let me know, this could be a game changer for us.

If you've not heard of seleste, here's some links: 1. The seleste website: https://www.seleste.co/

2. the youtube channel: https://www.youtube.com/@SelesteCo

Options

Comments

By Scott Davert on Monday, February 26, 2024 - 19:29

Member of the AppleVis Editorial Team

The tech would be fun to play with, but since no one bothers with braille support as far as I know, I'm mostly cut off from it as are the thousands of other DeafBlind people are cut off from Be My Eyes not having text calling and so forth. Maybe one day that will change.

By Brad on Monday, February 26, 2024 - 19:29

You could try BeMyAI, also if you would like text calling, email the bemyeyes team and see what they say.

Although won't it be hard to type a text then be told to move the camra or whatever, read what they wrote and then go back to your phone, I don't know i'm just curious.

By mr grieves on Monday, February 26, 2024 - 19:29

Will the Celeste glasses allow us to really feel the disappointment and misery in the faces of those Chelsea fans?

Nice to see another fan of the mighty reds on here.

Is there any hate for Be My AI? Or just from the blind bomb disposal team?

By Brad on Monday, February 26, 2024 - 19:29

@lottie, do you have proof of this hate of BeMyAI?

People might have concerns about privacy but I don't think they out right hate the app. If they do, that's wierd...

By Brad on Monday, February 26, 2024 - 19:29

And one day, you'll be able to sketch with words, well the sighted will anyway.

By Earle on Monday, February 26, 2024 - 19:29

I've been interested in these glasses for a while now. Personally, I have no problem with the subscription price. I know I could never afford the Envision glasses and I don't think the subscription option for Envision is available in Canada. I think that the Seleste glasses will get better as time goes on. It is my understanding that the app does not have to be open to use the glasses. Does anyone know what the different options are on the order page? There are 6 radio buttons and they all just say Seleste Glasses. I even tried screen recognition with no luck.

By Brad on Monday, February 26, 2024 - 19:29

What browser are you using?

With firefox the radio buttons read fine, they're tinted and non tinted.

The cart for me says items in cart even though there's none, I don't know what's going on with that.

By Earle on Monday, February 26, 2024 - 19:29

I tried using Safari on both my iPhone and iPad Pro. I can see the tint options, but the first thing I see on the order page is 6 radio buttons that just say Seleste Glasses.

By Holger Fiallo on Monday, February 26, 2024 - 19:29

I taught my clients that generalization does not help and creates problem. Reminded them that people do that about them just because they have a MI. Have fun playing with it. How long is the battery?

By Brad on Monday, February 26, 2024 - 19:29

the dev is on here but I'll email him to see if he can help.

By Holger Fiallo on Monday, February 26, 2024 - 19:29

No. Just letting you know. How you react is for you to decide. I do not control your feelings or thoughts. feelings of

By Bruce Harrell on Monday, February 26, 2024 - 19:29

The owner emailed:
Hi Bruce! Yeah we have a couple hearing aid users that enjoy using our glasses. Basically from our app you can route audio through the phone so if your hearing aids are connected to your phone you can get the audio coming out of that! Best, Shubh

By Brad on Monday, March 4, 2024 - 19:29

You just need to wait for your glasses.

I do think tutorials should exist on the website showing the features off so that peple can get excited though because at the moment the product isn't really shown off.

If I had a product; i'd want to show off it's best features so that more people buy it.

I think I'll email shub about this.

If you want something new; you're going to have to wait until after summer.

They're a very small company. Honestly I don't know how long they'll last,, they could last 20 years, they could last 5, it all depends on what the people think of the product.

I'm looking more into the glide personally, thanks for that amazing website again by the way, but the website does need a touch up, I think it should be made clear that you get a link afterwards that allows you to change your card and all that, well that's acording to Shub anyway.

I prefer it the other way around, you make your account then buy the product but you guys need to email him and call him if you want him to make changes.

he'll give you his facetime or number so you can chat,, but for peple like Lottie, keep in mind he's in a difirent country to you, I've chatted at 3 in the morning once and I didn't mind it but you might want to set up a time that works for both of you.

By Gokul on Thursday, March 14, 2024 - 19:29

Well yes, in that case it seems incredibly fast compared to whatever we have till now... and the discribtions also seem much more rich even compared to be my eyes which I believe is the gold-standard so far. And the continuously describe seen feature he talks about could be spectacularly useful/efficient! Now I am really excited.

By Brad on Thursday, March 14, 2024 - 19:29

There's better language moddles coming out all the time, the team actually should probably consider using claude 3 or something free. Chat gpt might have been the standard once but it's slowly being pushed aside by other LLMs.

By SSWFTW on Thursday, March 14, 2024 - 19:29

I am very excited to receive my pair. Really glad that he posted that demo video. I would also like to know and definitely will suggest if not possible, can we speed up the speech rate?
If not with that voice then can we use a compact voice that we can crank up?

By scriptsonic on Thursday, March 14, 2024 - 19:29

so here are some features I would like to have in the Celeste glasses.
That the glasses will integrate with Google Maps so that it will take a picture of where you're at and Cross reference it with the images Google Maps has. This would be way more accurate than GPS I think. GPS can be accurate to about 20 m², but a Reference to a picture /image stored by Google Maps, would be more exact. Also with regards to crossing the road, I wouldn't trust an AI to step out into the road, but maybe an AI could identify a crossing device such as a what we call pelican crossing or zebra crossing in the UK. so the device would scan for a pedestrian crossing device and help me find it. I could never step into the road on the say so of an AI. Hope I'm not too late for these comments to be passed on to the guy developing Celeste. Cheers for the post. a very interesting device.

By Brad on Thursday, March 14, 2024 - 19:29

Either way that's off topic.

I'd highly recommend anyone email Shub, he's good at replying and will talk to you about the glassesover facetime if you'd like.

He's very nice, giving me a refund on the glasses as i wouldn't actually use them so yeah feel free to email with as many questions as needed.

By Dave Nason on Thursday, March 14, 2024 - 19:29

Member of the AppleVis Editorial Team

I only ordered mine a week or two ago, so will be waiting a while longer sadly.
Looking forward to gearing what the first batch people think.
I’d suggest sticking mostly to this thread, it has the perfect title after all ☺️
Any formal review would be separate though of course.
Dave

By mr grieves on Thursday, March 14, 2024 - 19:29

I got a bit lost with the different Meta Ray-bans threads so happy to keep everything here, although might be less useful for someone who wants to get past all the random chat first.

I watched the recent video and it sounds good but I'm still a bit unsure as to how this works. There was enough of a lag to make me thing that AI processing is done in the cloud. So do the glasses talk bluetooth to the phone, and then the app on the phone uploads the image to the cloud? Or are the glasses doing more than that? I don't think they have a sim card so I'm guesisng it's all from the phone?

That's probably fine for ad hoc images, but the continuous mode might be a problem. I'm thinking battery life, speed and the cost of uploading a load of images. It's a shame there wasn't a demo of this as it's the one thing I can't quite picture.

Can't remember if this is something coming soon or already available? But would love it if someone could explain how this works when possible please.

Also would be interesting to know how useful people find the image descriptions when out and about. There was a huge amount of detail in the demo which was fantastic, but I'm thinking if I'm just trying to find my way in somewhere it may be a bit too verbose. But obviously in other situations that amount of detail would be perfect. I guess it depends what questions you ask?

It would also be great if anyone has been able to try both Celeste and the AI in the Meta Ray-bans and can compare.

The subscription still puts me off a little. Not that it is expensive for what it is, but whether I would use it often enough to justify that, and whether the Meta glasses are good enough for my needs assuming the AI ever comes to the UK.

By Brad on Thursday, March 14, 2024 - 19:29

it's uploaded from the phone, so it probably goes: take picture, picture is sent to the phone, phone uploads picture to cloud, then seleste speaks the results.

A more conprehencive podcast/demo would be nice.

By Portia on Thursday, March 14, 2024 - 19:29

Hey guys,

Well... I ordered my Seleste glasses on February 28, and they will be here on the 26th of this month, according to them, and when I track using the Canadapost website!
I'm so excited to unbox them in a video/podcast when they arrive, and the things that they will bring to us as the future unfolds will be exciting, too!

By Holger Fiallo on Thursday, March 14, 2024 - 19:29

I cirious how many will get it and later return them. Hope someone here check that. Will be interested to know within of getting it how many will return them by 6 months. Hope it will be easy to do so.

By Brad on Thursday, March 14, 2024 - 19:29

Why would invision be talking about that? IS it that CSun thing?

By Brad on Thursday, March 14, 2024 - 19:29

I think i'll stick to reddit for now. If it goes down then I'll check out that mastidon thing.