What is the Point of VoiceOver on the Apple Vision Pro

By Nicholas Stanford, 2 July, 2024

Forum
Other Apple Chat

I learned today that the Vision Pro has VoiceOver, and while I'm glad Apple continues to include accessibility solutions in its products, I do find this confusing. It seems to me that the Vision Pro is a primarily visual device, so why add VoiceOver? My only thought on this is it must be primarily for low vision users to use in some sircumstances, because I can't think of a reason for a totally blind person to use a Vision Pro. Is there one that I don't know about?

Options

Comments

By ming on Tuesday, July 2, 2024 - 23:12

well,
I think the voice over gestures are very incrotable and it is just use your finger to pinch or touch the other fingers to control it.
and it is very fantastic thing.
well,
tell me if I am wrong:
I think the vision pro is the only VR headset that totally blind people can use

By TheBllindGuy07 on Tuesday, July 2, 2024 - 23:12

I want to try this when it is here in canada in an apple store.

By SeasonKing on Tuesday, July 2, 2024 - 23:12

I want something like this for my IPhone. Hands-free operations.
Also, just because vision Pro's entire premis is around simulating a vertual visual environment, doesn't mean it has to be purely visual, similar to how IPhone's despight being very visual devices aren't just visual. They have audio, touch, haptics, etc.
If it can simulate a vertual visual environment, having a robust audio/haptic environment can only improve things. I am thinking full binoral soundscapes, elements having amazing earcons, and some great interfaces which take advantage of vertual auditory environment. Chances are that some of that stuff might trickle down to other devices as well.

By Ollie on Tuesday, July 2, 2024 - 23:12

I think it's grounding for whatever comes next. Very few people are buying this version, blind or not, but down the line with the second generation, or variation as it might be and if it is parsing data from all its sensors into an accessible format, voiceover will come into its own.

I agree, it's mainly visual at the moment, I'd also argue that it's not really for anyone yet, included sighted people, but I think it will be in years to come. If apple move into AR glasses, similar to the meta ray-bans, it's likely they'll use a fork of vision OS, and we've already seen how useful such smart glasses are. Feedback on any visual data through voiceover will be esecntial for our use.

By Manuel on Tuesday, July 2, 2024 - 23:12

I saw a video on YouTube where a blind customer has tested and reviewed it. The problem was that VoiceOVer constantly announced stuff and interpreted slight movements into gestures to execute. That's why he found the VoiceOVer experience was not on point as you have to be careful what you do while wearing Vision Pro.
Maybe it's better in the current visionOS version, and, who knows, maybe even better with version 2 that will ship by Fall this year.
I will definitely try the Vision Pro out in an Apple Store when it arrives at July 12th here in Germany.

By Nicholas Stanford on Tuesday, July 2, 2024 - 23:12

Thanks for the responses. The ability to control without touching anything is conceptually pretty cool. I'm not disputing that at all. My thoughts were more that since I can't actually see the augmented reality environment through the headset, it really doesn't do anything I can't already do on an iPhone or iPad. I guess for me what it comes down to is that I completely get how all the other apple products can be very useful to totally blind people. Since the whole point of this headset is creating a purely visual environment I don't see how that would ever be useful for blind users, especially since all the audio-based features should be achievable with an iPhone and a pair of AirPods Pro.

TL, DR: I understand how a blind person CAN use the Vision Pro. I just don't understand what it would do for a blind user that they can't get with their other Apple devices.

By Holger Fiallo on Tuesday, July 2, 2024 - 23:12

Keep hearing of Apple Glasses. Suppose to come out soon. Heard to be $400 but who knows.

By Nicholas Stanford on Tuesday, July 2, 2024 - 23:12

I've never used smart glasses. What do they do that's useful for blind users? Honestly I'm a bit behind on AR and VR stuff in general.

By OldBear on Tuesday, July 2, 2024 - 23:12

Having head control over aiming outward-looking cameras--not sure how many are in this contraption--could be that extra advantage over an iPhone and AirPods. But so could Apple glasses.
I despise the whole concept of projecting the user's eyes on screens on the outside of the glasses. It's like having a wall-hung video screen of fish swimming around, and expecting people to pretend to be fooled into thinking it's an actual aquarium hanging on the wall.

By Tyler on Tuesday, July 2, 2024 - 23:12

Member of the AppleVis Editorial Team

My understanding of current smart glasses offerings is that their main benefit for blind and low vision users is the handsfree experience. With a smartphone, a user could use one or both hands to position the camera over or in front of something they want read or described, but that might not be practical when navigating with a cane or dog harness in one hand, or for braille display users or those with limited hand mobility.

By mr grieves on Tuesday, July 2, 2024 - 23:12

I agree that having some of the functions of the phone hands free is fantastic. I use the Meta Ray-bans for things that the phone can probably do better, but it's just so incredibly convenient on your face.

So if I had a pair of glasses that had all my accessibility toolkit built in and I could take it anywhere without even needing my phone, that's pretty great.

The problem is the screen. As well as the cost of having it there, I can't help but feel that I wouldn't want that right in front of my face anyway. I'm sure it would be a quite uncomfortable experience. I can see enough to get a feeling of light and that there might be something there without actually having any idea what it is. I really, really don't like the idea of having reality projected at me via a screen.

If Apple could take away the screen, make it into a nice light pair of glasses and give me a sensible battery life then I would be interested. And they can stick a pair of googly eyes on the outside if they like, I don't care.

I think it is important for us to be taken along for the ride even if what's there right now is of limited use.

By TheBllindGuy07 on Tuesday, July 2, 2024 - 23:12

I am sure that sooner or later the same braille screen input on ios 18 will find its way on the vision pro. I think apple are enough smart and clever for that,with either vision pro or just the cheeper vision ... something rumoured apple is apparently focusing on now as they somehow understood that people are not willing to spend $3500 for what is still an experimental tech for most.

By SeasonKing on Tuesday, July 2, 2024 - 23:12

What is the point of this question.
With all due respect, Would the comunity have been okay if it didn't have Voiceover at all?
Apple is at least putting that much amount of thought and effert in making a first generation product this much accessible. Imagin the returns from this. I am not talking about monitory returns, but the jump in Accessibility. No other company would put this much effort in to making their first gen main-stream product this much accessible. Others would rather have you use controllers or keyboards connected to the headset.
I am guessing that When these things do take off, Apple is going to be leeps and bounds ahead of others in their software and accessibility framework for AR/VR compared to others.
Starting the accessible way also means that you get to research and develop early, figure out what works, what doesn’t, specify standards for your apps, so that they work with your assistive technologies.

By Ollie on Tuesday, July 2, 2024 - 23:12

I'm sorrry if I'm putting words in the OP's mouth, but I think it was more of a question, why might we want this product? Exploring it's benefits and flaws from a blind and partially sighted perspective because, maybe, for the partially sighted, this might be useful.

With the onbaord cameras this could be a good test bed for GPT's much delayed always on vision and voice system, for example. For partially sighted people, it could filter the world into more vivid contrast etc.

At the heart of it, this is a prototype for developers for future devices. It is not designed to be a mass market product. That will come down the pipe in two or three years time.

Regarding apple glasses, I've heard no rumours of price or spec or anything as yet. I'm not convinced they will have two lines, glasses and headset, but maybe they will. Siri on ones face and a head up display that can be projected for those with sight, sounds good, but then all the gesture control will be more difficult with the lack of sensors and, though I use voice at home a lot, this will be something that we don't use when out in pulbic.

By mr grieves on Tuesday, July 2, 2024 - 23:12

I was thinking about my own reply to this and it occurred to me that what I was saying is that these are absolutely what we need as blind folk as long as they are an entirely different product. I think a computer on your face, for me anyway, works best if I am just using my voice to control it or some simple swipes or whatever on the stem. I've not tried Vision Pro and have no massive desperation to seek out a pair, but the whole UI and interface sounds quite complicated. When I use the Meta Ray-bans I've never thought "I wish this had a screen reader". I'd like it to do a few more things but the interface it has works well for that. Maybe it would be nice not to have to have my phone around when I use them, but honestly who cares.

I think maybe the Vision Pro aren't really meant to be anything like the same thing - maybe more an executive gadget. SO I am beginning to wonder if the VoiceOver support is really that helpful right now. But who knows where these things end up. Maybe this will be the form factor for future Macs or whatever, in which case I'll be glad that they thought about it now and not way down the line.

For low vision users I can absolutely see these being fantastic. I tried something called OxSight, a few years ago which allowed me to adjust contrast, zoom in and so on, and increased my peripheral vision. I think this is probably what eSight does. I liked it but just didn't want it on my face. I remember them writing on a whiteboard and for the first time in ages I could read it because I could invert the colours and it just became really clear. Compared to something like that the Vision Pro is quite good value. Sadly no use to me now.

But right now, what I want from a wearable is nothing like this. I want third parties to be able to enhance the experience, but otherwise I think they are maybe just trying to do too much. I'm sure there is a market for VR - I'd love to have the sight to try it - but for I do wonder how many sighted people really have any interest or use for AR beyond the audio.

I can imagine for deaf users, if it could provide real-time subtitles on-screen in front of their eyes that it could be incredibly helpful.