A Preview of New Accessibility Features Set to Come Later this Year in iOS 11, watchOS 4, tvOS 11 and macOS 10.13 High Sierra

Wish iPhone 5 is able to get this update, but looks like apple is no longer supporting updates for iPhone 5... so disappointed because I'm now stuck with all the bugs from ios 10...

... A nice update. I really like the improvement ti invert colors, as I use that feature all the time, and hate how it inverts pictures. Speaking text in a picture is a nice little feature though. What would be really cool in addition to that is having the ability to set in accessibility a print screen to OCR feature. Essentially you could take a screenshot, and, if this feature is enabled, instead of saving it to your camera, it could use OCR to read text and just say it back. This would be very useful, for instance with Video content on which a lot of text is displayed.

Hello all,
I was not impressed by the keynote on Monday. However the improvements I see above make me a bit happier. Improved PDF support is something I have been seeing for quite a while and it looks like it is finally going to happen. I am also looking forward to the improved web and mail navigation mentioned. I also think with the, hopefully, soon to be released Orbit Reader 20 the braille improvements will be very useful.

Regards,
Greg Wocher

Hi. What does the thing with captions and videos mean?

Hello! Nice enhancements. I am waiteing for a new option the switch languages. It's very welcome to see after a long time. I am happy about supports Apple TV via a braille display.
I wait to see more so-prices.

I cannot wait to play around with all the new features! I'm especially excited to try out the image disscriptions and text within an image! I wonder if I could use this on GIF.'s. If so, that'd be a huge improvement. While I will not be entering any betas, I'll be anxiously awaiting the update in the fall. I also hope that they squash some of the bugs still crawling around ios10. Nonetheless, I'm excited with anticipation. Also, I wonder if the captions will work on Youtube videos, or if jhe videos will have to be done and edited or tagged certain ways. It'd be nice to be able to watch videos on YouTube and know a t least a bit more about what's going on. I have iome channels on my subscribed list, but it'i just Fox News and The Tonight Show With Jimmy Fallon, because those at least are pretty much auditory. Other than that, I just use it for music.

Congratulations apple accessibility.
I really enjoyed the new Improvements features.

This is what we need.
general Improvements
I hope the accessibility team focuses more on improvements than on major features that are not very useful and with many issues.

thank you apple.
cheers.

Just hoping that apple fix the bugs that we have at this moment such as VO saying unread in the news app. I will give anything just for this.

...just wow. This is really amazing. I feel like Mac, IOS, and Apple TV for braille users are going to be a lot better. I'm now considering whether I want to take part in the betas.

I'm impressed highly by the new stuff coming. Now my world will open up more, I mean, I can hardly imagine the pics described by voiceover, and those alt text pics on FB with text will never be a mystery again. At least I hope that feature is worked on heavily.

If that will really start to happen with the next update, that would be so convenient!

I'm looking forward to Apple's work on automatic image description. I want to say that that's an incredibly difficult job, to which thousands of academic research-hours have been thrown, so I will not be surprised if the function has limitations or false data. I'm of course very interested in it, however, as I'm sure all of you are as well. Actually, the data for videos seems even more useful to me than for plain images, as we already view videos often, and any additional data could be very helpful. I look forward to seeing it in action.

I cannot wait to try out these accessibility enhancements in the fall when I update to High Sierra. I've been waiting with baited breath for better native pdf support, and hopefully it will actually become reality this time 'round. Automatic language detection will be super cool too. Well done Apple accessibility team, as always!

Already feeling the excitement of what will be the new features that Apple will bring for all of us. Image description will be a tremendous step. Finally, we will be able to read text in bedded in images and/or find out The content of a picture. Nice, Apple. Way to go. Language detection will be excellent. I just can't wait to try it out. Thank you, Apple accessibility.

For the first time in years, I feel like Apple is actually showing some love for the Mac. It is long overdue in my opinion, but I am still grateful it is happening.

I have preferred to check email on my iPad instead of on my Mac because of how VoiceOver treated the message as a single block of text, even if it was formatted like a webpage. It sounds like that is changing, and VoiceOver on the Mac will begin interacting with emails more consistently with how webpages are treated. That will be a very welcome addition for me.

I am also really glad to see support for tagged PDFs finally showing up. This should have happened ages ago, but better late than never.

Having said all that, the one feature that I am looking forward to more than any other, by far, is the ability to announce text in images. A recent trend I hate is when somebody releases a statement for the media, and the statement is posted on Twitter. Because of the 140 character limit, the statement is converted into an image of text, which visually looks just like the rest of the text on the screen, but to VoiceOver the text within the image is invisible. I know I can copy the image and drop it into an OCR app of one sort or another, but that is a pain. If I can extract the text directly, with a single VoiceOver command, I will be very happy indeed. This should be easy, since the text in the image is just like any other on the screen, so the issues that normally get in the way of OCR accuracy should not be a problem.

Wow! Apple finally figured out that it is not helpful for low vision people to see negatives of all media!
Kidding aside, the inverted colors thing it was much needed and long-overdue. Picture descriptions is cool. OCR of unreadable text would definitely do a lot to catch voiceover up to other screen readers. Also, I am still going to hope against all available evidence that one day we might have control over the functions of the different gestures.

I am also looking forward to the accessibility features in iOS 11 and macOS High Sierra. For example the image description.

I'm really looking forward to the new accessibility features coming in iOs and Mac OS. I'm looking forward to hopefully being able to tell what the text says when people post images of text on FB and twitter. I'm also anxious to see how the changes in braille will work. Editing in grade 2 without having text converted to grade 1 will be very interesting. I definitely plan to participate in the public beta cycle for Mac OS since I have access to multiple Mac computers. I would love to test iOs, but being that i only have 1 iOs device that can run iOs 11, it won't be practical for me to beta test. At any rate, I'm pretty excited about this year's upcoming updates.

I'm loving this stuff. Can't wait to get my hands on the PB's (public betas) and test this stuff out. Good job, Apple!

The automatic transcription of voice mails needs to go away. Apple that talks so much about privacy and then gives the user no option as to whether or not private voice mails are sent to their servers seems kind of wrong.

This is the first time we've seen some of these features, and not everything will be perfect. So, in the first release of iOS 11 be prepared for a bit of a bumpy road. But as time goes on i'm sure any bugs will be squashed. This is how it usually goes with Apple. They perfect things as much as possible, release the new version and squash any bugs in subsequent releases.

Language detection already exists in VoiceOver on webpages and apps that have appropriate language tags.

Yes, but I think apple is making it system-wide now.

I wonder if this will include subtitles? If so, that will be a huge change to the way we view movies and Tv. I'm not getting my hopes up though.

Hi! It's exist in ios but it is not perfect because not all web sites useing in language tags. I n MacOsS it dosen't exist until now.

Perhaps there are already functions like this and I don't know about them, but here's my VO wish list.
1. More voices; Acapella or Eloquence speech would be nice
2. Verbal/tactile time announcement in the Clock app. You could have a voice and/or chime of your choosing on the hour or half-hour or quarter-hour and it would sync with Apple Watch. The apps designed for this purpose don't sync with the Apple Watch and since this feature is on the Mac to some degree, we should have it on our iDevices as well.
3. Customizable VO sounds; more options and the ability to mute the VO sounds you don't like and keep the ones you do like.
4. Some sort of vibration/haptic feedback/sound when an iOS device is successfully turned on. When I turn my phone off, it's always a guessing game as to whether the phone is turned on or not because there's no feedback unless you can see the apple icon on the screen.
5. Customizable speech output; if you had a Braille Note, you remember the "Speech on request" feature. Basically, while you were using the display, the speech was sort of half on. So, if you needed speech for reading a document or whatever, you could activate that particular feature without turning on speech for everything. I like speech, but only for certain things like reading long strings of text, etc.
6. An easier way to pair Braille displays without being forced to use speech, particularly for deaf/blind users.
7. Haptic time on iOS devices. So when your in a meeting, you just activate haptic time without the phone talking.
8. For the Apple Watch, a set gesture that "wakes" up the watch instead of accidentally activating it when you bump it against something or press a button without meaning to. I'm sure this would save A lot of battery as well as make for a more quiet experience.
And this is all for now. Perhaps more ideas will come later.

i've noticed and we're not even on iOS 11 yet some tweeks to siri and weather.

In regards to voices, that probably won't happen. The time thing is cool though.

Usually, a 3 finger tap will tell you where you are on the screen and what row and column it is. Does this mean that this info will be replaced with the image description feature? Not that I am complaining. I am not really interested in columns and rows anyway.

Hi guys,

My biggest issue with iOS is the fact that "Braille displays" are treated separately from bluetooth keyboards.

The fact that you cannot wake your device from a display is an issue for those of us with hearing problems.

I had a Braille paring issue this morning, which I believe wouldn't have been an issue at all if the display could work like a bluetooth keyboard.

I like the time suggestion. I have 2 other suggestions for the Mac, and perhaps iOS devices although I don't currently own one of those so I may be jumping ahead of myself here. But the first suggestion has to do with the time thing, and other announcements. It would be cool if we had the ability to choose from a list of possible sayings, and/or make up our own. For instance, when in the VO utility and sampling the different voices and such, there would be a list of possible sayings. I like what we have now too, which is: "The best way to predict the future is to invent it." My other suggestion is haptic feedback for the Mac, or would that be too hard to implement? The idea of haptic feedback intrigues me. I only saw it once, and that was a few years ago when I was helping a PhD. student out with his research project.

Hi,
Well, the new MacBooks have haptic feedback in the trackpads. I don't think they'll put haptic feedback in the whole machine, as it's on your lap, and any alerts that come in would be usually announced by a tone anyway. I don't see haptic feedback in the mac ever happening.

The iOS 11 VoiceOver accessibility improvements, specifically captions and PDF look great.

1. The UX I understand is the captions of a video can be rendered by VoiceOver in Braille and/or Speech. I’ve the setting enabled andhave tried videos in iTunes, Netflix, Prime Video, and YouTube, but the captions are not uttered by VoiceOver. Does the app developer or content producer have to interface with some new accessibility API to have this feature come alive?
2. The UX I understand for PDF accessibility is that a tagged PDF produced in Acrobat Pro or Microsoft Word consume using iOS 11 VoiceOver would allwed the tags to be accessible. For example, it should be possible to navigate by headings and read alt text in images. I tried a tagged PDF in iBooks, but it was not possible to navigate by headings or images, nor were the headings announced when touch exploration, and the alt text of image was not spoken. Does this require an iBooks update or does content producer need to apply specialized tags specific to iOS 11 VoiceOver?

Have others had success with these features? Any tips or pointers are greatly appreciated. Thanks!

hi all, can i set an auto-advance mode with a braille display for ios or ist feature only available in windows or mac for displays that support it? I am still considering a focus 14 but if i have to keep panning will find it frustrating. thoughts?

Hello,
The only auto-scrolling setting I know of for VoiceOver for iOS is one that will turn the page on multi-page documents such as in News.
I assume you want auto-panning? I think you will need a display that can do that for you, at least in iOS 10. At this time the only one I know of that can do it is the Handy Tech actilino.

Hi folks,

An auto pan or as HumanWare calls it, auto advance would be very useful, especially when reading very long texts. Safari and my Braille sense really do not like each other very much, so a bit of love for Web support would also be very nice, I am downloading the macOS beta as I write this, so I will have to take another look later.

Autoadvance is very necessary for the subtitles feature in IOS 11 because without it, the subtitles scroll by quickly and if they span a second line, you land up missing it.

It would be cool if Pages had this feature as well. Or perhaps I'm missing something? I received a newspaper article earlier this week from my mother, about a longtime family friend who passed away suddenly earlier this year. I was able to read the whole article with VoiceOver, but I had to do it manually with the up and down arrow keys because Pages stopped reading automatically after the first page. I even tried a Say-All but that didn't work. This has been the case with other things I've read using Pages and TextEdit. I've looked through the menus and found nothing. But I suppose I'll try that again.

Hello,

it's great to see such significant improvements possibly coming, especially text recognition in images. I hope that one of the improvements to the webpage navigation on Mac will be the proper support for reading a webpage using the down or up arrow with QuickNav turned off, that is, in the same manner as one would read a text document. Because currently, when the keyboard focus enters a text field, the VoiceOver cursor gets stuck there and you cannot continue to read the webpage with the down arrow, or with any other arrow key navigation commands for that matter.

Another thing is that when reading webpage with QuickNav off, item type, such as heading or link, is announced before the item text itself, and this cannot be configured using VoiceOver Utility.

Better PDF support is also a very welcome one. Apart for navigation by headings and links, which was not mentioned by Apple, but which I consider as quite important feature, it would be great if it is possible to select text in PDFs just as one can do in Pages documents using Shift and arrow keys. Currently, there is no sensible way of selecting and copying text from PDFs.

Regarding the auto detection of a document language and voice switching, as many other people I don't believe very much this could be reliable and it doesn't work for multilingual documents, I never use it on iPhone. Rather, I would welcome a single keyboard shortcut for switching to the last used voice, in a similar way as the speech rotor works. But currently it's not handy to switch between the speech rotor settings all the time to find the voice setting. Therefore, e.g., VO + Shift + left bracket for previous voice and VO + Shift + right bracket for the next voice would be very nice. Also speech rate modification could have direct keyboard shortcuts even though it can currently have them using the Keyboard Commander, but that needs configuration. Default shortcuts like VO + left bracket to decrease speech rate and VO + right bracket to increase it, so that the shortcuts are close to the previously suggested Voice switching shortcuts and are comfortable for the fingers, would be highly appreciated. Unfortunately, these keys are already occupied for other commands, however, to my viewpoint not so essential ones, and those could be moved to VO + Command + comma and period, for instance.

Speaking about shortcuts, I wonder there is no standard one for reading first the current time, including seconds, then date and lastly the day of the week, and which will reflect the system language and region settings. A keyboard shortcut for reading the battery level and if it's charging is also missing. These announcements can be done via AppleScript, but that's not for everyone and launching these scripts has some delay after pressing the shortcut.

Recently we have seen Pages adding support for document navigation by heading using different kinds of rotors, I am very grateful for that, just wish that navigation by headings, links, tables, etc. using single-key QuickNav as well as VO + Command + letter will soon be also possible, hopefully in Microsoft Word too. Something for Pages to be inspired from Microsoft Word might also be using Ctrl + Shift + Right or Left arrow to quickly set a heading style for the current paragraph or increase/decrease its heading level, and keyboard shortcuts for converting to numbered or bulleted lists..

This more or less sums up the most crucial points I am experiencing on the Mac. Anyway, thanks to the AppleVis team for sharing these plans for accessibility which look very good.

Kind regards

I've noticed in IOS11 beta that a 2 finger swipe right is explained to skip to related content. However I have not found what this does.

For those who would like paragraph navigation, if using a braille display, you can assign a key combination to the previous and next paragraph settings. For example, I've set mine to backspace with dots 2 3 to go to the previous paragraph, and backspace with dots 5 6 to skip to the next paragraph. This is under the "Braille commands" section of the info page of the braille display setup in the braille settings

The ability to assign *any* Braille command is excellent, and the structure and interaction is very polished. Within Voiceover Settings > Braille > Display > More Info > Braille command.