New VoiceOver features in iOS 16 beta

By Nikola Jovic, 8 July, 2022

Forum
Apple Beta Releases

Hello all, previous topics I have seen on here talk in length about new voices, and new features for VO on the Mac. However, here, let's discuss what did you find in VoiceOver that's new in iOS 16? Before I start, a small disclaimer, this is beta software, meaning that any of this could be changed, modified or even entirely removed in the next update if it is found to be too unstable. I will do my best to update the post if that ends up being the case, but for users not on the beta, don't necessarily expect things to work exactly the same in September as they do now.

For my part, this seems to be a release mainly focused on bug fixing, which is actually a very welcome thing. I did however notice a few more things:

  1. Under verbosity, there is an option called web rotor summary. It can be set to either speak, braille or do nothing. For a long time, I was wondering just what is this web rotor thing? That's mainly because for a long time, I stopped using rotor to navigate by elements on the web, and instead use gestures. However, now I know what it's all about... When you are on a web page, and assuming you have one of the elements in the rotor, you will hear its count when you focus on it. For example, say you set your rotor to headings, after a brief pause, you will hear something like, 5 headings, assuming the page has 5 headings on it. This verbosity option mentioned above allows you to turn this off, if you so choose.
  2. Modernized sounds. Sounds for dictating, as well as starting / stopping Siri via the side button have been modernized. Not much to say about this one, sounds are quite subjective but I personally think these are quite nice. They are subtle, might not be ideal for people who are hearing impaired, but I personally can't comment on that. In addition to this, a new sound has been added, a small click you will hear while an item is focused using screen recognition. This is quite useful if you have enabled the feature by accident, since in apps that are already accessible, this can cause a worse experience. This sound will let you know you are currently focusing elements using screen recognition.
  3. Announcing directional changes. This one is actually a little specific, so it might be a bit hard to explain, but it actually helps to avoid one very annoying bug, or at least know when you are encountering it. As you may or may not know, there are two text reading systems, left to right (used in languages such as English and many others), and right to left (used in languages like Arabic). Depending on the one used, VoiceOver behaves differently. For example, if we are using right to left, all gestures are inverted. Swiping right would behave as if you are swiping left, and so on. Why is this important, if I don't speak any of these languages, you might be wondering? Well,, it actually is. In certain cases, developers use a method to display text right to left that actually confuses VoiceOver. Have you ever noticed a situation where, in an application, as you are swiping to the right, VoiceOver gets stuck and navigates back and forth between 2 different elements over and over in a loop? If so, you have encountered the bug I am talking about. Note that this never happens in Apple native apps, so if you encounter it there, that's definitely a different bug. This is only in 3rd party apps. An example of this is Google authenticator. If you try to add an account, and try swiping to the right after writing a code, VoiceOver will get stuck between the control to choose whether the account will be time based and the text field to enter a key. As you are swiping right, you will only go back and forth between these two controls. In iOS 16, before VoiceOver says the control for time, it will first say, "directionality changed to right to left" This means that you should rather swipe left to proceed after this control. In fact, if you do so, you will discover the add button, which was previously not focusable via swiping and VoiceOver will again announce that the directionality is back to left to right, meaning you can do the standard right swipe again. Note that this example is quite specific. It's entirely possible Google will address it via a future Authenticator update, and in fact I hope they do so, but nevertheless you have probably encountered this scenario in other apps and wondered why Vo got stuck like that. In iOS 16, it should be a little more clear when this happens.
  4. Time announcement. Time will tell whether this is a bug, or a feature, but it seems like when waking the device up, VoiceOver now announces the date rather than the time. I am personally leaning towards this being a bug, but since sighted people got many visual options to customize the lock screen, I am also really hoping that in the future Apple can make this customizable and let us choose exactly what we want spoken on the lock screen. Options for this could be time, date, notifications count, or nothing at all, so Vo would stay silent when you wake the device up if that is what you prefer. Of course, all of those could be individually enabled / disabled just like other verbosity options. I think that would be a welcome change, but of course that is more of a suggestion than anything else. For now though, if we can't get any customizations, I certainly prefer the time being spoken over the date.

And that's all, for now. Found anything else I missed? Feel free to respond. Let's focus on new features here rather than bugs, though just like my last point, if you aren't sure whether something is a new feature or a bug (which can absolutely happen), feel free to write it.

Options

Your Feedback is Important to Improving Accessibility on Apple platforms

Don't assume that Apple is aware of a bug or that your report won't make a difference - submitting bug reports directly to the company helps them reproduce and resolve the issue faster. Your report may provide crucial information. The more reports they receive, the higher the priority they give to fixing the bug.

If you're using a beta version, use the Feedback Assistant on your device to submit feedback and bug reports. If you're using a public release, follow the instructions on this page.

Comments

By Piotr Machacz on Thursday, July 21, 2022 - 18:43

If you check in audio>Sounds and haptics there's a new sound when a screen recognition item is focused, which is a slightly deeper click to the one VoiceOver normally makes.

This could be helpful in situations where someone might have turned screen recognition on for an app and then forgot about it or didn't realize it was on. Since this can cause apps that have good accessibility to read worse this is a useful indication of what's happening

By Holger Fiallo on Thursday, July 21, 2022 - 18:43

In beta 2 you could ask Siri to restart phone. However I heard that this feature was remove in beta 3. Sad. This would had been great.

By Nikola Jovic on Thursday, July 21, 2022 - 18:43

Thanks for the reminder, Piotr!
I noticed that in earlier betas but completely forgot about it, you are right, very useful for accidental usage of this feature. Will add that one too.

By Jim D on Thursday, July 21, 2022 - 18:43

Nikola and others:
Thank you very much for this post! This is really helpful for those of us who need to know about the changes in upcoming versions because we support individuals who use voiceover, but who aren't quite ready to hop on the iOS 16 wagon.
Thanks again!
Jim

By Daniel Angus M… on Thursday, July 21, 2022 - 18:43

Restarting my iPhone with Siri works for me! This seems to be a server side thing, as when I updated to beta two, it initially it didn’t work. Then it started working with no differences in how I used my phone. And it still works in beta 3.

By Holger Fiallo on Thursday, July 21, 2022 - 18:43

Yes. It was remove in beta 2, glad that is back. That feature is great when you will need to restart phone.

By Amir on Thursday, July 21, 2022 - 18:43

With iOS 16 Beta 3 Siri can be used, once again, in Offline or Airplane mode. It didn't work with Beta 2. Moreover, it seems to me that - at least compared with previous betas, VoiceOver crashes less frequently though it still happens here and there. Another point is that while encountering repeated emojis, VoiceOver now conveys this info a bit differently. First we here the count number, say, 3, followed by a brief pause, followed by the name of the emoji, say, Red Heart. Speaking of Nikola's points, I think - and honestly hope, the new date announcement is a bug rather than a feature. Hearing the time was more useful and less redundant.

By Piotr Machacz on Thursday, July 21, 2022 - 18:43

I think it's more likely to be a bug related to the new customisable lock screens.

When Beta 2 came out, the editing interface became usable enough that I was able to add a weather lock screen in addition to the unmodified one. If I used that weather screen, then VoiceOver would speak the time.

Now with Beta 3 the lock screen accessibility is very clearly a work in progress because while more of the editing UI is accessible you can only read the widgets by touch and not flicking. And VO is reading the date again though if you wait a few seconds it says the time as well. So I suspect this is something that'll be fixed in future betas.

What would be even cooler and I think I'll suggest this to Apple is if you could enable auto speak for single widgets like you can with watch complications so you can decide exactly what you want to be spoken when the screen wakes up.

By ming on Thursday, July 21, 2022 - 18:43

I hope when you turn on voice over on IPhone or IPad.
it will have the startup sounds when turn on the phone/ restart the phone or IPad as well.

By Manuel on Thursday, July 21, 2022 - 18:43

Which startup sounds do you mean? I cannot remember any startup sounds for VoiceOver, neither in iOS 15 nor in iOS 16 beta.

By wiljames on Thursday, July 21, 2022 - 18:43

When your iDevice is unplugged from charging, true, you do not get a sound when the phone powers on. You do get one when charging your phone. Maybe that will be an option soon.

By Bhavik Vyas on Thursday, July 21, 2022 - 18:43

there is an ticking sound when appstore is loading something . like in safari.

By Siobhan on Thursday, July 21, 2022 - 18:43

The phone has no electrical power coming to it, so how does it start up when the button is pushed? Especially if the battery is dead? plus, don't we have enough blindness products that play some cheery God awful chime upon the pressing of a button to show the world, I work! :) I guess maybe they can put the option in, but there'd better be a setting to shut that off because otherwise I wouldn't update.

By Knut on Thursday, July 21, 2022 - 18:43

Just a vibration might be useful.

By Siobhan on Thursday, July 21, 2022 - 18:43

If the phone's mute switch is flipped, it will buzz as the phone turns on. I still maintain that if the battery is dead, absolutely nothing will happen until there is enough juice.

By SplendidFault on Thursday, July 21, 2022 - 18:43

I don't know how exactly restarting your phone via Siri works, but if that's how I think it does, then it would expose you to pranks or similar misbehaviours. I wonder if that is an optional feature that could be enabled or disabled on demand.