We all know that websites and apps should be accessible and work with screen readers. However, too often, this is not the case and it is a struggle to use them. Even when sites and apps are mostly accessible, you can sometimes encounter a form field that is not usable. This is where Screen Recognition can be a big help.
Recently, I have had to turn Screen Recognition on temporarily to complete tasks on certain apps and websites. For example, while I was registering on the website for Visa Airport Companion, I entered the necessary information but could not check the checkbox indicating that I was in agreement with the Terms and Conditions. When I turned on Screen Recognition, I could identify and check the checkbox. I ran into similar situations with other apps like Uber and Sonos. While the poor design of some elements on a website or app can be frustrating, at least a tool such as Screen Recognition can enable you to complete an otherwise inaccessible task.
To enable Screen Recognition, quadruple tap your iPhone with two fingers to open Voiceover Settings and swipe down to Screen Recognition and double tap to toggle on. Then double tap on Done at the top of the Settings. Alternatively, if Screen Recognition is in your Rotor, you can simply rotate your two fingers until you get to Screen Recognition and activate it that way. Don’t forget to turn it off when the task is complete because it can make the app or Safari difficult to use in general.
I hope this helps when encountering those annoying situations when you can almost complete a task but encounter an inaccessible element.
By Wayne A, 4 July, 2024
Forum
iOS and iPadOS
Comments
Screen recognition.
It's a great tool when it works.
It does make things accessible and with each mager update; they'll improve it even more.
its a wonderful tool
Its a wonderful tool. I know Apple didn't intend it to fix poor coding but it truly does. Again very well thought out by Apple.
Can't Agree More
I've used this feature a bit and could not agree more. Just yesterday when I was at my parents' place, for instance, I attempted to use an app called Enhance Pro. As previously mentioned on here, I now have a pair of Jabra hearing aids and this is the app that can control them. The app is rather inaccessible out of the box, but with Screen Recognition turned on it works a bit better. I had an issue with my hearing aids which ended up being resolved yesterday. The culprit wasn't technology directly, as I will explain in a comment to another post I wrote on here. But suffice it to say, this new feature is very nice. It is actually part of a new area within the accessibility settings, and it'd be great if @Anonymouse or somebody else on here did an audio demonstration of this 3-in-one feature. I, for one, am a bit confused by it but really appreciate what Apple are doing.
Waiting forever to see it on…
Waiting forever to see it on macos :( definitely a must know to use. Like for some financial apps from industry alliance it can be very useful.
Nothing against VOcr but it's not native, period.
@TheBllindGuy07
When the next apple vis report card comes out suggest it there. Put just what you had in this thread with some additional details. Example of how to write this suggestion up:
. Hi, please include Screen recognition on macOS. This would be very useful for financial apps from industry alliance. app XYZ replaced with the name of the app instead of XYZ app. is not accessible on the mac. If I use my phone and I use screen recognition on my iPhone it makes it accessible and I'm able to use the app. Be specific what tasks does it allow you to complete on your phone with it on? State that those same areas are not accessible for the mac side. This would boost productivity on the mac.
Screen recognition on Mac
I totally agree. I wish this feature was available on the Mac. It would be a game changer for the many times I encounter websites were forms cannot easily be completed.
I will send something to Apple accessibility to suggest this. Not sure if this will help but it’s worth a try.
@Wayne A and all
always submit feedback. If you follow what I suggested that should go a long way to hopefully getting it considered.
I used it on gumtree and it worked great!
For those that don't know; gumtree is like craigslist, I was going to say but for the UK but craigslist is in the UK too, it's clunky and I'm not a huge fan of the layout but it's here.