IOS VO Image Recognition Question

By Bellsfurmama, 21 July, 2017

Forum
iOS and iPadOS

Hi, guys. I was super excited to hear that voice over will be able to describe images in IOS 11. Does this mean games like Farm Story and Sim City will be more accessible? Does anyone have thoughts on this?

Options

Comments

By Erion on Thursday, July 27, 2017 - 00:23

Hello,
Only the basics. Common objects and possibly text will be recognised.
This means that inaccessible games are likely to stay that way. I am sorry.

By Remy on Thursday, July 27, 2017 - 00:23

Currently using the beta and I can say it's definetly in its infancy. But it is still a beta though.

By Ann Marie B on Sunday, August 27, 2017 - 00:23

In reply to by Erion

Hello.
Will videos with text inserted in them be accessible using Voice Over image /text recognition? ex. will Voice Over be able to read text within a video on face book while the video is playing?
Thanks

By Justin on Sunday, August 27, 2017 - 00:23

Hi,
Probably not. Think of Facebook's image thing. It'll say, something like Image is: 2 people, outdoor, text, but not what the text is. If you wanna know what the text is, you'd have to OCR on that image. I'm assuming here it'd be like how FB does the automatic image recognition.
HTH

By Bellsfurmama on Sunday, August 27, 2017 - 00:23

I didn't know you could read text within an image on FB. I don't know how to use OCR. How do you do that with NVDA or Voice Over?

I use NVDA on a desktop and voice over on my ipad.

By Justin on Sunday, August 27, 2017 - 00:23

FB will not read text inside an image, at least I think it won't. TO do OCR, you need a suitable app, like the recently released Seeing AI for iOS. It can do OCR on whatever printed materials you have in front of the camera. It is very easy to use and provides the simplest OCR. The only thing with that app is you can't recognize multiple pages at once, like in KNFB reader.

By Remy on Sunday, August 27, 2017 - 00:23

Actually, in IOS 11 you will be able to recognize some text within images by having your VO cursor on an image, then performing a single three finger tap. I just tried it, and it does work. It's not the be all and end all for us, but it's a good start. I don't think that will cary over to videos. I'll try it next time I play one. But what you can do for videos is take a screenshot by pressing home+lock buttons together, find the image in your photo album, then send it to an OCR app like seeing AI or Prismo Go and it will recognize the image for you. Actually, I believe it's Prismo Go which has a an option to "import most recently taken picture". Super helpful. To share a picture to another app, just hit the share button on the picture. The OCR app should be available by default, but if it isn't you may need to go to the "more" choice to find it. THen just make sure it's selected as an app you want shown. I'm in a real hurry or else I'd make this easier to understand. Please let it be known if you need clarification.

By Bellsfurmama on Sunday, August 27, 2017 - 00:23

Oh I love Seeing AI. It is an awesome app.

Will there be a blue tooth keyboard shortcut for OCR in IOS 11?

By Dave Nason on Sunday, August 27, 2017 - 00:23

Member of the AppleVis Editorial Team

Hi, just a quick reminder of AppleVis guidelines on discussion of betas. Please refrain from discussing specifics of the feature or how the feature operates and performs in the beta, as things can change between now and the official release. Many thanks.

By Remy on Sunday, August 27, 2017 - 00:23

Sorry Dave. Didn't mean to step on proverbial toes. Would be nice to be able to have a topic about the beta at the least. If we could gather all the many bugs with it then more people could give Apple feedback. Anyway, I'll try to refrain from discussing beta features in the future.