IOS VO Image Recognition Question

iOS & iPadOS

Hi, guys. I was super excited to hear that voice over will be able to describe images in IOS 11. Does this mean games like Farm Story and Sim City will be more accessible? Does anyone have thoughts on this?



Submitted by Erion on Friday, July 21, 2017

Only the basics. Common objects and possibly text will be recognised.
This means that inaccessible games are likely to stay that way. I am sorry.

Submitted by Remy on Friday, July 21, 2017

Currently using the beta and I can say it's definetly in its infancy. But it is still a beta though.

Submitted by Ann Marie B on Wednesday, August 9, 2017

In reply to by Erion

Will videos with text inserted in them be accessible using Voice Over image /text recognition? ex. will Voice Over be able to read text within a video on face book while the video is playing?

Submitted by Justin on Wednesday, August 9, 2017

Probably not. Think of Facebook's image thing. It'll say, something like Image is: 2 people, outdoor, text, but not what the text is. If you wanna know what the text is, you'd have to OCR on that image. I'm assuming here it'd be like how FB does the automatic image recognition.

Submitted by Bellsfurmama on Wednesday, August 9, 2017

I didn't know you could read text within an image on FB. I don't know how to use OCR. How do you do that with NVDA or Voice Over?

I use NVDA on a desktop and voice over on my ipad.

Submitted by Justin on Wednesday, August 9, 2017

FB will not read text inside an image, at least I think it won't. TO do OCR, you need a suitable app, like the recently released Seeing AI for iOS. It can do OCR on whatever printed materials you have in front of the camera. It is very easy to use and provides the simplest OCR. The only thing with that app is you can't recognize multiple pages at once, like in KNFB reader.

Submitted by Remy on Wednesday, August 9, 2017

Actually, in IOS 11 you will be able to recognize some text within images by having your VO cursor on an image, then performing a single three finger tap. I just tried it, and it does work. It's not the be all and end all for us, but it's a good start. I don't think that will cary over to videos. I'll try it next time I play one. But what you can do for videos is take a screenshot by pressing home+lock buttons together, find the image in your photo album, then send it to an OCR app like seeing AI or Prismo Go and it will recognize the image for you. Actually, I believe it's Prismo Go which has a an option to "import most recently taken picture". Super helpful. To share a picture to another app, just hit the share button on the picture. The OCR app should be available by default, but if it isn't you may need to go to the "more" choice to find it. THen just make sure it's selected as an app you want shown. I'm in a real hurry or else I'd make this easier to understand. Please let it be known if you need clarification.

Submitted by Bellsfurmama on Thursday, August 10, 2017

Oh I love Seeing AI. It is an awesome app.

Will there be a blue tooth keyboard shortcut for OCR in IOS 11?

Submitted by Dave Nason on Thursday, August 10, 2017

Member of the AppleVis Editorial Team

Hi, just a quick reminder of AppleVis guidelines on discussion of betas. Please refrain from discussing specifics of the feature or how the feature operates and performs in the beta, as things can change between now and the official release. Many thanks.

Submitted by Remy on Thursday, August 10, 2017

Sorry Dave. Didn't mean to step on proverbial toes. Would be nice to be able to have a topic about the beta at the least. If we could gather all the many bugs with it then more people could give Apple feedback. Anyway, I'll try to refrain from discussing beta features in the future.