Seeing AI and new AI abilities

By Jurgen, 18 November, 2023

Forum
iOS and iPadOS

Hi,
a while ago I've read in the update description of Seeing AI about the new abilities connected to AI like searching the scanned document for certain content, see more detailed description of scenes and so forth.
I immediately looked in the app for this new functionallity but wasn't successful. And that's still the case.
Am I wrong about this new abilities of Seeing AI?
Or could someone tell me how to find them?
;Thanks and all the best
Jürgen

Options

Comments

By Brad on Thursday, November 23, 2023 - 08:29

Sometimes you need to go to the app store and actually search for the app then tap on update.

By OldBear on Thursday, November 23, 2023 - 08:29

I just checked the sceen function in case the options were taken away. It has a "More" selection at the bottom of the screen. This expanded the description from the generic "A room," to a fairly detailed description, like a stack of clothes and stack of papers and so on. The explore by touch option seems to also be working without crashing the app now.

By Laszlo on Thursday, November 23, 2023 - 08:29

It is important to note that these features work only if the phone language is set to English, or the language of the Seeing AI app is set to English. The latter can be set not in the app itself, but in the "Seeing AI" section of the Settings app. If these conditions are not met, then the "More info" button in the scene channel and the "Ask Seeing AI" button in the document channel will simply not appear. These are the buttons that provide access to the new capabilities.
Furthermore there is yet another caveat: if the language of the phone is not English, and if you share an image with Seeing AI in order to describe it via the share sheet, then the new, more detailed descriptions cannot be accessed, because the interface comes up in the language of the phone, regardless of what the language of the Seeing AI app is set to.
I have found out these with thorough experimentation and got confirmation from the Seeing AI team as well.

By Saqib on Thursday, November 23, 2023 - 08:29

Hi, yes, the new AI features should be there in version 5.2 - as @Brad suggested, you might need to manually update if your phone isn't set to download updates automatically.

From anyone - if you try out the new features - do please let us know via the feedback option in the menu, or email Seeing AI at Microsoft.com. We're continuing to improve the descriptions, and some other exciting new AI features in the works!

And, @Laszlo, we're also working on making at least the rich descriptions available in other languages.

By Jurgen on Thursday, November 23, 2023 - 08:29

Hi,
thanks a lot for all your enlightning comments. I live in Germany using german as the primary language. So that's why the new features don't appear on my iphone.
Thanks again and
all the best
Jürgen

By Laszlo on Thursday, November 23, 2023 - 08:29

Hi Saqib! In the meantime until rich descriptions are available in more languages, it would help many users if at least English rich descriptions were available regardless of phone language and the language of the Seeing AI app. Many users speak English as a secondary language like Jürgen and me. I think this workaround would be very quick to implement.
Hi Jürgen! From your name I presumed that you were using German iOS, that's why I noted the language issue, as it also hit me (I am Hungarian). For now as a workaround you can set the language of the Seeing AI app to English in the "Seeing AI" section of the Settings app,while setting the recognition language to German in the Seeeing AI app. The latter is for the short text and document channels. I use a setup like this for now and I am happy with it: I can enjoy the rich descriptions, while short text and document channels also work as expected: they recognise in my native language.

By blindpk on Thursday, November 23, 2023 - 08:29

I would also like to have the ability to have the English descriptions until more languages are available.

By Cordelia on Thursday, November 23, 2023 - 08:29

Thanks for pointing to the workaround. I was going to ask if such an option was available. Thanks.

By Jurgen on Thursday, November 23, 2023 - 08:29

Thanks a lot for all your helpful comments. And thanks for the idea to switch languages in Seeing AI.
Hopefully Microsoft will implement these helpful features for other languages as well. In my case german in deed.
All the best
Jürgen