Availability of AI audio description for videos on Pixel devices
By Clayton Jacobs…, 24 December, 2024
Forum
Android
I don't know how many pixel users are aware of this feature, but this is especially useful in the YouTube app. If you touch the video player while the video is playing, you will get an AI description of what is being displayed on the screen.
Since Google officially hasn't announced any specific feature around Youtube Audio descriptions, I am guessing that this is the normal Talkback image description feature, and would work on any modern smartphone with updated OS and Talkback version, I don't know what are the latest numbers.
However, since the Gemini powered descriptions open up a popup to show descriptions, I am again guessing it's not using Gemini.
On my Moto Edge 50 Neo, with everything updated, when I tap on the video screen, Talkback announces: "Video player, double-tap to show video controls". By default, no descriptions for me. I've assigned a 3 finger single tap gesture to generate Gemini descriptions, which does work, but introduces a popup as previously suggested. For next seen, I have to close the popup by doing a back gesture and doing a 3 finger tap once again.
I would apreciate if you can do a screen-record of the way it's working on your pixel, upload it to Dropbox/GoogleDrive, and share the link for our understanding. Do be mindful about your privacy while doing so.
Meanwhile, I'll reach out to a pixel owner friend to test it out locally.
If what you said is indeed true, I am super intrigued about this feature.
Comments
Define: "Touch the video player"
is this with, or without talkback or any other screen reader?
In response to Brian
Yes, this is with TalkBack + all it requires is a single tap on the video player screen
Some burning questions!
Since Google officially hasn't announced any specific feature around Youtube Audio descriptions, I am guessing that this is the normal Talkback image description feature, and would work on any modern smartphone with updated OS and Talkback version, I don't know what are the latest numbers.
However, since the Gemini powered descriptions open up a popup to show descriptions, I am again guessing it's not using Gemini.
On my Moto Edge 50 Neo, with everything updated, when I tap on the video screen, Talkback announces: "Video player, double-tap to show video controls". By default, no descriptions for me. I've assigned a 3 finger single tap gesture to generate Gemini descriptions, which does work, but introduces a popup as previously suggested. For next seen, I have to close the popup by doing a back gesture and doing a 3 finger tap once again.
I would apreciate if you can do a screen-record of the way it's working on your pixel, upload it to Dropbox/GoogleDrive, and share the link for our understanding. Do be mindful about your privacy while doing so.
Meanwhile, I'll reach out to a pixel owner friend to test it out locally.
If what you said is indeed true, I am super intrigued about this feature.
I second this
I would love to listen to a demonstration of this feature in action. 🙂